-- Logs begin at Tue 2022-09-27 16:41:40 UTC, end at Tue 2022-09-27 17:49:32 UTC. -- Sep 27 17:15:42.899615 dv-cinder-849143-8-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 27 17:15:42.909170 dv-cinder-849143-8-iscsi devstack@n-api.service[105436]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 27 17:15:42.910475 dv-cinder-849143-8-iscsi devstack@n-api.service[105436]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Sep 27 17:15:42 2022] *** Sep 27 17:15:42.910475 dv-cinder-849143-8-iscsi devstack@n-api.service[105436]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 27 17:15:42.910475 dv-cinder-849143-8-iscsi devstack@n-api.service[105436]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 27 17:15:42.910475 dv-cinder-849143-8-iscsi devstack@n-api.service[105436]: nodename: dv-cinder-849143-8-iscsi Sep 27 17:15:42.910475 dv-cinder-849143-8-iscsi devstack@n-api.service[105436]: machine: x86_64 Sep 27 17:15:42.910475 dv-cinder-849143-8-iscsi devstack@n-api.service[105436]: clock source: unix Sep 27 17:15:42.910475 dv-cinder-849143-8-iscsi devstack@n-api.service[105436]: pcre jit disabled Sep 27 17:15:42.910475 dv-cinder-849143-8-iscsi devstack@n-api.service[105436]: detected number of CPU cores: 4 Sep 27 17:15:42.910475 dv-cinder-849143-8-iscsi devstack@n-api.service[105436]: current working directory: / Sep 27 17:15:42.910475 dv-cinder-849143-8-iscsi devstack@n-api.service[105436]: detected binary path: /usr/bin/uwsgi-core Sep 27 17:15:42.910475 dv-cinder-849143-8-iscsi devstack@n-api.service[105436]: your processes number limit is 47680 Sep 27 17:15:42.910475 dv-cinder-849143-8-iscsi devstack@n-api.service[105436]: your memory page size is 4096 bytes Sep 27 17:15:42.910475 dv-cinder-849143-8-iscsi devstack@n-api.service[105436]: detected max file descriptor number: 2048 Sep 27 17:15:42.911351 dv-cinder-849143-8-iscsi devstack@n-api.service[105436]: lock engine: pthread robust mutexes Sep 27 17:15:42.911351 dv-cinder-849143-8-iscsi devstack@n-api.service[105436]: thunder lock: enabled Sep 27 17:15:42.911351 dv-cinder-849143-8-iscsi devstack@n-api.service[105436]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 27 17:15:42.911351 dv-cinder-849143-8-iscsi devstack@n-api.service[105436]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 27 17:15:42.949706 dv-cinder-849143-8-iscsi devstack@n-api.service[105436]: Python main interpreter initialized at 0x564a5570b9c0 Sep 27 17:15:42.949706 dv-cinder-849143-8-iscsi devstack@n-api.service[105436]: python threads support enabled Sep 27 17:15:42.949706 dv-cinder-849143-8-iscsi devstack@n-api.service[105436]: your server socket listen backlog is limited to 100 connections Sep 27 17:15:42.949706 dv-cinder-849143-8-iscsi devstack@n-api.service[105436]: your mercy for graceful operations on workers is 90 seconds Sep 27 17:15:42.950034 dv-cinder-849143-8-iscsi devstack@n-api.service[105436]: mapped 403077 bytes (393 KB) for 2 cores Sep 27 17:15:42.950136 dv-cinder-849143-8-iscsi devstack@n-api.service[105436]: *** Operational MODE: preforking *** Sep 27 17:15:42.950388 dv-cinder-849143-8-iscsi devstack@n-api.service[105436]: *** uWSGI is running in multiple interpreter mode *** Sep 27 17:15:42.950388 dv-cinder-849143-8-iscsi devstack@n-api.service[105436]: spawned uWSGI master process (pid: 105436) Sep 27 17:15:42.950556 dv-cinder-849143-8-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 27 17:15:42.957572 dv-cinder-849143-8-iscsi devstack@n-api.service[105436]: spawned uWSGI worker 1 (pid: 105437, cores: 1) Sep 27 17:15:42.957572 dv-cinder-849143-8-iscsi devstack@n-api.service[105436]: spawned uWSGI worker 2 (pid: 105438, cores: 1) Sep 27 17:15:42.957572 dv-cinder-849143-8-iscsi devstack@n-api.service[105436]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 27 17:15:43.612940 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 27 17:15:43.613599 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 27 17:15:44.704462 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 27 17:15:44.704462 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: from cryptography.utils import int_from_bytes Sep 27 17:15:44.705199 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 27 17:15:44.705199 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: from cryptography.utils import int_from_bytes Sep 27 17:15:44.706376 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 27 17:15:44.706376 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: from cryptography.utils import int_from_bytes Sep 27 17:15:44.706808 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 27 17:15:44.706808 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: from cryptography.utils import int_from_bytes Sep 27 17:15:47.190406 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 27 17:15:47.190978 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 27 17:15:47.190978 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 27 17:15:47.191436 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 27 17:15:47.191436 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 27 17:15:47.191598 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 27 17:15:47.191684 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 27 17:15:47.191775 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 27 17:15:47.191855 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 27 17:15:47.191933 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 27 17:15:47.192156 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.192253 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.192507 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.192611 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.192831 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.192937 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.193151 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.193246 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.193482 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.193576 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.193793 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.193885 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.194136 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.194224 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.194458 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.194560 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.194788 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.194882 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.195048 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.195134 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.195364 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.195460 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.195690 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849143-8-iscsi {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.195828 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849143-8-iscsi {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.195999 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.196088 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.196307 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.196392 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.196618 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.196705 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.196938 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.197026 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.197241 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.197332 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.197564 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.197658 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.197868 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.197953 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.198394 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.198513 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.198834 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.198946 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.199143 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.199257 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.199454 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.199566 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.199788 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.199916 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.200103 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.200197 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.200413 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.200506 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.200734 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.200820 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.201046 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.201134 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.201373 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.201480 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.201685 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.201785 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.202100 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849143-8-iscsi {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.202208 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849143-8-iscsi {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.202426 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.202518 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.202740 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.202837 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.203055 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.203139 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.203467 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.203567 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.203781 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.203868 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.204091 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.204183 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.204415 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.204514 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.204741 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.204875 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.205053 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.205141 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.205383 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.205479 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.205707 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.205792 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.206028 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.206147 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.206386 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.206501 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.206695 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.206812 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.207009 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.207126 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.207323 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.207439 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.207648 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.207764 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.208484 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.208607 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.208781 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.208921 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.209036 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.209177 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.209348 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.209490 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.209673 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.209815 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.210003 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.210164 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.210356 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.210493 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.210613 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.210747 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.210869 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.211000 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.211194 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.211324 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.211520 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.211651 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.211833 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.211964 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.212148 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.212276 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.212461 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.212586 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.212773 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.212910 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.213085 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.213174 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.213394 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.213488 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.213705 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.213804 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.214015 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.214129 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.214366 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.214452 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.214687 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.214819 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.215012 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.215099 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.215321 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.215407 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.215644 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.215743 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.216042 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.55 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.216127 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.55 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.216300 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.55 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.216394 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.55 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.216612 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.216741 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.216952 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.217045 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.217274 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.217374 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.217584 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.217670 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.217905 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.217996 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.218254 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.218342 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.218565 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.218651 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.218874 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.218958 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.219185 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.219270 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.219509 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.219598 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.219846 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.219930 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.220154 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.220239 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.220407 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.220500 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.220710 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.220804 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.221017 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.221116 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.221338 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.221423 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.221646 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.221730 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.221954 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.222048 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.222288 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.222374 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.222592 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.222677 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.222900 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.223070 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.223205 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.223291 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.223560 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.224180 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.224380 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.224477 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.224691 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.224783 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.224999 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.225085 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.225303 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.225400 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.225610 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.225701 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.225916 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.226001 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.226246 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.226346 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.226569 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.226664 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.226894 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.226980 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.227204 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.227290 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.227510 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.227610 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.227819 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.227906 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.228390 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.228492 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.228712 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.228803 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.229020 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.229104 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.229326 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.229418 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.229649 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.229733 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.229955 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.230039 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.230287 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.230374 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.230606 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.230692 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.230915 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.231000 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.231221 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.231306 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.231541 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.231625 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.231845 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.231932 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.232153 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.232246 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.232470 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.232555 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.232779 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.232863 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.233085 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.233178 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.233389 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.233474 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.233694 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.233787 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.233999 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.234110 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.234329 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.234413 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.234635 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.234743 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.234942 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.235035 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.235245 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.235332 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.235567 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.235661 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.235892 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.235979 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.236201 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.236331 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.236509 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.236607 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.236816 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.236902 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.237138 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.237222 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:15:47.237472 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.237565 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.237806 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.237891 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.238178 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.238266 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.238497 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.238646 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.238831 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.238918 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.239195 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.239287 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.239515 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.239602 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.239834 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.239927 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.240149 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.240248 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.240481 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.240570 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.240795 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.240888 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.241111 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.241204 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.241425 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.241551 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.241753 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.241904 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.242092 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.242233 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.242437 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.242568 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.242758 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.242900 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.243075 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.243209 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.243396 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.243517 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.243709 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.243839 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.244030 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.244164 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.244358 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.244490 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.244681 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.244802 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.244993 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.245325 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.245325 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.245618 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.245769 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.245901 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.246040 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.246237 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.246388 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.246538 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.246685 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.246850 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.246937 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.247027 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.247238 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.247327 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.247549 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.247641 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.247897 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.248039 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.248199 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.248324 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.248514 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.248669 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.248827 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.248970 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.249132 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.249233 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.249455 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.249552 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.249768 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.249863 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.250131 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.250235 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.250411 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.250507 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.250723 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.250816 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.251031 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.251116 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.251366 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.251461 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.251684 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.251769 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.252011 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.252098 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.252325 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.252423 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.252638 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.252723 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.252956 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.253043 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.253268 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.253366 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.253580 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.253672 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.253889 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.253974 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.254222 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.254324 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.254528 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.254614 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.254861 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.254955 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.255172 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.255258 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.255477 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.255568 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.255799 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.255887 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.256127 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.256220 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.256436 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.256522 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.256771 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.256856 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.257077 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.257171 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.257388 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.257474 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.257699 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.257783 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.258009 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.258143 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.258342 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.258434 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.258655 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.258749 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.258970 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.259063 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.259280 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.259491 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.259605 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.259917 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.260053 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.260224 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.260547 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.260634 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.260854 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.261163 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.261249 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.261483 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.261790 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.261891 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.262120 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.262405 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.262504 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.262737 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.263047 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.263140 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.263368 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.263593 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.263687 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.264001 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.264178 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.264336 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.264645 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.264738 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.264971 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.265292 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.265418 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.265609 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.265891 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.266029 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.266222 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.266347 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.266623 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.266783 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.266905 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.267021 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.267150 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.267387 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.267515 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.267752 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.267881 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.267994 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.268302 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.268442 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.268610 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.268756 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.268928 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.269138 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.269278 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.269473 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.269608 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.269800 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.269930 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.270136 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.270268 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.271097 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.271233 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.271355 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.271439 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.271945 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.272032 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.272101 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.272182 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.272251 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.272317 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.272828 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.272912 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.272981 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.273057 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.273126 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.273192 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.273720 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.273818 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.273888 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.273964 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.274040 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.274130 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.274527 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.274630 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.274710 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.274797 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.275057 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.275144 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.275344 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.275436 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.275625 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.275711 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.275910 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.276005 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.276231 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.276325 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.276585 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.276694 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.276938 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.277041 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.277216 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.277303 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.277483 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.277580 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.277851 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.277948 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.278176 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.278271 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.278457 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.278545 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.278771 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.278863 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.279080 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.279182 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.279397 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.279491 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.279709 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.279803 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.280021 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.280129 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.280331 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.280425 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.280642 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.280734 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.280960 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.281063 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.281267 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.281360 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.281583 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.281675 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.281895 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.281998 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.282246 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.282341 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.282558 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.282651 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.282876 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.282979 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.283182 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.283275 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.283496 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.283589 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.283809 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.283902 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.284125 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.284218 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.284440 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.284534 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.284751 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.284842 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.285070 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.285169 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.285381 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.285472 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.285694 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.285787 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.286029 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.286674 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.286949 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.287052 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.287254 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.287349 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.287570 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.287674 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.287876 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.287989 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.288192 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.288293 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.288507 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.288608 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.288817 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.288917 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.289135 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.289233 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.289449 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.289549 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.289761 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.289863 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.290094 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.290199 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.290399 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.290489 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.290712 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.290811 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.291023 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.291113 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.291332 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.291422 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.291648 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.291738 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.291953 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.292041 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.292260 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.292354 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.292572 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.292670 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.292884 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.293015 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.293191 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.293323 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.293499 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.293635 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.293803 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.293933 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.294133 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.294267 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.294451 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.294583 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.294760 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.294896 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.295076 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.295216 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.295399 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.295529 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.295709 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.295847 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.296024 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.296165 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.296334 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.296465 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.296645 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.296774 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.296951 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.297180 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.297312 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.297446 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.297574 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.297699 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.297863 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.298004 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.298238 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.298393 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.298523 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.298649 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.298800 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.298941 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.299124 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.299255 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.299434 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.299566 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.299746 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.299875 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.300053 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.300190 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.300359 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.300496 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.300669 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.300798 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.301371 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.301505 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.301613 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.301613 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.301829 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.301939 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.302058 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.302289 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.302401 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.302558 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.302690 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.302875 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.302994 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.303203 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.303330 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.303516 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.303632 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.303820 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.303932 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.304130 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.304247 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.304437 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.304566 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.304751 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.304868 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.305072 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.305186 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.305387 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.305644 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.305761 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.305981 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.306121 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.306312 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.306437 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.306621 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.306755 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.306933 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.307065 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.307297 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.307441 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.307570 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.307704 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.307830 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.307956 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.308111 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.308248 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.308457 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.308596 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.308725 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.308852 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.309020 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.309152 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.309327 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.309467 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.309658 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.309791 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.309970 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.310161 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.310302 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.310430 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.310592 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.310733 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.310897 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.311028 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.311205 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.311335 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.311513 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.311646 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.311820 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.311951 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.312490 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.312623 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.312731 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.312841 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.312948 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.313069 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.313188 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.313295 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.313409 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.313517 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.313646 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.313772 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.313959 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.314099 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.314292 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.314408 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.314600 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.314728 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.316547 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.317279 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.317279 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.317614 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.317759 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.317900 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.318030 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.318183 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.318313 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.318457 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.318669 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.318803 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.318931 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.319057 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.319186 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.319328 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.319457 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.319585 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.319711 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.319838 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.319965 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.320101 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.320230 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.320358 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.320484 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.320611 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.320737 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.320874 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.321003 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.321138 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.321268 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.321395 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.321530 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.321659 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.321795 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.321924 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.322051 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.322218 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.322367 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.322503 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.322632 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.322759 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.322886 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.323013 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.323150 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.323286 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.323415 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.323551 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.323687 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.323816 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.323953 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.324090 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.324226 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.324363 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.324491 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.324618 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.324759 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.324907 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.325046 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.325174 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.325315 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.325455 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.325588 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.325723 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.325851 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.325985 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.326128 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.326270 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.326407 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.326537 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.326663 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.326780 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.326916 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.327059 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.327188 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.327314 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.327441 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.327650 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.327780 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.327917 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.328045 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.328172 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.328298 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.328425 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.328563 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.328775 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.328921 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.329051 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.329178 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.329305 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.329441 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.329570 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.329697 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.329825 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.329960 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.330129 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.330347 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.330488 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.330618 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.330756 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.330885 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.331019 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.331157 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.331286 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.331413 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.331539 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.331673 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.331811 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.331946 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.332074 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.332209 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.332345 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.332485 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.332626 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.332755 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.333404 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.333544 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.333673 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.333800 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.333936 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.334065 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.334209 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.334324 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.334449 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.334575 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.334715 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.334845 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.334971 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.335097 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.335223 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.335364 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.335496 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.335631 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.335772 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.335902 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.336029 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.336163 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.336291 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.336417 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.336542 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.336677 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.336793 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.336908 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.337036 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.337161 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.337288 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.337413 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.337539 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.337691 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.337886 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.338024 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.338211 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.338350 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.338569 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.338699 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.338905 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.339036 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.339162 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.339289 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.339425 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.339553 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.339679 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.339806 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.339931 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.340065 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.340203 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.340330 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.340456 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.340581 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.340786 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.340918 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.341093 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.341226 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.341408 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.341548 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.341722 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.341862 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.342034 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.342204 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.342373 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.342505 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.342681 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.342824 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.342994 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.343123 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.343300 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.343438 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.343613 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.343751 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.343928 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.344066 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.344243 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.344421 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.344558 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.344696 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.344852 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.345090 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.345220 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.345419 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.345565 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.345741 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.345872 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.346060 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.346232 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.346392 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.346536 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.346704 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.346833 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.347019 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.347150 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.347334 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.347474 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.347643 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.347773 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.348011 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.348149 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.348317 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.348458 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.349188 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.349382 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.349512 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.349647 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.349806 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.349947 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.350146 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.350290 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.350458 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.350590 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.350788 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.350920 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.351095 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.351224 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.351420 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.351549 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.351821 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.351951 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.352134 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.352271 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.352445 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.352575 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.352753 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.352883 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.353325 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.353463 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.353639 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.353781 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.353971 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.354149 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.354290 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.354426 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.354603 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.354748 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.354911 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.355041 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.355237 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.355367 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.355545 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.355685 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.355902 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.356050 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.356211 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.356342 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.356528 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.356660 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.356847 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.356988 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.357156 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.357293 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.357483 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.357615 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.357808 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.357950 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.358180 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.358311 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.358460 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.358592 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.358862 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.358994 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.359174 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.359313 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.359520 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.359649 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.359784 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.359910 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.360105 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.360244 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.360414 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.360544 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.360722 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.360852 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.361033 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.361163 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.361340 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.361476 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.361645 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.361781 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.361973 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.362156 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.362306 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.362449 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.362622 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.362751 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.362936 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.363073 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.363247 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.363385 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.363555 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.363684 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.363860 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.363989 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.364209 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.364354 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.364516 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.364648 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.364842 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.364974 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.365156 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.365299 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.365470 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.365600 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.365780 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.365919 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.366104 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.366238 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.366427 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.366557 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.366738 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.366879 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.367105 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.367245 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.367374 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.367501 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.367628 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.367754 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.367939 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.368071 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.368278 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.368417 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.368555 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.368683 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.368865 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.369020 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.369203 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.369332 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.369570 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.369788 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.369920 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.370048 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.370275 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.370406 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.370548 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.370686 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.370815 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.370941 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.371068 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.371194 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.371328 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.371454 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.371625 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.371756 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.371968 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.372100 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.372277 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.372417 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.372582 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.372719 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.372889 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.373020 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.373196 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.373328 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.373507 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.373639 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.373817 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.373955 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.374136 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.374268 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.374442 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.374573 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.374769 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.374900 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.375077 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.375216 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.375403 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.375534 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.375715 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.375855 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.376020 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.376151 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.376325 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.376463 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.376630 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.376770 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.376936 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.377065 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.377273 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.377410 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.377546 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.377683 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.377846 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.377977 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.378179 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.378403 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.378534 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.378668 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.378803 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.378937 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.379094 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.379226 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.379420 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.379566 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.380305 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.380439 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.380566 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.380692 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.380851 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.380985 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.381159 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.381290 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.381491 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.381613 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.381798 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.381927 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.382140 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.382275 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.382456 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.382672 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.382815 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.383007 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.383139 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.383327 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.383460 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.383646 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.383786 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.383963 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.384102 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.384282 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.384413 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.384600 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.384733 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.384914 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.385043 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.385226 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.385355 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.385542 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.385679 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.385853 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.385996 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.386207 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.386350 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.386532 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.386728 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.386859 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.387065 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.387196 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.387424 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.387562 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.387689 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.387815 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.387999 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.388137 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.388318 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.388526 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.388657 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.388784 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.388938 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.389069 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.389253 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.389387 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.389567 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.389698 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.389882 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.390028 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.390241 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.390456 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.390587 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.390727 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.390856 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.390992 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.391170 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.391301 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.391487 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.391620 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.391804 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.391949 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.392118 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.392249 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.392435 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.392566 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.392738 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.392869 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.393066 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.393206 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.393377 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.393507 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.393695 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.393827 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.394013 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.394177 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.394356 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.394500 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.394675 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.394816 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.395032 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.395196 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.395397 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.396109 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.396241 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.396449 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.396582 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.396780 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.396948 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.397111 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.397243 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.397433 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.397578 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.397753 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.397893 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.398117 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.398252 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.398413 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.398557 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.398751 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.398903 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.399032 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.399159 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.399320 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.399453 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.399629 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.399835 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.399968 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.400146 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.400277 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.400493 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.400641 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.400807 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.400949 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.401136 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.401267 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.401456 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.401679 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.401812 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.402114 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.402247 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.402428 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.402558 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.402736 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.402879 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.403048 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.403180 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.403360 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.403498 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.403670 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.403802 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.403996 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.404126 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.404307 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.404447 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.404613 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.404743 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.404928 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.405059 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.405238 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.405381 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.405543 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.405775 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.405915 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.406152 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.406297 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.406478 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.406611 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.406785 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.406916 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.407098 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.407231 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.407405 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.407537 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.407735 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.407867 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.408045 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.408176 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.408353 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.408486 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.408661 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.408875 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.409014 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.409158 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.409289 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.409415 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.409542 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.409669 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.409848 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.409993 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.410176 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.410321 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.410494 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.410700 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.410830 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.410988 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.411128 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.411240 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.411420 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.411561 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.411770 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.411905 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.412093 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.412222 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.412404 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.412536 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.412715 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.412847 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.413030 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.413169 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.413336 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.413474 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.413642 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.413774 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.413948 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.414119 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.414284 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.414415 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.414602 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.414734 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.414912 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.415051 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.415224 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.415362 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.415532 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.415662 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.415846 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.415985 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.416202 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.416405 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.416537 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.416744 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.416884 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.417069 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.417200 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.417404 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.417537 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.417726 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.417854 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.418036 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.418207 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.418373 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.418505 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.418684 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.418816 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.419022 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.419150 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.419286 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.419413 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.419616 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.419745 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.419928 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.420067 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.420244 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.420472 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.420601 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.420820 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.420959 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.421131 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.421264 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.421460 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.421602 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.421771 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.421903 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.422127 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.422265 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.422415 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.422545 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.422724 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.422867 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.423036 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.423167 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.423347 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.423479 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.423662 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.423805 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.423976 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.424115 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.424291 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.424423 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.424605 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.424746 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.424918 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.425051 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.425232 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.425363 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.425542 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.425673 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.425852 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.425981 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.426188 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.426321 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.426500 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.426654 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.426838 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.426968 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.427157 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.427289 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.427472 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.427603 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.427776 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.427901 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.428123 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.428448 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.428586 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.428769 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.428899 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.429106 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.429252 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.429464 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.429603 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.429739 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.429866 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.429993 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.430156 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.430324 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.430457 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.430637 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.430769 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.430981 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.431120 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.431257 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.431394 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.431588 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.431726 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.431900 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.432045 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.432241 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.432570 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.432699 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.432879 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.433010 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.433189 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.433321 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.433498 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.433629 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.433810 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.434103 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.434251 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.434381 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.434517 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.434645 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.434773 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.434909 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.435041 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.435167 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.435329 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.435461 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.435636 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.435781 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.435945 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.436075 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.436250 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.436381 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.436557 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.436699 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.436867 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.436998 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.437174 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.437305 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.437479 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.437612 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.437787 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.437918 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.438121 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.438256 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.438417 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.438587 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.438718 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.438854 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.439018 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.439172 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.439381 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.439513 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.439646 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.439775 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.439901 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.440035 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.440194 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.440326 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.440549 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.440696 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.440827 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.440963 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.441139 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.441269 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.441439 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.441570 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.441749 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.441896 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.442059 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.442727 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.442908 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.443040 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.443219 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.443364 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.443532 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.443670 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.443840 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.443972 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.444179 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.444331 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.444468 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.444597 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.444745 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.444876 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.445052 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.445177 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.445372 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.445503 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.445687 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.445819 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.445998 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.446162 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.446336 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.446468 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.446649 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.446780 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.446975 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.447114 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.447291 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.447422 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.447596 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.447733 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.447923 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.448046 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.448240 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.448378 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.448552 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.448690 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.448868 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.448997 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.449180 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.449312 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.449525 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.449666 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.449795 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.449928 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.450118 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.450252 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.450431 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.450576 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.450743 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.450872 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.451062 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.451193 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.451379 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.451519 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.451686 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.451824 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.452000 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.452136 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.452317 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.452449 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.452634 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.452765 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.452948 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.453086 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.453263 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.453403 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.453576 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.453705 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.453895 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.454035 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.454286 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.454437 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.454568 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.454694 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.454856 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.455002 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.455172 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.455310 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.455490 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.455621 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.455804 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.455945 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.456120 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.456253 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.456435 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.456565 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.456705 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105437) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 27 17:15:47.456841 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.457067 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.457394 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.457714 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.458628 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.458963 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.459313 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.459633 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.459979 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.460314 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.460636 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.460953 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.461263 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:15:47.461509 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105438) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 27 17:15:47.611406 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: INFO dbcounter [None req-e0fa7306-ae1b-4cd8-ae7a-405a0b77ac08 None None] Registered counter for database nova_api Sep 27 17:15:47.613832 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: INFO dbcounter [None req-1f887ba1-daf9-4979-9a3a-f394784a4d1b None None] Registered counter for database nova_api Sep 27 17:15:47.631913 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG oslo_db.sqlalchemy.engines [None req-e0fa7306-ae1b-4cd8-ae7a-405a0b77ac08 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105437) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 27 17:15:47.633694 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG oslo_db.sqlalchemy.engines [None req-1f887ba1-daf9-4979-9a3a-f394784a4d1b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105438) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 27 17:15:47.638580 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG dbcounter [-] [105437] Writer thread running {{(pid=105437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 27 17:15:47.640306 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG dbcounter [-] [105438] Writer thread running {{(pid=105438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 27 17:15:47.695486 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.context [None req-e0fa7306-ae1b-4cd8-ae7a-405a0b77ac08 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b2a4a363-82fa-43f0-a614-939b4985f9a0(cell1) {{(pid=105437) load_cells /opt/stack/nova/nova/context.py:464}} Sep 27 17:15:47.696611 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.context [None req-1f887ba1-daf9-4979-9a3a-f394784a4d1b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b2a4a363-82fa-43f0-a614-939b4985f9a0(cell1) {{(pid=105438) load_cells /opt/stack/nova/nova/context.py:464}} Sep 27 17:15:47.699317 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG oslo_concurrency.lockutils [None req-e0fa7306-ae1b-4cd8-ae7a-405a0b77ac08 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:15:47.699794 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG oslo_concurrency.lockutils [None req-e0fa7306-ae1b-4cd8-ae7a-405a0b77ac08 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:15:47.700495 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG oslo_concurrency.lockutils [None req-1f887ba1-daf9-4979-9a3a-f394784a4d1b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:15:47.700968 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG oslo_concurrency.lockutils [None req-1f887ba1-daf9-4979-9a3a-f394784a4d1b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:15:47.701363 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG oslo_concurrency.lockutils [None req-e0fa7306-ae1b-4cd8-ae7a-405a0b77ac08 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:15:47.702110 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG oslo_concurrency.lockutils [None req-e0fa7306-ae1b-4cd8-ae7a-405a0b77ac08 None None] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:15:47.702563 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG oslo_concurrency.lockutils [None req-e0fa7306-ae1b-4cd8-ae7a-405a0b77ac08 None None] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:15:47.702676 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG oslo_concurrency.lockutils [None req-1f887ba1-daf9-4979-9a3a-f394784a4d1b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:15:47.703285 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG oslo_concurrency.lockutils [None req-1f887ba1-daf9-4979-9a3a-f394784a4d1b None None] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:15:47.703726 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG oslo_concurrency.lockutils [None req-1f887ba1-daf9-4979-9a3a-f394784a4d1b None None] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:15:47.704545 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG oslo_concurrency.lockutils [None req-e0fa7306-ae1b-4cd8-ae7a-405a0b77ac08 None None] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:15:47.705679 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG oslo_concurrency.lockutils [None req-1f887ba1-daf9-4979-9a3a-f394784a4d1b None None] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105438) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:15:47.706550 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: INFO dbcounter [None req-e0fa7306-ae1b-4cd8-ae7a-405a0b77ac08 None None] Registered counter for database nova_cell0 Sep 27 17:15:47.707687 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: INFO dbcounter [None req-1f887ba1-daf9-4979-9a3a-f394784a4d1b None None] Registered counter for database nova_cell0 Sep 27 17:15:47.711098 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: INFO dbcounter [None req-e0fa7306-ae1b-4cd8-ae7a-405a0b77ac08 None None] Registered counter for database nova_cell1 Sep 27 17:15:47.712227 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: INFO dbcounter [None req-1f887ba1-daf9-4979-9a3a-f394784a4d1b None None] Registered counter for database nova_cell1 Sep 27 17:15:47.718174 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG oslo_db.sqlalchemy.engines [None req-e0fa7306-ae1b-4cd8-ae7a-405a0b77ac08 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105437) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 27 17:15:47.719774 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG oslo_db.sqlalchemy.engines [None req-1f887ba1-daf9-4979-9a3a-f394784a4d1b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105438) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 27 17:15:47.722937 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG dbcounter [-] [105437] Writer thread running {{(pid=105437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 27 17:15:47.724664 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG dbcounter [-] [105438] Writer thread running {{(pid=105438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 27 17:15:47.725320 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG oslo_db.sqlalchemy.engines [None req-1f887ba1-daf9-4979-9a3a-f394784a4d1b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105438) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 27 17:15:47.857895 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG oslo_db.sqlalchemy.engines [None req-e0fa7306-ae1b-4cd8-ae7a-405a0b77ac08 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105437) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 27 17:15:47.863362 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG dbcounter [-] [105437] Writer thread running {{(pid=105437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 27 17:15:47.867093 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG dbcounter [-] [105438] Writer thread running {{(pid=105438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 27 17:15:47.872328 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: INFO dbcounter [None req-e0fa7306-ae1b-4cd8-ae7a-405a0b77ac08 None None] Registered counter for database nova_cell0 Sep 27 17:15:47.875729 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: INFO dbcounter [None req-1f887ba1-daf9-4979-9a3a-f394784a4d1b None None] Registered counter for database nova_cell0 Sep 27 17:15:47.881100 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG oslo_db.sqlalchemy.engines [None req-e0fa7306-ae1b-4cd8-ae7a-405a0b77ac08 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105437) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 27 17:15:47.884661 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG oslo_db.sqlalchemy.engines [None req-1f887ba1-daf9-4979-9a3a-f394784a4d1b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105438) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 27 17:15:47.885717 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG dbcounter [-] [105437] Writer thread running {{(pid=105437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 27 17:15:47.889340 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG dbcounter [-] [105438] Writer thread running {{(pid=105438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 27 17:15:48.221338 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: WARNING keystonemiddleware.auth_token [None req-e0fa7306-ae1b-4cd8-ae7a-405a0b77ac08 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 27 17:15:48.225524 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: WARNING keystonemiddleware.auth_token [None req-1f887ba1-daf9-4979-9a3a-f394784a4d1b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 27 17:15:48.229379 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: WARNING keystonemiddleware.auth_token [None req-e0fa7306-ae1b-4cd8-ae7a-405a0b77ac08 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 27 17:15:48.233125 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: WARNING keystonemiddleware.auth_token [None req-1f887ba1-daf9-4979-9a3a-f394784a4d1b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 27 17:15:48.570279 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: WARNING keystonemiddleware.auth_token [None req-e0fa7306-ae1b-4cd8-ae7a-405a0b77ac08 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 27 17:15:48.576140 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: WARNING keystonemiddleware.auth_token [None req-e0fa7306-ae1b-4cd8-ae7a-405a0b77ac08 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 27 17:15:48.579623 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: WARNING keystonemiddleware.auth_token [None req-1f887ba1-daf9-4979-9a3a-f394784a4d1b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 27 17:15:48.581453 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564a5570b9c0 pid: 105437 (default app) Sep 27 17:15:48.583584 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi [None req-e0fa7306-ae1b-4cd8-ae7a-405a0b77ac08 None None] Calling method '>' {{(pid=105437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:15:48.584770 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: INFO nova.api.openstack.requestlog [None req-e0fa7306-ae1b-4cd8-ae7a-405a0b77ac08 None None] 10.222.0.55 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001761 Sep 27 17:15:48.585177 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: [pid: 105437|app: 0|req: 1/1] 10.222.0.55 () {50 vars in 788 bytes} [Tue Sep 27 17:15:48 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:15:48.585586 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: WARNING keystonemiddleware.auth_token [None req-1f887ba1-daf9-4979-9a3a-f394784a4d1b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 27 17:15:48.590859 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564a5570b9c0 pid: 105438 (default app) Sep 27 17:17:10.343085 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi [None req-e0fa7306-ae1b-4cd8-ae7a-405a0b77ac08 None None] Calling method '>' {{(pid=105437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:17:10.344097 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: INFO nova.api.openstack.requestlog [None req-e0fa7306-ae1b-4cd8-ae7a-405a0b77ac08 None None] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Sep 27 17:17:10.344674 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: [pid: 105437|app: 0|req: 2/2] 10.222.0.55 () {54 vars in 931 bytes} [Tue Sep 27 17:17:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:17:10.362561 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG dbcounter [-] [105438] Writing DB stats nova_api:SELECT=3 {{(pid=105438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:17:10.363690 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG dbcounter [-] [105438] Writing DB stats nova_cell0:SELECT=3 {{(pid=105438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:17:10.364578 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG dbcounter [-] [105438] Writing DB stats nova_cell1:SELECT=3 {{(pid=105438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:17:10.365406 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG dbcounter [-] [105438] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:17:11.228053 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi [None req-f6001afe-564d-44fc-9531-f44ea6d8715d admin admin] Calling method '>' {{(pid=105438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:17:11.261008 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: INFO nova.api.openstack.requestlog [None req-f6001afe-564d-44fc-9531-f44ea6d8715d admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.909021 Sep 27 17:17:11.261794 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: [pid: 105438|app: 0|req: 1/3] 10.222.0.55 () {60 vars in 1292 bytes} [Tue Sep 27 17:17:10 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:17:13.884022 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi [None req-e0fa7306-ae1b-4cd8-ae7a-405a0b77ac08 None None] Calling method '>' {{(pid=105437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:17:13.885049 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: INFO nova.api.openstack.requestlog [None req-e0fa7306-ae1b-4cd8-ae7a-405a0b77ac08 None None] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Sep 27 17:17:13.885440 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: [pid: 105437|app: 0|req: 3/4] 10.222.0.55 () {54 vars in 931 bytes} [Tue Sep 27 17:17:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:17:14.350064 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi [None req-3629d4f9-de53-4e38-ac10-bb481ff8045b admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "cirros256", "rxtx_factor": 1.0, "disk": 1, "swap": 0, "id": "c1", "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=105438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:17:14.397214 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: INFO nova.api.openstack.requestlog [None req-3629d4f9-de53-4e38-ac10-bb481ff8045b admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.505598 Sep 27 17:17:14.397786 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: [pid: 105438|app: 0|req: 2/5] 10.222.0.55 () {64 vars in 1283 bytes} [Tue Sep 27 17:17:13 2022] POST /compute/v2.1/flavors => generated 407 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 17:17:14.412094 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG dbcounter [-] [105437] Writing DB stats nova_api:SELECT=3 {{(pid=105437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:17:14.412974 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG dbcounter [-] [105437] Writing DB stats nova_cell1:SELECT=3 {{(pid=105437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:17:14.414954 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG dbcounter [-] [105437] Writing DB stats nova_cell0:SELECT=3 {{(pid=105437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:17:14.416265 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG dbcounter [-] [105437] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:17:14.620523 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi [None req-4f821068-ede2-485b-b12d-dcaa33f134ec admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:17:14.692243 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: INFO nova.api.openstack.requestlog [None req-4f821068-ede2-485b-b12d-dcaa33f134ec admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.285988 Sep 27 17:17:14.692828 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: [pid: 105437|app: 0|req: 4/6] 10.222.0.55 () {64 vars in 1336 bytes} [Tue Sep 27 17:17:14 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:17:17.328256 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi [None req-3629d4f9-de53-4e38-ac10-bb481ff8045b admin admin] Calling method '>' {{(pid=105438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:17:17.329323 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: INFO nova.api.openstack.requestlog [None req-3629d4f9-de53-4e38-ac10-bb481ff8045b admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Sep 27 17:17:17.330005 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: [pid: 105438|app: 0|req: 3/7] 10.222.0.55 () {54 vars in 931 bytes} [Tue Sep 27 17:17:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:17:18.002927 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi [None req-d03def2b-9955-4036-b3af-052b033a4b93 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 512, "rxtx_factor": 1.0, "disk": 5, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "swap": 0, "id": "d1"}} {{(pid=105437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:17:18.042311 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: INFO nova.api.openstack.requestlog [None req-d03def2b-9955-4036-b3af-052b033a4b93 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.706225 Sep 27 17:17:18.046151 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: [pid: 105437|app: 0|req: 5/8] 10.222.0.55 () {64 vars in 1283 bytes} [Tue Sep 27 17:17:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 17:17:18.056099 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi [None req-c9690763-9f41-491f-a0a3-12d7b3eb723d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:17:18.095321 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: INFO nova.api.openstack.requestlog [None req-c9690763-9f41-491f-a0a3-12d7b3eb723d admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043245 Sep 27 17:17:18.095905 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: [pid: 105438|app: 0|req: 4/9] 10.222.0.55 () {64 vars in 1336 bytes} [Tue Sep 27 17:17:18 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:17:20.729076 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi [None req-d03def2b-9955-4036-b3af-052b033a4b93 admin admin] Calling method '>' {{(pid=105437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:17:20.730062 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: INFO nova.api.openstack.requestlog [None req-d03def2b-9955-4036-b3af-052b033a4b93 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001561 Sep 27 17:17:20.730497 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: [pid: 105437|app: 0|req: 6/10] 10.222.0.55 () {54 vars in 931 bytes} [Tue Sep 27 17:17:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:17:21.145988 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi [None req-baec9791-893e-4b34-9d5f-4c1430cc9cf2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "ds1G", "disk": 10, "id": "d2", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 1024}} {{(pid=105438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:17:21.165853 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: INFO nova.api.openstack.requestlog [None req-baec9791-893e-4b34-9d5f-4c1430cc9cf2 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.428009 Sep 27 17:17:21.166445 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: [pid: 105438|app: 0|req: 5/11] 10.222.0.55 () {64 vars in 1283 bytes} [Tue Sep 27 17:17:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 17:17:21.178561 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi [None req-b97837dc-9a0b-4d47-b1e4-b435b3a3f1d8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:17:21.207740 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: INFO nova.api.openstack.requestlog [None req-b97837dc-9a0b-4d47-b1e4-b435b3a3f1d8 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032938 Sep 27 17:17:21.208325 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: [pid: 105437|app: 0|req: 7/12] 10.222.0.55 () {64 vars in 1336 bytes} [Tue Sep 27 17:17:21 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:17:23.843339 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi [None req-baec9791-893e-4b34-9d5f-4c1430cc9cf2 admin admin] Calling method '>' {{(pid=105438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:17:23.844353 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: INFO nova.api.openstack.requestlog [None req-baec9791-893e-4b34-9d5f-4c1430cc9cf2 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Sep 27 17:17:23.845371 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: [pid: 105438|app: 0|req: 6/13] 10.222.0.55 () {54 vars in 931 bytes} [Tue Sep 27 17:17:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:17:24.258694 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi [None req-15dbfeac-04c8-4bd3-a717-98c18d445803 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "swap": 0, "name": "ds2G", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 2048, "id": "d3"}} {{(pid=105437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:17:24.279106 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: INFO nova.api.openstack.requestlog [None req-15dbfeac-04c8-4bd3-a717-98c18d445803 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.427657 Sep 27 17:17:24.283196 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: [pid: 105437|app: 0|req: 8/14] 10.222.0.55 () {64 vars in 1283 bytes} [Tue Sep 27 17:17:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 17:17:24.291958 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi [None req-aebcd980-0dfe-4ea8-a426-c1d00f3a1cb2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:17:24.324643 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: INFO nova.api.openstack.requestlog [None req-aebcd980-0dfe-4ea8-a426-c1d00f3a1cb2 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036205 Sep 27 17:17:24.325335 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: [pid: 105438|app: 0|req: 7/15] 10.222.0.55 () {64 vars in 1336 bytes} [Tue Sep 27 17:17:24 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:17:26.966746 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi [None req-15dbfeac-04c8-4bd3-a717-98c18d445803 admin admin] Calling method '>' {{(pid=105437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:17:26.967766 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: INFO nova.api.openstack.requestlog [None req-15dbfeac-04c8-4bd3-a717-98c18d445803 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001541 Sep 27 17:17:26.968186 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: [pid: 105437|app: 0|req: 9/16] 10.222.0.55 () {54 vars in 931 bytes} [Tue Sep 27 17:17:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:17:27.392020 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi [None req-e3089f08-9a83-4c7b-873a-eb9f0fa560c9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "ram": 4096, "rxtx_factor": 1.0, "vcpus": 4, "id": "d4", "disk": 20}} {{(pid=105438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:17:27.411483 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: INFO nova.api.openstack.requestlog [None req-e3089f08-9a83-4c7b-873a-eb9f0fa560c9 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.436961 Sep 27 17:17:27.412064 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: [pid: 105438|app: 0|req: 8/17] 10.222.0.55 () {64 vars in 1283 bytes} [Tue Sep 27 17:17:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 17:17:27.424516 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi [None req-4cc0e931-b562-4927-ae6f-157cdf98eb8b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:17:27.449129 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: INFO nova.api.openstack.requestlog [None req-4cc0e931-b562-4927-ae6f-157cdf98eb8b admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028520 Sep 27 17:17:27.449698 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: [pid: 105437|app: 0|req: 10/18] 10.222.0.55 () {64 vars in 1336 bytes} [Tue Sep 27 17:17:27 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:17:30.053620 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi [None req-e3089f08-9a83-4c7b-873a-eb9f0fa560c9 admin admin] Calling method '>' {{(pid=105438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:17:30.054891 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: INFO nova.api.openstack.requestlog [None req-e3089f08-9a83-4c7b-873a-eb9f0fa560c9 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001695 Sep 27 17:17:30.055246 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: [pid: 105438|app: 0|req: 9/19] 10.222.0.55 () {54 vars in 931 bytes} [Tue Sep 27 17:17:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:17:30.457174 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi [None req-090e9eab-8b13-4672-bec0-30dd582fd784 admin admin] Calling method '>' {{(pid=105437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:17:30.482533 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: INFO nova.api.openstack.requestlog [None req-090e9eab-8b13-4672-bec0-30dd582fd784 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.421290 Sep 27 17:17:30.483065 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: [pid: 105437|app: 0|req: 11/20] 10.222.0.55 () {60 vars in 1292 bytes} [Tue Sep 27 17:17:30 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:17:33.144651 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi [None req-e3089f08-9a83-4c7b-873a-eb9f0fa560c9 admin admin] Calling method '>' {{(pid=105438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:17:33.145676 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: INFO nova.api.openstack.requestlog [None req-e3089f08-9a83-4c7b-873a-eb9f0fa560c9 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Sep 27 17:17:33.146086 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: [pid: 105438|app: 0|req: 10/21] 10.222.0.55 () {54 vars in 931 bytes} [Tue Sep 27 17:17:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:17:33.551085 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi [None req-1fdca31e-cd16-4a40-82d0-6efe95bac6d2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "1", "swap": 0, "ram": 512, "rxtx_factor": 1.0, "name": "m1.tiny", "vcpus": 1, "disk": 1}} {{(pid=105437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:17:33.571544 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: INFO nova.api.openstack.requestlog [None req-1fdca31e-cd16-4a40-82d0-6efe95bac6d2 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.419534 Sep 27 17:17:33.572298 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: [pid: 105437|app: 0|req: 12/22] 10.222.0.55 () {64 vars in 1283 bytes} [Tue Sep 27 17:17:33 2022] POST /compute/v2.1/flavors => generated 402 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 27 17:17:33.584439 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi [None req-e6cda49c-cdb1-497c-a048-dd7c399a0ba4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:17:33.611960 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: INFO nova.api.openstack.requestlog [None req-e6cda49c-cdb1-497c-a048-dd7c399a0ba4 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031231 Sep 27 17:17:33.612558 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: [pid: 105438|app: 0|req: 11/23] 10.222.0.55 () {64 vars in 1333 bytes} [Tue Sep 27 17:17:33 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:17:36.332950 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi [None req-1fdca31e-cd16-4a40-82d0-6efe95bac6d2 admin admin] Calling method '>' {{(pid=105437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:17:36.333972 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: INFO nova.api.openstack.requestlog [None req-1fdca31e-cd16-4a40-82d0-6efe95bac6d2 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Sep 27 17:17:36.334420 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: [pid: 105437|app: 0|req: 13/24] 10.222.0.55 () {54 vars in 931 bytes} [Tue Sep 27 17:17:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:17:36.705270 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi [None req-740deb6a-7d95-4211-a05b-9db1ca27fe80 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "ram": 2048, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "name": "m1.small", "id": "2", "disk": 20}} {{(pid=105438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:17:36.729669 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: INFO nova.api.openstack.requestlog [None req-740deb6a-7d95-4211-a05b-9db1ca27fe80 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.388210 Sep 27 17:17:36.730170 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: [pid: 105438|app: 0|req: 12/25] 10.222.0.55 () {64 vars in 1283 bytes} [Tue Sep 27 17:17:36 2022] POST /compute/v2.1/flavors => generated 405 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 17:17:36.743402 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi [None req-5e520000-36e0-4acc-882d-79668788b05f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:17:36.767581 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: INFO nova.api.openstack.requestlog [None req-5e520000-36e0-4acc-882d-79668788b05f admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028360 Sep 27 17:17:36.768160 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: [pid: 105437|app: 0|req: 14/26] 10.222.0.55 () {64 vars in 1333 bytes} [Tue Sep 27 17:17:36 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:17:39.407564 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi [None req-740deb6a-7d95-4211-a05b-9db1ca27fe80 admin admin] Calling method '>' {{(pid=105438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:17:39.409925 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: INFO nova.api.openstack.requestlog [None req-740deb6a-7d95-4211-a05b-9db1ca27fe80 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003325 Sep 27 17:17:39.417186 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: [pid: 105438|app: 0|req: 13/27] 10.222.0.55 () {54 vars in 931 bytes} [Tue Sep 27 17:17:39 2022] GET /compute/v2.1 => generated 388 bytes in 10 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:17:39.870662 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi [None req-20f6c5d6-dc5e-4384-8500-7ac0b637e6dc admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "id": "3", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 4096, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "swap": 0}} {{(pid=105437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:17:39.895905 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: INFO nova.api.openstack.requestlog [None req-20f6c5d6-dc5e-4384-8500-7ac0b637e6dc admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.478847 Sep 27 17:17:39.896762 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: [pid: 105437|app: 0|req: 15/28] 10.222.0.55 () {64 vars in 1283 bytes} [Tue Sep 27 17:17:39 2022] POST /compute/v2.1/flavors => generated 406 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 17:17:39.909123 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi [None req-dbc84602-91e7-4440-b0d1-ae90703066d5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:17:39.936856 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: INFO nova.api.openstack.requestlog [None req-dbc84602-91e7-4440-b0d1-ae90703066d5 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031464 Sep 27 17:17:39.937550 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: [pid: 105438|app: 0|req: 14/29] 10.222.0.55 () {64 vars in 1333 bytes} [Tue Sep 27 17:17:39 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:17:42.679324 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi [None req-20f6c5d6-dc5e-4384-8500-7ac0b637e6dc admin admin] Calling method '>' {{(pid=105437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:17:42.680927 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: INFO nova.api.openstack.requestlog [None req-20f6c5d6-dc5e-4384-8500-7ac0b637e6dc admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002032 Sep 27 17:17:42.681322 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: [pid: 105437|app: 0|req: 16/30] 10.222.0.55 () {54 vars in 931 bytes} [Tue Sep 27 17:17:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:17:43.125869 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi [None req-0f8058dd-5fd2-4853-bec7-af6b5f443168 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.large", "id": "4", "disk": 80, "swap": 0, "vcpus": 4, "ram": 8192}} {{(pid=105438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:17:43.131396 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG dbcounter [-] [105438] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:17:43.147743 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: INFO nova.api.openstack.requestlog [None req-0f8058dd-5fd2-4853-bec7-af6b5f443168 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.460543 Sep 27 17:17:43.148286 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: [pid: 105438|app: 0|req: 15/31] 10.222.0.55 () {64 vars in 1283 bytes} [Tue Sep 27 17:17:42 2022] POST /compute/v2.1/flavors => generated 405 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 17:17:43.164582 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi [None req-5d7cb85b-4511-4aa2-9ae1-25dfae976d9b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:17:43.189487 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: INFO nova.api.openstack.requestlog [None req-5d7cb85b-4511-4aa2-9ae1-25dfae976d9b admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032618 Sep 27 17:17:43.190219 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: [pid: 105437|app: 0|req: 17/32] 10.222.0.55 () {64 vars in 1333 bytes} [Tue Sep 27 17:17:43 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:17:45.780132 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi [None req-0f8058dd-5fd2-4853-bec7-af6b5f443168 admin admin] Calling method '>' {{(pid=105438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:17:45.781154 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: INFO nova.api.openstack.requestlog [None req-0f8058dd-5fd2-4853-bec7-af6b5f443168 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Sep 27 17:17:45.781653 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: [pid: 105438|app: 0|req: 16/33] 10.222.0.55 () {54 vars in 931 bytes} [Tue Sep 27 17:17:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 17:17:46.216817 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi [None req-3a9a6ad1-735b-4bb0-85df-28e77658c0c9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 16384, "disk": 160, "swap": 0, "id": "5", "name": "m1.xlarge", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8}} {{(pid=105437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:17:46.224188 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG dbcounter [-] [105437] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:17:46.240855 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: INFO nova.api.openstack.requestlog [None req-3a9a6ad1-735b-4bb0-85df-28e77658c0c9 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.453101 Sep 27 17:17:46.241505 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: [pid: 105437|app: 0|req: 18/34] 10.222.0.55 () {64 vars in 1283 bytes} [Tue Sep 27 17:17:45 2022] POST /compute/v2.1/flavors => generated 408 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 17:17:46.255015 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi [None req-aa04dfd4-b1df-4e89-b8f1-ae13fef08fb6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:17:46.280724 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: INFO nova.api.openstack.requestlog [None req-aa04dfd4-b1df-4e89-b8f1-ae13fef08fb6 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030726 Sep 27 17:17:46.281337 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: [pid: 105438|app: 0|req: 17/35] 10.222.0.55 () {64 vars in 1333 bytes} [Tue Sep 27 17:17:46 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:18:03.092117 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi [None req-3a9a6ad1-735b-4bb0-85df-28e77658c0c9 admin admin] Calling method '>' {{(pid=105437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:18:03.093068 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: INFO nova.api.openstack.requestlog [None req-3a9a6ad1-735b-4bb0-85df-28e77658c0c9 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Sep 27 17:18:03.094090 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: [pid: 105437|app: 0|req: 19/36] 10.222.0.55 () {54 vars in 931 bytes} [Tue Sep 27 17:18:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 17:18:03.104968 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG dbcounter [-] [105438] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:18:03.479389 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi [None req-fcb1cd35-dd16-485d-b010-6b1dd7575ca4 admin admin] Calling method '>' {{(pid=105438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:18:03.500588 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: INFO nova.api.openstack.requestlog [None req-fcb1cd35-dd16-485d-b010-6b1dd7575ca4 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.399737 Sep 27 17:18:03.501154 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: [pid: 105438|app: 0|req: 18/37] 10.222.0.55 () {60 vars in 1292 bytes} [Tue Sep 27 17:18:03 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:18:04.804803 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi [None req-3a9a6ad1-735b-4bb0-85df-28e77658c0c9 admin admin] Calling method '>' {{(pid=105437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:18:04.805820 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: INFO nova.api.openstack.requestlog [None req-3a9a6ad1-735b-4bb0-85df-28e77658c0c9 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Sep 27 17:18:04.806259 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: [pid: 105437|app: 0|req: 20/38] 10.222.0.55 () {56 vars in 1074 bytes} [Tue Sep 27 17:18:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:18:05.453261 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi [None req-49f1e54a-8fce-43dc-ae79-81f0fc9df0b8 admin admin] Calling method '>' {{(pid=105438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:18:05.460865 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: INFO nova.api.openstack.wsgi [None req-49f1e54a-8fce-43dc-ae79-81f0fc9df0b8 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 27 17:18:05.464147 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi [None req-49f1e54a-8fce-43dc-ae79-81f0fc9df0b8 admin admin] Request method failure captured: Sep 27 17:18:05.464147 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 27 17:18:05.464147 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: Accept: application/json Sep 27 17:18:05.464147 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: Accept-Encoding: gzip, deflate Sep 27 17:18:05.464147 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: Connection: keep-alive Sep 27 17:18:05.464147 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: Content-Length: 0 Sep 27 17:18:05.464147 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: Host: 10.222.0.55 Sep 27 17:18:05.464147 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: Openstack-Api-Version: compute 2.92 Sep 27 17:18:05.464147 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: Openstack-System-Scope: None Sep 27 17:18:05.464147 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: User-Agent: python-novaclient Sep 27 17:18:05.464147 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: X-Auth-Token: gAAAAABjMzBMFiIkb_uJT8rErmy04MA4ShopYJY3aAGvHJz3WjOd33PY8pzjbJmvIZX2PW3CJhZsZtcsI7lTbxILKv4AyAUN6Uhg_uFH0bwk1vO12IHp2lynKzjud8iSjvNEr4sDVQ5zgOChQflHWu39nlyVkFyYpSx1j4h2FsHnHo-LbXX4akk Sep 27 17:18:05.464147 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: X-Domain-Id: None Sep 27 17:18:05.464147 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: X-Domain-Name: None Sep 27 17:18:05.464147 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: X-Identity-Status: Confirmed Sep 27 17:18:05.464147 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: X-Is-Admin-Project: True Sep 27 17:18:05.464147 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: X-Openstack-Nova-Api-Version: 2.92 Sep 27 17:18:05.464147 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: X-Project-Domain-Id: default Sep 27 17:18:05.464147 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: X-Project-Domain-Name: Default Sep 27 17:18:05.464147 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: X-Project-Id: 5c93f41c1d2243bfbbfb547f2005e999 Sep 27 17:18:05.464147 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: X-Project-Name: admin Sep 27 17:18:05.464147 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: X-Role: reader,admin,member Sep 27 17:18:05.464147 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: X-Roles: reader,admin,member Sep 27 17:18:05.465854 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/5c93f41c1d2243bfbbfb547f2005e999"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_5c93f41c1d2243bfbbfb547f2005e999", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/5c93f41c1d2243bfbbfb547f2005e999"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/5c93f41c1d2243bfbbfb547f2005e999"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 27 17:18:05.465854 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: X-Tenant: admin Sep 27 17:18:05.465854 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: X-Tenant-Id: 5c93f41c1d2243bfbbfb547f2005e999 Sep 27 17:18:05.465854 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: X-Tenant-Name: admin Sep 27 17:18:05.465854 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: X-User: admin Sep 27 17:18:05.465854 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: X-User-Domain-Id: default Sep 27 17:18:05.465854 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: X-User-Domain-Name: Default Sep 27 17:18:05.465854 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: X-User-Id: 60f027a86a574cfdbd746a543980fbdf Sep 27 17:18:05.465854 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: X-User-Name: admin Sep 27 17:18:05.465854 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: method: > Sep 27 17:18:05.465854 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: exception: Flavor 42 could not be found. Sep 27 17:18:05.465854 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: action_args: {'id': '42'} Sep 27 17:18:05.465854 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: {{(pid=105438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 17:18:05.465854 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:18:05.467002 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 27 17:18:05.467002 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 27 17:18:05.467002 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 27 17:18:05.467002 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 27 17:18:05.467002 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 27 17:18:05.467002 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 27 17:18:05.467002 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 27 17:18:05.467002 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 27 17:18:05.467002 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 27 17:18:05.467002 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 17:18:05.467002 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 27 17:18:05.467002 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 27 17:18:05.467002 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 27 17:18:05.467002 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi Sep 27 17:18:05.467002 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:18:05.467002 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi Sep 27 17:18:05.467002 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:18:05.467002 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:18:05.467002 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:18:05.468170 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 17:18:05.468170 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 17:18:05.468170 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 17:18:05.468170 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 17:18:05.468170 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 27 17:18:05.468170 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 27 17:18:05.468170 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 27 17:18:05.468170 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi Sep 27 17:18:05.468170 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:18:05.468170 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi Sep 27 17:18:05.468170 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:18:05.468170 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:18:05.468170 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:18:05.468170 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 17:18:05.468170 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 17:18:05.468170 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 27 17:18:05.468170 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi Sep 27 17:18:05.468170 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi [None req-49f1e54a-8fce-43dc-ae79-81f0fc9df0b8 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 17:18:05.470234 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: INFO nova.api.openstack.requestlog [None req-49f1e54a-8fce-43dc-ae79-81f0fc9df0b8 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.519750 Sep 27 17:18:05.470234 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: [pid: 105438|app: 0|req: 19/39] 10.222.0.55 () {60 vars in 1190 bytes} [Tue Sep 27 17:18:04 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 521 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 27 17:18:05.478229 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi [None req-8f239dc6-2d76-42c9-80ab-d7347e9ef278 admin admin] Calling method '>' {{(pid=105437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:18:05.503607 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: INFO nova.api.openstack.requestlog [None req-8f239dc6-2d76-42c9-80ab-d7347e9ef278 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.029970 Sep 27 17:18:05.504167 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: [pid: 105437|app: 0|req: 21/40] 10.222.0.55 () {60 vars in 1210 bytes} [Tue Sep 27 17:18:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:18:05.514883 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi [None req-f3a7dd60-b0eb-4e76-a06d-801d42961e69 admin admin] Calling method '>' {{(pid=105438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:18:05.537085 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: INFO nova.api.openstack.requestlog [None req-f3a7dd60-b0eb-4e76-a06d-801d42961e69 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026719 Sep 27 17:18:05.537635 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: [pid: 105438|app: 0|req: 20/41] 10.222.0.55 () {60 vars in 1210 bytes} [Tue Sep 27 17:18:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:18:05.547698 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi [None req-b9f4f5ee-a74a-436f-b177-56f5569043b1 admin admin] Calling method '>' {{(pid=105437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:18:05.553425 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: INFO nova.api.openstack.wsgi [None req-b9f4f5ee-a74a-436f-b177-56f5569043b1 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 27 17:18:05.556713 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi [None req-b9f4f5ee-a74a-436f-b177-56f5569043b1 admin admin] Request method failure captured: Sep 27 17:18:05.556713 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 27 17:18:05.556713 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: Accept: application/json Sep 27 17:18:05.556713 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: Accept-Encoding: gzip, deflate Sep 27 17:18:05.556713 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: Connection: keep-alive Sep 27 17:18:05.556713 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: Content-Length: 0 Sep 27 17:18:05.556713 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: Host: 10.222.0.55 Sep 27 17:18:05.556713 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: Openstack-Api-Version: compute 2.92 Sep 27 17:18:05.556713 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: Openstack-System-Scope: None Sep 27 17:18:05.556713 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: User-Agent: python-novaclient Sep 27 17:18:05.556713 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: X-Auth-Token: gAAAAABjMzBMFiIkb_uJT8rErmy04MA4ShopYJY3aAGvHJz3WjOd33PY8pzjbJmvIZX2PW3CJhZsZtcsI7lTbxILKv4AyAUN6Uhg_uFH0bwk1vO12IHp2lynKzjud8iSjvNEr4sDVQ5zgOChQflHWu39nlyVkFyYpSx1j4h2FsHnHo-LbXX4akk Sep 27 17:18:05.556713 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: X-Domain-Id: None Sep 27 17:18:05.556713 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: X-Domain-Name: None Sep 27 17:18:05.556713 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: X-Identity-Status: Confirmed Sep 27 17:18:05.556713 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: X-Is-Admin-Project: True Sep 27 17:18:05.556713 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: X-Openstack-Nova-Api-Version: 2.92 Sep 27 17:18:05.556713 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: X-Project-Domain-Id: default Sep 27 17:18:05.556713 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: X-Project-Domain-Name: Default Sep 27 17:18:05.556713 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: X-Project-Id: 5c93f41c1d2243bfbbfb547f2005e999 Sep 27 17:18:05.556713 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: X-Project-Name: admin Sep 27 17:18:05.556713 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: X-Role: reader,admin,member Sep 27 17:18:05.556713 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: X-Roles: reader,admin,member Sep 27 17:18:05.558339 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/5c93f41c1d2243bfbbfb547f2005e999"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_5c93f41c1d2243bfbbfb547f2005e999", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/5c93f41c1d2243bfbbfb547f2005e999"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/5c93f41c1d2243bfbbfb547f2005e999"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 27 17:18:05.558339 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: X-Tenant: admin Sep 27 17:18:05.558339 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: X-Tenant-Id: 5c93f41c1d2243bfbbfb547f2005e999 Sep 27 17:18:05.558339 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: X-Tenant-Name: admin Sep 27 17:18:05.558339 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: X-User: admin Sep 27 17:18:05.558339 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: X-User-Domain-Id: default Sep 27 17:18:05.558339 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: X-User-Domain-Name: Default Sep 27 17:18:05.558339 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: X-User-Id: 60f027a86a574cfdbd746a543980fbdf Sep 27 17:18:05.558339 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: X-User-Name: admin Sep 27 17:18:05.558339 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: method: > Sep 27 17:18:05.558339 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: exception: Flavor 42 could not be found. Sep 27 17:18:05.558339 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: action_args: {'id': '42'} Sep 27 17:18:05.558339 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: {{(pid=105437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 17:18:05.558339 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:18:05.559259 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 27 17:18:05.559259 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 27 17:18:05.559259 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 27 17:18:05.559259 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 27 17:18:05.559259 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 27 17:18:05.559259 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 27 17:18:05.559259 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 27 17:18:05.559259 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 27 17:18:05.559259 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 27 17:18:05.559259 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 17:18:05.559259 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 27 17:18:05.559259 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 27 17:18:05.559259 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 27 17:18:05.559259 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi Sep 27 17:18:05.559259 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:18:05.559259 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi Sep 27 17:18:05.559259 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:18:05.559259 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:18:05.559259 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:18:05.560297 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 17:18:05.560297 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 17:18:05.560297 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 17:18:05.560297 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 17:18:05.560297 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 27 17:18:05.560297 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 27 17:18:05.560297 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 27 17:18:05.560297 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi Sep 27 17:18:05.560297 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:18:05.560297 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi Sep 27 17:18:05.560297 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:18:05.560297 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:18:05.560297 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:18:05.560297 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 17:18:05.560297 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 17:18:05.560297 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 27 17:18:05.560297 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi Sep 27 17:18:05.560297 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi [None req-b9f4f5ee-a74a-436f-b177-56f5569043b1 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 17:18:05.561311 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: INFO nova.api.openstack.requestlog [None req-b9f4f5ee-a74a-436f-b177-56f5569043b1 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014662 Sep 27 17:18:05.561311 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: [pid: 105437|app: 0|req: 22/42] 10.222.0.55 () {60 vars in 1190 bytes} [Tue Sep 27 17:18:05 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 27 17:18:06.771738 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi [None req-f3a7dd60-b0eb-4e76-a06d-801d42961e69 admin admin] Calling method '>' {{(pid=105438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:18:06.772753 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: INFO nova.api.openstack.requestlog [None req-f3a7dd60-b0eb-4e76-a06d-801d42961e69 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Sep 27 17:18:06.773145 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: [pid: 105438|app: 0|req: 21/43] 10.222.0.55 () {56 vars in 1074 bytes} [Tue Sep 27 17:18:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:18:07.302410 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi [None req-2f200779-9eb8-4b6f-ba12-cf71dd33a4d4 admin admin] Calling method '>' {{(pid=105437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:18:07.307661 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: INFO nova.api.openstack.wsgi [None req-2f200779-9eb8-4b6f-ba12-cf71dd33a4d4 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 27 17:18:07.309176 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi [None req-2f200779-9eb8-4b6f-ba12-cf71dd33a4d4 admin admin] Request method failure captured: Sep 27 17:18:07.309176 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 27 17:18:07.309176 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: Accept: application/json Sep 27 17:18:07.309176 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: Accept-Encoding: gzip, deflate Sep 27 17:18:07.309176 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: Connection: keep-alive Sep 27 17:18:07.309176 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: Content-Length: 0 Sep 27 17:18:07.309176 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: Host: 10.222.0.55 Sep 27 17:18:07.309176 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: Openstack-Api-Version: compute 2.92 Sep 27 17:18:07.309176 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: Openstack-System-Scope: None Sep 27 17:18:07.309176 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: User-Agent: python-novaclient Sep 27 17:18:07.309176 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: X-Auth-Token: gAAAAABjMzBO7H5zY3L3h2Jms9fQwaYgFavfYYFh0zjOlctEBWVuxY2aMgebIllsqZLQOJ-dpY0ojJT8p2xSYafBdOJ36zW1E-0xf3dJQj8JlSpnB7W-708OqoRKSVZYgWBtHFUOM3kxnoKC5rdt2osLADXNGNwyl8sRSwDR_Rg10Pbe2KRWYG0 Sep 27 17:18:07.309176 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: X-Domain-Id: None Sep 27 17:18:07.309176 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: X-Domain-Name: None Sep 27 17:18:07.309176 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: X-Identity-Status: Confirmed Sep 27 17:18:07.309176 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: X-Is-Admin-Project: True Sep 27 17:18:07.309176 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: X-Openstack-Nova-Api-Version: 2.92 Sep 27 17:18:07.309176 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: X-Project-Domain-Id: default Sep 27 17:18:07.309176 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: X-Project-Domain-Name: Default Sep 27 17:18:07.309176 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: X-Project-Id: 5c93f41c1d2243bfbbfb547f2005e999 Sep 27 17:18:07.309176 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: X-Project-Name: admin Sep 27 17:18:07.309176 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: X-Role: reader,admin,member Sep 27 17:18:07.309176 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: X-Roles: reader,admin,member Sep 27 17:18:07.310814 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/5c93f41c1d2243bfbbfb547f2005e999"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_5c93f41c1d2243bfbbfb547f2005e999", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/5c93f41c1d2243bfbbfb547f2005e999"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/5c93f41c1d2243bfbbfb547f2005e999"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 27 17:18:07.310814 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: X-Tenant: admin Sep 27 17:18:07.310814 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: X-Tenant-Id: 5c93f41c1d2243bfbbfb547f2005e999 Sep 27 17:18:07.310814 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: X-Tenant-Name: admin Sep 27 17:18:07.310814 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: X-User: admin Sep 27 17:18:07.310814 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: X-User-Domain-Id: default Sep 27 17:18:07.310814 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: X-User-Domain-Name: Default Sep 27 17:18:07.310814 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: X-User-Id: 60f027a86a574cfdbd746a543980fbdf Sep 27 17:18:07.310814 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: X-User-Name: admin Sep 27 17:18:07.310814 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: method: > Sep 27 17:18:07.310814 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: exception: Flavor 84 could not be found. Sep 27 17:18:07.310814 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: action_args: {'id': '84'} Sep 27 17:18:07.310814 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: {{(pid=105437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 17:18:07.310814 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:18:07.311785 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 27 17:18:07.311785 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 27 17:18:07.311785 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 27 17:18:07.311785 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 27 17:18:07.311785 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 27 17:18:07.311785 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 27 17:18:07.311785 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 27 17:18:07.311785 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 27 17:18:07.311785 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 27 17:18:07.311785 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 17:18:07.311785 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 27 17:18:07.311785 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 27 17:18:07.311785 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 27 17:18:07.311785 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi Sep 27 17:18:07.311785 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:18:07.311785 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi Sep 27 17:18:07.311785 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:18:07.311785 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:18:07.311785 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:18:07.313381 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 17:18:07.313381 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 17:18:07.313381 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 17:18:07.313381 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 17:18:07.313381 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 27 17:18:07.313381 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 27 17:18:07.313381 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 27 17:18:07.313381 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi Sep 27 17:18:07.313381 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:18:07.313381 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi Sep 27 17:18:07.313381 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:18:07.313381 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:18:07.313381 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:18:07.313381 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 17:18:07.313381 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 17:18:07.313381 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 27 17:18:07.313381 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi Sep 27 17:18:07.313381 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi [None req-2f200779-9eb8-4b6f-ba12-cf71dd33a4d4 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 17:18:07.314852 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: INFO nova.api.openstack.requestlog [None req-2f200779-9eb8-4b6f-ba12-cf71dd33a4d4 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.393418 Sep 27 17:18:07.314852 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: [pid: 105437|app: 0|req: 23/44] 10.222.0.55 () {60 vars in 1190 bytes} [Tue Sep 27 17:18:06 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 394 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 27 17:18:07.320502 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi [None req-23751849-12ce-48d5-ada7-e5badbdbd32d admin admin] Calling method '>' {{(pid=105438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:18:07.335864 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: INFO nova.api.openstack.requestlog [None req-23751849-12ce-48d5-ada7-e5badbdbd32d admin admin] 10.222.0.55 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019094 Sep 27 17:18:07.336400 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: [pid: 105438|app: 0|req: 22/45] 10.222.0.55 () {60 vars in 1210 bytes} [Tue Sep 27 17:18:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:18:07.346448 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi [None req-a2cb3e18-4b1e-499e-b8e0-3f1a3b4f1a23 admin admin] Calling method '>' {{(pid=105437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:18:07.361740 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: INFO nova.api.openstack.requestlog [None req-a2cb3e18-4b1e-499e-b8e0-3f1a3b4f1a23 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019515 Sep 27 17:18:07.362285 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: [pid: 105437|app: 0|req: 24/46] 10.222.0.55 () {60 vars in 1210 bytes} [Tue Sep 27 17:18:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 17:18:07.371189 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi [None req-1c02b213-a458-4ceb-9158-3f54c1c5c750 admin admin] Calling method '>' {{(pid=105438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:18:07.376021 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: INFO nova.api.openstack.wsgi [None req-1c02b213-a458-4ceb-9158-3f54c1c5c750 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 27 17:18:07.377516 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi [None req-1c02b213-a458-4ceb-9158-3f54c1c5c750 admin admin] Request method failure captured: Sep 27 17:18:07.377516 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 27 17:18:07.377516 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: Accept: application/json Sep 27 17:18:07.377516 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: Accept-Encoding: gzip, deflate Sep 27 17:18:07.377516 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: Connection: keep-alive Sep 27 17:18:07.377516 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: Content-Length: 0 Sep 27 17:18:07.377516 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: Host: 10.222.0.55 Sep 27 17:18:07.377516 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: Openstack-Api-Version: compute 2.92 Sep 27 17:18:07.377516 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: Openstack-System-Scope: None Sep 27 17:18:07.377516 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: User-Agent: python-novaclient Sep 27 17:18:07.377516 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: X-Auth-Token: gAAAAABjMzBO7H5zY3L3h2Jms9fQwaYgFavfYYFh0zjOlctEBWVuxY2aMgebIllsqZLQOJ-dpY0ojJT8p2xSYafBdOJ36zW1E-0xf3dJQj8JlSpnB7W-708OqoRKSVZYgWBtHFUOM3kxnoKC5rdt2osLADXNGNwyl8sRSwDR_Rg10Pbe2KRWYG0 Sep 27 17:18:07.377516 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: X-Domain-Id: None Sep 27 17:18:07.377516 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: X-Domain-Name: None Sep 27 17:18:07.377516 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: X-Identity-Status: Confirmed Sep 27 17:18:07.377516 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: X-Is-Admin-Project: True Sep 27 17:18:07.377516 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: X-Openstack-Nova-Api-Version: 2.92 Sep 27 17:18:07.377516 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: X-Project-Domain-Id: default Sep 27 17:18:07.377516 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: X-Project-Domain-Name: Default Sep 27 17:18:07.377516 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: X-Project-Id: 5c93f41c1d2243bfbbfb547f2005e999 Sep 27 17:18:07.377516 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: X-Project-Name: admin Sep 27 17:18:07.377516 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: X-Role: reader,admin,member Sep 27 17:18:07.377516 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: X-Roles: reader,admin,member Sep 27 17:18:07.379066 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/5c93f41c1d2243bfbbfb547f2005e999"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_5c93f41c1d2243bfbbfb547f2005e999", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/5c93f41c1d2243bfbbfb547f2005e999"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/5c93f41c1d2243bfbbfb547f2005e999"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 27 17:18:07.379066 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: X-Tenant: admin Sep 27 17:18:07.379066 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: X-Tenant-Id: 5c93f41c1d2243bfbbfb547f2005e999 Sep 27 17:18:07.379066 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: X-Tenant-Name: admin Sep 27 17:18:07.379066 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: X-User: admin Sep 27 17:18:07.379066 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: X-User-Domain-Id: default Sep 27 17:18:07.379066 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: X-User-Domain-Name: Default Sep 27 17:18:07.379066 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: X-User-Id: 60f027a86a574cfdbd746a543980fbdf Sep 27 17:18:07.379066 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: X-User-Name: admin Sep 27 17:18:07.379066 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: method: > Sep 27 17:18:07.379066 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: exception: Flavor 84 could not be found. Sep 27 17:18:07.379066 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: action_args: {'id': '84'} Sep 27 17:18:07.379066 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: {{(pid=105438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 17:18:07.379066 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:18:07.379901 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 27 17:18:07.379901 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 27 17:18:07.379901 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 27 17:18:07.379901 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 27 17:18:07.379901 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 27 17:18:07.379901 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 27 17:18:07.379901 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 27 17:18:07.379901 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 27 17:18:07.379901 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 27 17:18:07.379901 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 17:18:07.379901 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 27 17:18:07.379901 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 27 17:18:07.379901 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 27 17:18:07.379901 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi Sep 27 17:18:07.379901 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:18:07.379901 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi Sep 27 17:18:07.379901 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:18:07.379901 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:18:07.379901 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:18:07.381059 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 17:18:07.381059 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 17:18:07.381059 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 17:18:07.381059 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 17:18:07.381059 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 27 17:18:07.381059 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 27 17:18:07.381059 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 27 17:18:07.381059 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi Sep 27 17:18:07.381059 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:18:07.381059 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi Sep 27 17:18:07.381059 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:18:07.381059 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:18:07.381059 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:18:07.381059 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 17:18:07.381059 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 17:18:07.381059 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 27 17:18:07.381059 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi Sep 27 17:18:07.381059 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi [None req-1c02b213-a458-4ceb-9158-3f54c1c5c750 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 17:18:07.382064 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: INFO nova.api.openstack.requestlog [None req-1c02b213-a458-4ceb-9158-3f54c1c5c750 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011226 Sep 27 17:18:07.382064 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: [pid: 105438|app: 0|req: 23/47] 10.222.0.55 () {60 vars in 1190 bytes} [Tue Sep 27 17:18:07 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 27 17:18:08.583343 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi [None req-a2cb3e18-4b1e-499e-b8e0-3f1a3b4f1a23 admin admin] Calling method '>' {{(pid=105437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:18:08.584363 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: INFO nova.api.openstack.requestlog [None req-a2cb3e18-4b1e-499e-b8e0-3f1a3b4f1a23 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Sep 27 17:18:08.584758 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: [pid: 105437|app: 0|req: 25/48] 10.222.0.55 () {56 vars in 1074 bytes} [Tue Sep 27 17:18:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 17:18:09.110606 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi [None req-faceca0d-a72a-4a8a-90e1-6f5087274dc5 admin admin] Calling method '>' {{(pid=105438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:18:09.116387 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: INFO nova.api.openstack.wsgi [None req-faceca0d-a72a-4a8a-90e1-6f5087274dc5 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 27 17:18:09.117889 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi [None req-faceca0d-a72a-4a8a-90e1-6f5087274dc5 admin admin] Request method failure captured: Sep 27 17:18:09.117889 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 27 17:18:09.117889 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: Accept: application/json Sep 27 17:18:09.117889 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: Accept-Encoding: gzip, deflate Sep 27 17:18:09.117889 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: Connection: keep-alive Sep 27 17:18:09.117889 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: Content-Length: 0 Sep 27 17:18:09.117889 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: Host: 10.222.0.55 Sep 27 17:18:09.117889 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: Openstack-Api-Version: compute 2.92 Sep 27 17:18:09.117889 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: Openstack-System-Scope: None Sep 27 17:18:09.117889 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: User-Agent: python-novaclient Sep 27 17:18:09.117889 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: X-Auth-Token: gAAAAABjMzBQiW_OnLKkHGVJNLWAgZz7KpX8jkIMyZ47QrCnNEUK3paI2OkYHg29c0-2XR14ZT9OyXHzNo08JYOEDgpy7d_3RRbrKfnPtiHTxB5JaOAELUSuvecOokj3-yuW3Xxa4y-tc4LV34u__PJFTndhj7PYK884F1HsiiaOdP3T5sRFXFA Sep 27 17:18:09.117889 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: X-Domain-Id: None Sep 27 17:18:09.117889 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: X-Domain-Name: None Sep 27 17:18:09.117889 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: X-Identity-Status: Confirmed Sep 27 17:18:09.117889 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: X-Is-Admin-Project: True Sep 27 17:18:09.117889 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: X-Openstack-Nova-Api-Version: 2.92 Sep 27 17:18:09.117889 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: X-Project-Domain-Id: default Sep 27 17:18:09.117889 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: X-Project-Domain-Name: Default Sep 27 17:18:09.117889 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: X-Project-Id: 5c93f41c1d2243bfbbfb547f2005e999 Sep 27 17:18:09.117889 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: X-Project-Name: admin Sep 27 17:18:09.117889 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: X-Role: reader,admin,member Sep 27 17:18:09.117889 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: X-Roles: reader,admin,member Sep 27 17:18:09.119359 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/5c93f41c1d2243bfbbfb547f2005e999"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_5c93f41c1d2243bfbbfb547f2005e999", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/5c93f41c1d2243bfbbfb547f2005e999"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/5c93f41c1d2243bfbbfb547f2005e999"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 27 17:18:09.119359 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: X-Tenant: admin Sep 27 17:18:09.119359 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: X-Tenant-Id: 5c93f41c1d2243bfbbfb547f2005e999 Sep 27 17:18:09.119359 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: X-Tenant-Name: admin Sep 27 17:18:09.119359 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: X-User: admin Sep 27 17:18:09.119359 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: X-User-Domain-Id: default Sep 27 17:18:09.119359 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: X-User-Domain-Name: Default Sep 27 17:18:09.119359 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: X-User-Id: 60f027a86a574cfdbd746a543980fbdf Sep 27 17:18:09.119359 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: X-User-Name: admin Sep 27 17:18:09.119359 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: method: > Sep 27 17:18:09.119359 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: exception: Flavor 451 could not be found. Sep 27 17:18:09.119359 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: action_args: {'id': '451'} Sep 27 17:18:09.119359 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: {{(pid=105438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 17:18:09.119359 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:18:09.120179 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 27 17:18:09.120179 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 27 17:18:09.120179 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 27 17:18:09.120179 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 27 17:18:09.120179 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 27 17:18:09.120179 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 27 17:18:09.120179 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 27 17:18:09.120179 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 27 17:18:09.120179 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 27 17:18:09.120179 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 17:18:09.120179 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 27 17:18:09.120179 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 27 17:18:09.120179 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 27 17:18:09.120179 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi Sep 27 17:18:09.120179 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:18:09.120179 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi Sep 27 17:18:09.120179 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:18:09.120179 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:18:09.120179 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:18:09.121249 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 17:18:09.121249 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 17:18:09.121249 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 17:18:09.121249 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 17:18:09.121249 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 27 17:18:09.121249 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 27 17:18:09.121249 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 27 17:18:09.121249 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi Sep 27 17:18:09.121249 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:18:09.121249 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi Sep 27 17:18:09.121249 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:18:09.121249 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:18:09.121249 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:18:09.121249 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 17:18:09.121249 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 17:18:09.121249 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 27 17:18:09.121249 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: ERROR nova.api.openstack.wsgi Sep 27 17:18:09.121249 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi [None req-faceca0d-a72a-4a8a-90e1-6f5087274dc5 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105438) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 17:18:09.122621 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: INFO nova.api.openstack.requestlog [None req-faceca0d-a72a-4a8a-90e1-6f5087274dc5 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.395490 Sep 27 17:18:09.122621 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: [pid: 105438|app: 0|req: 24/49] 10.222.0.55 () {60 vars in 1193 bytes} [Tue Sep 27 17:18:08 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 396 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 27 17:18:09.129589 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi [None req-e25caefd-abbb-4fa7-b23e-a3582b834422 admin admin] Calling method '>' {{(pid=105437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:18:09.144790 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: INFO nova.api.openstack.requestlog [None req-e25caefd-abbb-4fa7-b23e-a3582b834422 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018777 Sep 27 17:18:09.145316 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: [pid: 105437|app: 0|req: 26/50] 10.222.0.55 () {60 vars in 1210 bytes} [Tue Sep 27 17:18:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:18:09.154568 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi [None req-f308b502-c4a5-454c-ba56-7426cda98283 admin admin] Calling method '>' {{(pid=105438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:18:09.169116 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: INFO nova.api.openstack.requestlog [None req-f308b502-c4a5-454c-ba56-7426cda98283 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018021 Sep 27 17:18:09.169636 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: [pid: 105438|app: 0|req: 25/51] 10.222.0.55 () {60 vars in 1210 bytes} [Tue Sep 27 17:18:09 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:18:09.178630 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi [None req-7ad85c29-a600-4071-b6c3-74a8fcac39d8 admin admin] Calling method '>' {{(pid=105437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:18:09.183592 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: INFO nova.api.openstack.wsgi [None req-7ad85c29-a600-4071-b6c3-74a8fcac39d8 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 27 17:18:09.185083 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi [None req-7ad85c29-a600-4071-b6c3-74a8fcac39d8 admin admin] Request method failure captured: Sep 27 17:18:09.185083 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 27 17:18:09.185083 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: Accept: application/json Sep 27 17:18:09.185083 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: Accept-Encoding: gzip, deflate Sep 27 17:18:09.185083 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: Connection: keep-alive Sep 27 17:18:09.185083 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: Content-Length: 0 Sep 27 17:18:09.185083 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: Host: 10.222.0.55 Sep 27 17:18:09.185083 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: Openstack-Api-Version: compute 2.92 Sep 27 17:18:09.185083 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: Openstack-System-Scope: None Sep 27 17:18:09.185083 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: User-Agent: python-novaclient Sep 27 17:18:09.185083 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: X-Auth-Token: gAAAAABjMzBQiW_OnLKkHGVJNLWAgZz7KpX8jkIMyZ47QrCnNEUK3paI2OkYHg29c0-2XR14ZT9OyXHzNo08JYOEDgpy7d_3RRbrKfnPtiHTxB5JaOAELUSuvecOokj3-yuW3Xxa4y-tc4LV34u__PJFTndhj7PYK884F1HsiiaOdP3T5sRFXFA Sep 27 17:18:09.185083 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: X-Domain-Id: None Sep 27 17:18:09.185083 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: X-Domain-Name: None Sep 27 17:18:09.185083 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: X-Identity-Status: Confirmed Sep 27 17:18:09.185083 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: X-Is-Admin-Project: True Sep 27 17:18:09.185083 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: X-Openstack-Nova-Api-Version: 2.92 Sep 27 17:18:09.185083 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: X-Project-Domain-Id: default Sep 27 17:18:09.185083 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: X-Project-Domain-Name: Default Sep 27 17:18:09.185083 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: X-Project-Id: 5c93f41c1d2243bfbbfb547f2005e999 Sep 27 17:18:09.185083 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: X-Project-Name: admin Sep 27 17:18:09.185083 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: X-Role: reader,admin,member Sep 27 17:18:09.185083 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: X-Roles: reader,admin,member Sep 27 17:18:09.186556 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/5c93f41c1d2243bfbbfb547f2005e999"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_5c93f41c1d2243bfbbfb547f2005e999", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/5c93f41c1d2243bfbbfb547f2005e999"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/5c93f41c1d2243bfbbfb547f2005e999"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 27 17:18:09.186556 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: X-Tenant: admin Sep 27 17:18:09.186556 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: X-Tenant-Id: 5c93f41c1d2243bfbbfb547f2005e999 Sep 27 17:18:09.186556 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: X-Tenant-Name: admin Sep 27 17:18:09.186556 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: X-User: admin Sep 27 17:18:09.186556 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: X-User-Domain-Id: default Sep 27 17:18:09.186556 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: X-User-Domain-Name: Default Sep 27 17:18:09.186556 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: X-User-Id: 60f027a86a574cfdbd746a543980fbdf Sep 27 17:18:09.186556 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: X-User-Name: admin Sep 27 17:18:09.186556 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: method: > Sep 27 17:18:09.186556 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: exception: Flavor 451 could not be found. Sep 27 17:18:09.186556 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: action_args: {'id': '451'} Sep 27 17:18:09.186556 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: {{(pid=105437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 17:18:09.186556 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:18:09.188015 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 27 17:18:09.188015 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 27 17:18:09.188015 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 27 17:18:09.188015 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 27 17:18:09.188015 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 27 17:18:09.188015 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 27 17:18:09.188015 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 27 17:18:09.188015 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 27 17:18:09.188015 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 27 17:18:09.188015 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 17:18:09.188015 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 27 17:18:09.188015 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 27 17:18:09.188015 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 27 17:18:09.188015 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi Sep 27 17:18:09.188015 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:18:09.188015 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi Sep 27 17:18:09.188015 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:18:09.188015 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:18:09.188015 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:18:09.189612 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 17:18:09.189612 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 17:18:09.189612 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 17:18:09.189612 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 17:18:09.189612 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 27 17:18:09.189612 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 27 17:18:09.189612 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 27 17:18:09.189612 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi Sep 27 17:18:09.189612 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:18:09.189612 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi Sep 27 17:18:09.189612 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:18:09.189612 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:18:09.189612 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:18:09.189612 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 17:18:09.189612 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 17:18:09.189612 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 27 17:18:09.189612 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: ERROR nova.api.openstack.wsgi Sep 27 17:18:09.189612 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi [None req-7ad85c29-a600-4071-b6c3-74a8fcac39d8 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105437) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 17:18:09.191238 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: INFO nova.api.openstack.requestlog [None req-7ad85c29-a600-4071-b6c3-74a8fcac39d8 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011324 Sep 27 17:18:09.191238 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: [pid: 105437|app: 0|req: 27/52] 10.222.0.55 () {60 vars in 1193 bytes} [Tue Sep 27 17:18:09 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 27 17:18:10.424493 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi [None req-f308b502-c4a5-454c-ba56-7426cda98283 admin admin] Calling method '>' {{(pid=105438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:18:10.425507 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: INFO nova.api.openstack.requestlog [None req-f308b502-c4a5-454c-ba56-7426cda98283 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Sep 27 17:18:10.425906 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: [pid: 105438|app: 0|req: 26/53] 10.222.0.55 () {56 vars in 1074 bytes} [Tue Sep 27 17:18:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:18:10.950457 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi [None req-d978658a-97b8-48e0-9a43-cd7a9067b9a0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:18:10.970271 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: INFO nova.api.openstack.requestlog [None req-d978658a-97b8-48e0-9a43-cd7a9067b9a0 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.405910 Sep 27 17:18:10.970761 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: [pid: 105437|app: 0|req: 28/54] 10.222.0.55 () {64 vars in 1235 bytes} [Tue Sep 27 17:18:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 17:18:12.200717 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi [None req-f308b502-c4a5-454c-ba56-7426cda98283 admin admin] Calling method '>' {{(pid=105438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:18:12.201735 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: INFO nova.api.openstack.requestlog [None req-f308b502-c4a5-454c-ba56-7426cda98283 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Sep 27 17:18:12.202163 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: [pid: 105438|app: 0|req: 27/55] 10.222.0.55 () {56 vars in 1074 bytes} [Tue Sep 27 17:18:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:18:12.736613 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi [None req-96f8ebfb-623c-42d1-b328-57aff6292690 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:18:12.755520 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: INFO nova.api.openstack.requestlog [None req-96f8ebfb-623c-42d1-b328-57aff6292690 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.409254 Sep 27 17:18:12.756272 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: [pid: 105437|app: 0|req: 29/56] 10.222.0.55 () {64 vars in 1235 bytes} [Tue Sep 27 17:18:12 2022] POST /compute/v2.1/flavors => generated 405 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 17:18:13.965399 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi [None req-f308b502-c4a5-454c-ba56-7426cda98283 admin admin] Calling method '>' {{(pid=105438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:18:13.966440 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: INFO nova.api.openstack.requestlog [None req-f308b502-c4a5-454c-ba56-7426cda98283 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Sep 27 17:18:13.966835 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: [pid: 105438|app: 0|req: 28/57] 10.222.0.55 () {56 vars in 1074 bytes} [Tue Sep 27 17:18:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:18:14.495500 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi [None req-db2b624e-1e5a-4cc3-ae7b-2cd78523469d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:18:14.514757 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: INFO nova.api.openstack.requestlog [None req-db2b624e-1e5a-4cc3-ae7b-2cd78523469d admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.410104 Sep 27 17:18:14.515612 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: [pid: 105437|app: 0|req: 30/58] 10.222.0.55 () {64 vars in 1235 bytes} [Tue Sep 27 17:18:14 2022] POST /compute/v2.1/flavors => generated 407 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 17:18:15.731341 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi [None req-f308b502-c4a5-454c-ba56-7426cda98283 admin admin] Calling method '>' {{(pid=105438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:18:15.732379 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: INFO nova.api.openstack.requestlog [None req-f308b502-c4a5-454c-ba56-7426cda98283 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Sep 27 17:18:15.732773 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: [pid: 105438|app: 0|req: 29/59] 10.222.0.55 () {56 vars in 1074 bytes} [Tue Sep 27 17:18:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:18:16.247997 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi [None req-ff265e8c-4b6e-4bf2-bab0-7d7413bbd180 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:18:16.267013 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: INFO nova.api.openstack.requestlog [None req-ff265e8c-4b6e-4bf2-bab0-7d7413bbd180 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.396725 Sep 27 17:18:16.267548 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: [pid: 105437|app: 0|req: 31/60] 10.222.0.55 () {64 vars in 1235 bytes} [Tue Sep 27 17:18:15 2022] POST /compute/v2.1/flavors => generated 409 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 17:18:17.479710 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi [None req-f308b502-c4a5-454c-ba56-7426cda98283 admin admin] Calling method '>' {{(pid=105438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:18:17.480730 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: INFO nova.api.openstack.requestlog [None req-f308b502-c4a5-454c-ba56-7426cda98283 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Sep 27 17:18:17.481134 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: [pid: 105438|app: 0|req: 30/61] 10.222.0.55 () {56 vars in 1074 bytes} [Tue Sep 27 17:18:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:18:18.003988 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi [None req-07714199-b15b-48f1-82a6-8607af92a78f admin admin] Calling method '>' {{(pid=105437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:18:18.024565 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: INFO nova.api.openstack.requestlog [None req-07714199-b15b-48f1-82a6-8607af92a78f admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.402447 Sep 27 17:18:18.025101 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: [pid: 105437|app: 0|req: 32/62] 10.222.0.55 () {60 vars in 1202 bytes} [Tue Sep 27 17:18:17 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:19:14.776897 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi [None req-f308b502-c4a5-454c-ba56-7426cda98283 admin admin] Calling method '>' {{(pid=105438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:19:14.777845 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: INFO nova.api.openstack.requestlog [None req-f308b502-c4a5-454c-ba56-7426cda98283 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Sep 27 17:19:14.778285 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: [pid: 105438|app: 0|req: 31/63] 10.222.0.55 () {54 vars in 931 bytes} [Tue Sep 27 17:19:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:19:14.788908 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG dbcounter [-] [105437] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=105437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:19:15.164010 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi [None req-40e38aa6-a891-47fd-8f7d-301297063e49 admin admin] Calling method '>' {{(pid=105437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:19:15.184062 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: INFO nova.api.openstack.requestlog [None req-40e38aa6-a891-47fd-8f7d-301297063e49 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.399633 Sep 27 17:19:15.184625 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: [pid: 105437|app: 0|req: 33/64] 10.222.0.55 () {60 vars in 1292 bytes} [Tue Sep 27 17:19:14 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:19:15.206215 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG dbcounter [-] [105438] Writing DB stats nova_api:SELECT=14 {{(pid=105438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:19:15.210245 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi [None req-0d59c6f4-f696-4e32-b4bd-3a29e988b0ef admin admin] Calling method '>' {{(pid=105438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:19:15.217663 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: INFO nova.api.openstack.requestlog [None req-0d59c6f4-f696-4e32-b4bd-3a29e988b0ef admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012939 Sep 27 17:19:15.218227 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: [pid: 105438|app: 0|req: 32/65] 10.222.0.55 () {60 vars in 1283 bytes} [Tue Sep 27 17:19:15 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:19:15.229625 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi [None req-0e7080f2-d426-4e28-a2a4-3b792a284acf admin admin] Calling method '>' {{(pid=105437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:19:15.236755 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: INFO nova.api.openstack.requestlog [None req-0e7080f2-d426-4e28-a2a4-3b792a284acf admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010867 Sep 27 17:19:15.237257 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: [pid: 105437|app: 0|req: 34/66] 10.222.0.55 () {60 vars in 1286 bytes} [Tue Sep 27 17:19:15 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:19:15.248483 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi [None req-d782b5cc-176c-4f9c-a8f4-d58118e58753 admin admin] Calling method '>' {{(pid=105438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:19:15.255468 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: INFO nova.api.openstack.requestlog [None req-d782b5cc-176c-4f9c-a8f4-d58118e58753 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010864 Sep 27 17:19:15.255969 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: [pid: 105438|app: 0|req: 33/67] 10.222.0.55 () {60 vars in 1286 bytes} [Tue Sep 27 17:19:15 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:19:15.267187 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi [None req-bc947659-1d01-437f-8de5-5fa1492b6e3f admin admin] Calling method '>' {{(pid=105437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:19:15.274024 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: INFO nova.api.openstack.requestlog [None req-bc947659-1d01-437f-8de5-5fa1492b6e3f admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010801 Sep 27 17:19:15.274559 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: [pid: 105437|app: 0|req: 35/68] 10.222.0.55 () {60 vars in 1283 bytes} [Tue Sep 27 17:19:15 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:22:09.580654 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi [None req-d782b5cc-176c-4f9c-a8f4-d58118e58753 admin admin] Calling method '>' {{(pid=105438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:22:09.581689 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: INFO nova.api.openstack.requestlog [None req-d782b5cc-176c-4f9c-a8f4-d58118e58753 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Sep 27 17:22:09.582112 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: [pid: 105438|app: 0|req: 34/69] 10.222.0.55 () {56 vars in 1074 bytes} [Tue Sep 27 17:22:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:22:09.721297 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG dbcounter [-] [105437] Writing DB stats nova_api:SELECT=6 {{(pid=105437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:22:09.862253 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi [None req-c2940048-7510-46dc-8528-c21ba52a7e8f admin admin] Calling method '>' {{(pid=105437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:22:09.866892 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG oslo_concurrency.lockutils [None req-c2940048-7510-46dc-8528-c21ba52a7e8f admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:22:09.867384 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG oslo_concurrency.lockutils [None req-c2940048-7510-46dc-8528-c21ba52a7e8f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:22:09.867825 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG oslo_concurrency.lockutils [None req-c2940048-7510-46dc-8528-c21ba52a7e8f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:22:09.868554 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG oslo_concurrency.lockutils [None req-c2940048-7510-46dc-8528-c21ba52a7e8f admin admin] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:22:09.869013 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG oslo_concurrency.lockutils [None req-c2940048-7510-46dc-8528-c21ba52a7e8f admin admin] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:22:09.869447 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG oslo_concurrency.lockutils [None req-c2940048-7510-46dc-8528-c21ba52a7e8f admin admin] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:22:09.902246 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: INFO nova.api.openstack.requestlog [None req-c2940048-7510-46dc-8528-c21ba52a7e8f admin admin] 10.222.0.55 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.182179 Sep 27 17:22:09.902799 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: [pid: 105437|app: 0|req: 36/70] 10.222.0.55 () {60 vars in 1193 bytes} [Tue Sep 27 17:22:09 2022] GET /compute/v2.1/os-services => generated 791 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 17:22:11.021927 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi [None req-d782b5cc-176c-4f9c-a8f4-d58118e58753 admin admin] Calling method '>' {{(pid=105438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:22:11.022987 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: INFO nova.api.openstack.requestlog [None req-d782b5cc-176c-4f9c-a8f4-d58118e58753 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Sep 27 17:22:11.023386 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: [pid: 105438|app: 0|req: 35/71] 10.222.0.55 () {56 vars in 1074 bytes} [Tue Sep 27 17:22:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:22:11.211854 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi [None req-c1fe17be-91de-4ac3-a98f-dd9b97e118b0 admin admin] Calling method '>' {{(pid=105437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:22:11.215841 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG oslo_concurrency.lockutils [None req-c1fe17be-91de-4ac3-a98f-dd9b97e118b0 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:22:11.216322 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG oslo_concurrency.lockutils [None req-c1fe17be-91de-4ac3-a98f-dd9b97e118b0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:22:11.216785 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG oslo_concurrency.lockutils [None req-c1fe17be-91de-4ac3-a98f-dd9b97e118b0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:22:11.217510 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG oslo_concurrency.lockutils [None req-c1fe17be-91de-4ac3-a98f-dd9b97e118b0 admin admin] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:22:11.217966 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG oslo_concurrency.lockutils [None req-c1fe17be-91de-4ac3-a98f-dd9b97e118b0 admin admin] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:22:11.218415 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG oslo_concurrency.lockutils [None req-c1fe17be-91de-4ac3-a98f-dd9b97e118b0 admin admin] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:22:11.237705 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: INFO nova.api.openstack.requestlog [None req-c1fe17be-91de-4ac3-a98f-dd9b97e118b0 admin admin] 10.222.0.55 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.076016 Sep 27 17:22:11.238280 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: [pid: 105437|app: 0|req: 37/72] 10.222.0.55 () {60 vars in 1193 bytes} [Tue Sep 27 17:22:11 2022] GET /compute/v2.1/os-services => generated 791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 17:22:22.708773 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi [None req-d782b5cc-176c-4f9c-a8f4-d58118e58753 admin admin] Calling method '>' {{(pid=105438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:22:22.709797 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: INFO nova.api.openstack.requestlog [None req-d782b5cc-176c-4f9c-a8f4-d58118e58753 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Sep 27 17:22:22.710227 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: [pid: 105438|app: 0|req: 36/73] 10.222.0.55 () {56 vars in 1074 bytes} [Tue Sep 27 17:22:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:22:22.854314 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG dbcounter [-] [105437] Writing DB stats nova_cell0:SELECT=4 {{(pid=105437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:22:22.855271 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG dbcounter [-] [105437] Writing DB stats nova_cell1:SELECT=4 {{(pid=105437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:22:22.856499 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG dbcounter [-] [105437] Writing DB stats nova_api:SELECT=8 {{(pid=105437) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:22:22.904166 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi [None req-96355000-dca8-4e6e-abee-80752244853c admin admin] Calling method '>' {{(pid=105437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:22:22.907540 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG oslo_concurrency.lockutils [None req-96355000-dca8-4e6e-abee-80752244853c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:22:22.908020 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG oslo_concurrency.lockutils [None req-96355000-dca8-4e6e-abee-80752244853c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:22:22.908451 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG oslo_concurrency.lockutils [None req-96355000-dca8-4e6e-abee-80752244853c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:22:22.909173 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG oslo_concurrency.lockutils [None req-96355000-dca8-4e6e-abee-80752244853c admin admin] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:22:22.909623 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG oslo_concurrency.lockutils [None req-96355000-dca8-4e6e-abee-80752244853c admin admin] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:22:22.910041 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG oslo_concurrency.lockutils [None req-96355000-dca8-4e6e-abee-80752244853c admin admin] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:22:22.934524 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: INFO nova.api.openstack.requestlog [None req-96355000-dca8-4e6e-abee-80752244853c admin admin] 10.222.0.55 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.084593 Sep 27 17:22:22.935212 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: [pid: 105437|app: 0|req: 38/74] 10.222.0.55 () {60 vars in 1193 bytes} [Tue Sep 27 17:22:22 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:22:24.036621 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG nova.api.openstack.wsgi [None req-d782b5cc-176c-4f9c-a8f4-d58118e58753 admin admin] Calling method '>' {{(pid=105438) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:22:24.037633 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: INFO nova.api.openstack.requestlog [None req-d782b5cc-176c-4f9c-a8f4-d58118e58753 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Sep 27 17:22:24.038036 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: [pid: 105438|app: 0|req: 37/75] 10.222.0.55 () {56 vars in 1074 bytes} [Tue Sep 27 17:22:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:22:24.229344 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG nova.api.openstack.wsgi [None req-30aa72f9-596c-4a82-9aec-1e37c21484da admin admin] Calling method '>' {{(pid=105437) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:22:24.233635 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG oslo_concurrency.lockutils [None req-30aa72f9-596c-4a82-9aec-1e37c21484da admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:22:24.234165 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG oslo_concurrency.lockutils [None req-30aa72f9-596c-4a82-9aec-1e37c21484da admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:22:24.234597 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG oslo_concurrency.lockutils [None req-30aa72f9-596c-4a82-9aec-1e37c21484da admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:22:24.235314 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG oslo_concurrency.lockutils [None req-30aa72f9-596c-4a82-9aec-1e37c21484da admin admin] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:22:24.235757 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG oslo_concurrency.lockutils [None req-30aa72f9-596c-4a82-9aec-1e37c21484da admin admin] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:22:24.236176 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: DEBUG oslo_concurrency.lockutils [None req-30aa72f9-596c-4a82-9aec-1e37c21484da admin admin] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105437) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:22:24.257162 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: INFO nova.api.openstack.requestlog [None req-30aa72f9-596c-4a82-9aec-1e37c21484da admin admin] 10.222.0.55 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.078051 Sep 27 17:22:24.257642 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: [pid: 105437|app: 0|req: 39/76] 10.222.0.55 () {60 vars in 1193 bytes} [Tue Sep 27 17:22:24 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:23:19.565659 dv-cinder-849143-8-iscsi devstack@n-api.service[105436]: Tue Sep 27 17:23:19 2022 - graceful shutdown triggered... Sep 27 17:23:19.565789 dv-cinder-849143-8-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 27 17:23:19.566887 dv-cinder-849143-8-iscsi devstack@n-api.service[105437]: Gracefully killing worker 1 (pid: 105437)... Sep 27 17:23:19.567768 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: Gracefully killing worker 2 (pid: 105438)... Sep 27 17:23:19.694139 dv-cinder-849143-8-iscsi devstack@n-api.service[105438]: DEBUG dbcounter [-] [105438] Writing DB stats nova_api:SELECT=4 {{(pid=105438) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:23:20.568083 dv-cinder-849143-8-iscsi devstack@n-api.service[105436]: worker 1 buried after 1 seconds Sep 27 17:23:20.568083 dv-cinder-849143-8-iscsi devstack@n-api.service[105436]: worker 2 buried after 1 seconds Sep 27 17:23:20.568083 dv-cinder-849143-8-iscsi devstack@n-api.service[105436]: goodbye to uWSGI. Sep 27 17:23:20.569583 dv-cinder-849143-8-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 27 17:23:20.570180 dv-cinder-849143-8-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 27 17:23:20.572986 dv-cinder-849143-8-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 27 17:23:20.582053 dv-cinder-849143-8-iscsi devstack@n-api.service[120395]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 27 17:23:20.584188 dv-cinder-849143-8-iscsi devstack@n-api.service[120395]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Sep 27 17:23:20 2022] *** Sep 27 17:23:20.584188 dv-cinder-849143-8-iscsi devstack@n-api.service[120395]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 27 17:23:20.584188 dv-cinder-849143-8-iscsi devstack@n-api.service[120395]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 27 17:23:20.584188 dv-cinder-849143-8-iscsi devstack@n-api.service[120395]: nodename: dv-cinder-849143-8-iscsi Sep 27 17:23:20.584188 dv-cinder-849143-8-iscsi devstack@n-api.service[120395]: machine: x86_64 Sep 27 17:23:20.584188 dv-cinder-849143-8-iscsi devstack@n-api.service[120395]: clock source: unix Sep 27 17:23:20.584188 dv-cinder-849143-8-iscsi devstack@n-api.service[120395]: pcre jit disabled Sep 27 17:23:20.584188 dv-cinder-849143-8-iscsi devstack@n-api.service[120395]: detected number of CPU cores: 4 Sep 27 17:23:20.584188 dv-cinder-849143-8-iscsi devstack@n-api.service[120395]: current working directory: / Sep 27 17:23:20.584188 dv-cinder-849143-8-iscsi devstack@n-api.service[120395]: detected binary path: /usr/bin/uwsgi-core Sep 27 17:23:20.584188 dv-cinder-849143-8-iscsi devstack@n-api.service[120395]: your processes number limit is 47680 Sep 27 17:23:20.585073 dv-cinder-849143-8-iscsi devstack@n-api.service[120395]: your memory page size is 4096 bytes Sep 27 17:23:20.585073 dv-cinder-849143-8-iscsi devstack@n-api.service[120395]: detected max file descriptor number: 2048 Sep 27 17:23:20.585073 dv-cinder-849143-8-iscsi devstack@n-api.service[120395]: lock engine: pthread robust mutexes Sep 27 17:23:20.585073 dv-cinder-849143-8-iscsi devstack@n-api.service[120395]: thunder lock: enabled Sep 27 17:23:20.585073 dv-cinder-849143-8-iscsi devstack@n-api.service[120395]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 27 17:23:20.585073 dv-cinder-849143-8-iscsi devstack@n-api.service[120395]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 27 17:23:20.624667 dv-cinder-849143-8-iscsi devstack@n-api.service[120395]: Python main interpreter initialized at 0x56245a2579c0 Sep 27 17:23:20.624667 dv-cinder-849143-8-iscsi devstack@n-api.service[120395]: python threads support enabled Sep 27 17:23:20.624667 dv-cinder-849143-8-iscsi devstack@n-api.service[120395]: your server socket listen backlog is limited to 100 connections Sep 27 17:23:20.624667 dv-cinder-849143-8-iscsi devstack@n-api.service[120395]: your mercy for graceful operations on workers is 90 seconds Sep 27 17:23:20.625102 dv-cinder-849143-8-iscsi devstack@n-api.service[120395]: mapped 403077 bytes (393 KB) for 2 cores Sep 27 17:23:20.625102 dv-cinder-849143-8-iscsi devstack@n-api.service[120395]: *** Operational MODE: preforking *** Sep 27 17:23:20.625394 dv-cinder-849143-8-iscsi devstack@n-api.service[120395]: *** uWSGI is running in multiple interpreter mode *** Sep 27 17:23:20.625394 dv-cinder-849143-8-iscsi devstack@n-api.service[120395]: spawned uWSGI master process (pid: 120395) Sep 27 17:23:20.625596 dv-cinder-849143-8-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 27 17:23:20.626474 dv-cinder-849143-8-iscsi devstack@n-api.service[120395]: spawned uWSGI worker 1 (pid: 120415, cores: 1) Sep 27 17:23:20.626598 dv-cinder-849143-8-iscsi devstack@n-api.service[120395]: spawned uWSGI worker 2 (pid: 120416, cores: 1) Sep 27 17:23:20.626720 dv-cinder-849143-8-iscsi devstack@n-api.service[120395]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 27 17:23:21.303733 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 27 17:23:21.360790 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 27 17:23:22.467225 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 27 17:23:22.467225 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: from cryptography.utils import int_from_bytes Sep 27 17:23:22.468350 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 27 17:23:22.468350 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: from cryptography.utils import int_from_bytes Sep 27 17:23:22.539232 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 27 17:23:22.539232 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: from cryptography.utils import int_from_bytes Sep 27 17:23:22.539855 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 27 17:23:22.539855 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: from cryptography.utils import int_from_bytes Sep 27 17:23:24.872263 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 27 17:23:24.872872 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 27 17:23:24.873158 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 27 17:23:24.873449 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 27 17:23:24.874269 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 27 17:23:24.874668 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.875004 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.875331 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.875658 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.875998 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.876315 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.876662 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.876970 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.877301 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.877563 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.877881 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.878415 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849143-8-iscsi {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.878749 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.879069 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.879392 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.879723 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.880033 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.880369 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.880696 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.881210 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.882680 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.882680 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.882680 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.882680 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.883045 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.883260 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.883578 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.883901 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.884216 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.884547 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.884956 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849143-8-iscsi {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.885275 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.885607 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.885913 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.886376 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.886698 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.886997 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.887324 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.887643 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.887954 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.888285 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.888607 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.888927 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.889314 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.890117 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.890446 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.890765 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.891094 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.891393 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.891703 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.891958 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.892267 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.892592 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.892911 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.893237 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.893491 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.893746 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.894102 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.894416 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.895070 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.895070 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.895332 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.895644 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.895954 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.896263 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.896573 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.896881 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.897204 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.897522 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.897848 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.898178 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.898505 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.898921 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.55 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.899173 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.55 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.899485 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.899832 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.900152 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.900472 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.900792 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.901123 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.901430 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.901741 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.902053 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.902400 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.902740 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.903052 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.903305 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.903611 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.903921 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.904243 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.904554 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.904897 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.905207 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.905512 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.905824 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.906160 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.906475 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.906783 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.907091 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.907399 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.907705 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.908015 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.908327 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.908634 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.908964 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.909285 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.909594 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.909904 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.910240 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.910560 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.910879 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.911192 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.911503 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.911826 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.912137 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.912446 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.912766 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.913075 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.913384 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.913702 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.914004 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.914341 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.914660 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.914970 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.915279 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.915586 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.915894 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.916217 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.916510 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.916814 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.917120 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.917422 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.917745 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.918098 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.918402 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.918717 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.919027 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.919347 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.919693 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.920029 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.920382 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.920946 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.921557 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.922212 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.922814 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.923403 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.923987 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.924600 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.925204 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.925811 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.926260 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.926603 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.927123 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.927764 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.928385 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.928711 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.929039 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.929364 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.929709 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.930061 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.930729 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.931056 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.931421 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.931780 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.932105 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.932479 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.933110 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.933286 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 27 17:23:24.933780 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 27 17:23:24.933952 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.934160 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 27 17:23:24.934316 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.934551 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 27 17:23:24.934713 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 27 17:23:24.934860 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.935095 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.935319 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.935584 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.935845 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.936631 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.936911 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.937211 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.937490 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.937762 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.938034 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.938334 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.938533 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.938683 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.938841 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.939003 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.939149 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.939302 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.939454 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.939610 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.939781 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.939945 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.939945 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849143-8-iscsi {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.940532 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.940700 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.940700 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.941004 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.941598 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.941754 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.941910 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.941910 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.942238 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.942238 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.942539 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.942685 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.943104 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.943259 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.943259 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.943259 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.943687 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.943859 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.943859 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.944193 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.944378 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.944583 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.944767 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.944952 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.945144 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.945144 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.945502 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.945700 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.945700 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.946052 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.946251 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.946446 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.946639 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.946822 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.947016 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.947212 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.947395 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.947579 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.948385 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.948576 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.948780 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.948974 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849143-8-iscsi {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.949170 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.949354 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.949755 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.949929 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.950121 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.950287 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.950665 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.950665 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.950961 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.951118 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.951292 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.952352 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.952352 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.952661 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.952824 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.953115 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.953381 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.953540 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.953687 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.953839 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.953984 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.954162 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.954316 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.954469 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.954615 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.954768 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.954923 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.955069 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.955232 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.955386 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.955539 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.955684 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.955861 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.956092 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.956256 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.956256 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.956539 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.956704 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.956866 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.957012 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.957189 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.957343 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.957487 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.957647 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.957792 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.957944 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.958122 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.958295 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.958448 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.958604 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.958768 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.958920 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.959064 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.959230 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.959392 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.959556 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.959709 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.959855 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.959998 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.960143 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.960301 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.960447 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.960447 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.960947 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.961101 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.961257 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.961411 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.961576 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.961958 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.962329 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.962499 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.962654 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.962801 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.963276 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.963581 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.963677 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.963775 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.963863 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.963949 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.964045 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.964144 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.964233 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.964327 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.964421 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.964508 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.964603 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.964603 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.55 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.964775 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.964870 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.55 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.964956 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.965051 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.965138 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.965232 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.965327 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.965413 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.965505 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.965678 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.965775 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.965862 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.965948 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.966033 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.966157 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.966157 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.966340 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.966340 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.966516 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.966603 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.966688 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.966783 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.966870 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.966963 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.967062 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.967157 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.967262 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.967398 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.967497 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.967585 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.967670 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.967771 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.967872 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.967968 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.968063 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.968151 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.968244 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.968339 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.968435 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.968530 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.968624 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.968719 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.968807 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.968900 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.969006 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.969103 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.969197 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.969297 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.969386 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.969479 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.969630 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.969733 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.969934 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.970028 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.970263 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.970371 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.970577 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.970741 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.970888 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.971040 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.971194 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.971318 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.971511 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.971607 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.971831 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.971940 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.972145 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.972436 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.972645 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.972773 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.972986 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.973089 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.973331 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.973491 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.973635 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.973738 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.973938 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.974042 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.974293 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.974389 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.974597 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.974691 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.974899 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.975003 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.975215 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.975318 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.975520 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.975623 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.975824 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.975918 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.976138 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.976231 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.976436 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.976541 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.976740 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.976833 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.977054 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.977148 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.977359 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.977462 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.977661 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.977764 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.977962 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.978064 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.978288 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.978397 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.978591 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.978684 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.978891 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.978991 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.979189 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.979291 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.979491 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.979585 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.979788 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.980144 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.980369 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.980472 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.980691 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.980780 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.980999 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.981114 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.981301 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.981404 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.981601 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.981707 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.981918 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 27 17:23:24.982019 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.982272 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.982368 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.982587 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.982688 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.982916 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.983026 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.983249 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.983342 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.983572 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.983665 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.983884 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.983986 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.984198 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.984290 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.984508 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.984601 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.984821 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.984928 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.985143 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.985246 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.985451 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.985545 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.985760 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.985856 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.986083 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.986179 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.986405 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.986498 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.986721 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.986821 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.987055 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.987196 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.987386 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.987570 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.987705 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.987889 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.988025 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.988208 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.988370 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.988519 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.988689 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.988837 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.989007 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.989164 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.989326 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.989485 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.989636 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.989797 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.989953 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.990645 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.990821 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.991006 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.991006 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.991381 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.991545 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.991696 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.991802 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.991900 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.992005 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.992173 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.992485 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.992834 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.993098 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.993348 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.993533 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.993779 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.993949 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.994458 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.994563 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.994653 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.994748 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.994836 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.994932 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.995028 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.995123 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.995217 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.995440 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.995534 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.995754 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.995848 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.996062 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.996154 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.996380 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.996482 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.996695 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.996790 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.997011 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.997107 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.997324 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.997432 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.997638 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.997741 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.997948 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.998049 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.998286 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.998398 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.999129 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.999469 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.999469 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.999655 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.999756 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:24.999845 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.000030 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.000576 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.000664 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.000739 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.000821 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.000902 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.000986 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.001306 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.001416 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.001716 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.001829 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.001928 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.002031 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.002192 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.002521 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.002723 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.002893 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.003173 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.003371 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.003868 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.004003 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.004292 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.004392 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.004490 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.004567 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.004647 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.004727 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.004827 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.005030 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.005492 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.005589 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.005679 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.005765 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.006680 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.006680 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.006837 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.006910 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.006988 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.007084 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.007084 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.007225 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.007445 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.007548 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.007636 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.007725 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.007950 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.008286 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.008452 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.008610 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.008776 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.008947 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.009116 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.009272 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.009435 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.009576 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.009737 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.009881 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.010027 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.010255 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.010347 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.010458 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.010569 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.010769 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.010871 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.011093 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.011195 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.011420 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.011599 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.011752 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.011917 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.012073 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.012227 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.012514 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.012672 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.012826 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.012968 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.013066 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.013256 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.013256 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.013558 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.013707 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.013850 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.013993 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.014307 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.014423 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.014513 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.014599 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.014684 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.014776 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.014858 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.015084 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.015180 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.015390 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.015483 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.015697 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.015797 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.016001 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.016104 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.016324 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.016434 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.016638 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.016742 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.016949 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.017044 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.017267 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.017375 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.017578 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.017714 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.017890 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.017983 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.018230 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.018338 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.018547 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.018655 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.018860 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.018962 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.019167 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.019274 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.019477 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.019579 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.019783 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.019883 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.020094 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.020196 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.020403 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.020498 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.020715 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.020818 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.021023 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.021116 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.021333 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.021434 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.021643 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.021736 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.021951 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.022049 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.022281 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.022384 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.022626 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.022722 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.022911 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.023003 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.023221 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.023315 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.023533 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.023628 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.023841 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.023944 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.024163 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.024272 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.024472 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.024579 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.024781 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.024949 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.025094 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.025190 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.025405 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.025500 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.025716 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.025820 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.026036 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.026171 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.026371 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.026466 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.026692 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.026802 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.027000 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.027099 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.027319 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.027411 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.027631 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.027733 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.027948 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.028049 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.028251 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.028344 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.028559 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.028668 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.028884 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.028975 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.029199 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.029292 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.029514 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.029606 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.030369 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.030473 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.030697 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.030792 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.031010 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.031113 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.031319 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.031410 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.031636 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.031734 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.031945 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.032040 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.032252 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.032345 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.032620 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.032803 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.032902 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.032996 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.033173 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.033275 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.033485 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.033598 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.033789 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.033883 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.034119 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.034217 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.034431 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.034545 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.034736 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.034830 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.035040 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.035130 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.035352 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.035454 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.035661 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.035754 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.035991 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.036091 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.036305 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.036407 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.036616 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.036710 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.036918 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.037019 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.037228 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.037330 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.037542 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.037635 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.037848 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.037947 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.038210 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.038321 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.038521 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.038635 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.038829 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.038959 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.039177 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.039310 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.039513 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.039625 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.039790 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.039908 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.040106 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.040212 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.040426 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.040539 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.040738 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.040852 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.041055 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.041158 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.041368 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.041482 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.041680 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.041813 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.042002 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.042221 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.042330 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.042419 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.042638 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.042759 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.043007 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.043153 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.043306 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.043449 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.043608 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.043762 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.043919 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.044071 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.044221 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.044364 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.044527 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.044675 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.044819 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.044969 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.045114 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.045240 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.045470 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.046275 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.046387 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.046599 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.046702 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.046915 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.047188 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.047340 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.047524 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.047659 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.047841 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.047977 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.048161 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.048306 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.048507 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.048634 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.048828 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.048964 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.049157 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.049279 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.049484 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.049601 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.049800 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.049903 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.050126 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.050265 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.050440 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.050596 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.050744 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.050914 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.051049 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.051237 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.051345 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.051550 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.051647 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.051884 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.051989 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.052213 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.052325 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.052531 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.052631 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.052864 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.052976 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.053133 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.053268 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.053437 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.053597 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.053741 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.053916 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.054055 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.054279 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.054374 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.054609 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.054702 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.054921 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.055030 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.055232 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.055334 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.055550 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.055660 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.055858 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.055962 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.056163 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.056265 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.056465 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.056559 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.056785 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.056890 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.057097 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.057198 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.057414 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.057514 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.057731 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.057832 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.058041 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.058170 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.058374 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.058469 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.058686 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.058802 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.058999 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.059114 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.059300 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.059404 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.059602 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.059707 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.059903 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.060006 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.060212 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.060321 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.060518 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.060622 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.060819 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.060928 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.061151 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.061331 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.061466 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.061570 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.061776 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.061881 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.062101 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.062293 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.062448 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.062588 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.062734 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.062889 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.063105 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.063210 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.063345 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.063494 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.063639 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.063783 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.063886 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.064077 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.064227 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.064370 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.064516 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.064680 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.064840 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.064987 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.065131 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.065278 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.065420 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.065563 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.065755 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.065905 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.066063 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.066230 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.066375 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.066519 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.066687 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.066831 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.066980 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.067130 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.067279 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.067436 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.067578 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.067723 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.067864 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.068009 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.068157 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.068324 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.068478 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.068640 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.068792 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.068943 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.069093 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.069245 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.069397 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.069539 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.069682 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.069827 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.069970 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.070174 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.070268 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.070387 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.070482 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.070704 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.070814 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.071006 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.071100 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.071314 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.071415 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.071621 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.071730 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.071925 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.072017 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.072226 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.072327 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.072534 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.072642 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.072835 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.072930 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.073202 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.073316 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.073436 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.073532 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.073736 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.073834 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.074037 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.074172 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.074378 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.074482 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.074685 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.074776 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.074989 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.075093 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.075292 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.075393 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.075594 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.075684 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.075934 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.076038 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.076236 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.076536 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.076636 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.077404 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.077513 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.077724 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.077818 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.078043 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.078155 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.078381 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.078485 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.078693 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.078808 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.079006 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.079099 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.079311 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.079420 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.079626 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.079726 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.079933 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.080034 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.080245 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.080355 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.080548 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.080642 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.080848 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.080941 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.081166 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.081269 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.081479 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.081581 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.081791 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.081885 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.082133 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.082232 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.082455 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.082556 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.082777 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.082881 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.083080 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.083176 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.083427 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.083543 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.083692 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.083800 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.084000 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.084102 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.084311 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.084413 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.084622 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.084728 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.084933 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.085027 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.085245 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.085346 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.085555 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.085661 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.085866 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.085959 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.086198 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.086309 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.086510 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.086606 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.086825 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.086925 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.087133 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.087234 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.087439 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.087578 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.087762 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.087865 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.088078 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.088195 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.088380 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.088510 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.088690 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.088804 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.088995 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.089107 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.089307 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.089521 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.089623 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.089839 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.090031 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.090276 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.090373 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.090608 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.090711 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.090936 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.091039 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.091261 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.091365 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.091570 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.091664 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.091890 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.091984 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.092202 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.092344 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.092575 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.092727 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.092892 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.093000 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.093208 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.093302 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.093538 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.093644 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.093843 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.093951 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.094195 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.094289 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.094505 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.094607 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.094818 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.094932 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.095133 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.095237 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.095434 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.095673 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.095775 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.096026 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.096134 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.096345 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.096446 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.096648 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.096753 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.096970 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.097079 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.097297 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.097390 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.097610 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.097717 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.097941 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.098052 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.098280 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.098398 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.098589 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.098700 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.098911 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.099013 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.099228 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.099332 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.099536 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.099646 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.099846 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.099941 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.100163 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.100266 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.100476 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.100579 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.100783 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.100886 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.101097 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.101201 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.101408 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.101505 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.101718 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.101811 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.102037 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.102176 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.102365 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.102481 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.102681 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.102839 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.103000 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.103105 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.103310 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.103405 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.103648 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.103755 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.103925 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.104033 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.104233 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.104337 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.104554 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.104708 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.104863 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.105266 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.105515 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.105656 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.105823 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.105967 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.106158 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.106272 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.106471 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.106566 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.106778 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.106882 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.107082 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.107191 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.107405 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.107500 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.107711 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.107811 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.108546 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.108660 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.108862 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.108967 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.109169 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.109271 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.109472 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.109576 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.109773 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.109868 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.110113 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.110212 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.110421 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.110528 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.110743 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.110847 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.111058 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.111299 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.111407 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.111638 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.111733 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.111964 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.112058 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.112285 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.112386 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.112596 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.112721 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.112900 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.113031 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.113208 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.113306 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.113495 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.113589 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.113834 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.113938 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.114156 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.114251 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.114479 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.114570 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.114794 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.114894 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.115113 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.115207 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.115420 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.115574 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.115727 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.115887 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.116042 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.116200 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.116336 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.116455 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.116648 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.116757 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.116962 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.117074 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.117276 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.117397 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.117578 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.117687 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.117881 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.117985 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.118211 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.118321 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.118515 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.118611 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.118819 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.118921 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.119125 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.119238 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.119432 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.119536 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.119733 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.119835 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.120035 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.120137 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.120339 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.120443 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.120659 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.120755 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.120963 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.121069 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.121281 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.121375 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.121588 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.121680 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.121894 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.122001 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.122222 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.122364 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.122531 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.122629 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.122872 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.122992 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.123227 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.123336 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.123490 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.123641 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.123924 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.124050 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.124191 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.124288 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.124508 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.124622 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.124825 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.124932 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.125141 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.125244 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.125455 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.125559 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.125772 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.125877 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.126102 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.126201 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.126426 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.126594 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.126756 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.126905 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.127051 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.127196 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.127349 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.127511 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.127665 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.127816 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.127977 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.128130 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.128278 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.128458 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.128679 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.128820 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.128987 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.129130 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.129279 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.129429 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.129571 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.129722 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.129871 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.130029 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.130186 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.130347 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.130497 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.130639 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.130792 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.130939 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.131095 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.131247 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.131393 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.131536 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.131689 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.131842 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.131995 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.132145 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.132290 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.132431 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.132584 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.132751 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.132901 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.133055 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.133206 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.133305 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.133462 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.133616 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.133771 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.133940 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.134038 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.134214 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.134313 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.134485 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.134610 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.134796 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.134920 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.135128 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.135242 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.135465 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.135565 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.135784 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.135887 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.136108 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.136213 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.136423 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.136533 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.136735 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.136843 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.137045 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.137151 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.137354 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.137457 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.137667 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.137764 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.137980 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.138115 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.138318 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.138412 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.138650 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.138743 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.138964 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.139066 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.139827 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.139998 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.140146 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.140250 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.140445 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.140549 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.140757 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.140969 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.141073 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.141289 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.141394 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.141624 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.141727 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.141952 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.142055 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.142304 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.142480 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.142625 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.142720 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.142950 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.143045 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.143280 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.143416 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.143593 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.143715 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.143899 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.144000 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.144210 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.144310 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.144522 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.144616 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.144826 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.144934 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.145142 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.145258 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.145451 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.145543 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.145758 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.145915 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.146120 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.146209 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.146396 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.146492 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.146816 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.146918 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.147138 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.147260 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.147468 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.147562 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.147799 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.147902 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.148113 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.148216 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.148443 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.148537 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.148772 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.148881 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.149105 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.149214 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.149411 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.149507 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.149716 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.149811 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.150029 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.150155 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.150364 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.150461 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.150670 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.150772 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.150975 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.151077 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.151265 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120416) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 27 17:23:25.151367 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.151581 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.151886 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.152198 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.152504 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.152836 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.153141 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.153515 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.153752 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.154093 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.154393 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.154701 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.155083 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.155393 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.155706 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.156011 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.156402 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.156712 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.157026 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.157380 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.157691 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.157996 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.158344 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.158651 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.158957 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.159273 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.159585 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.159905 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.160216 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.160528 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.160872 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.161187 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.161721 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.162056 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.162396 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.162726 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.163062 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.163368 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.163673 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.163980 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.164302 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.164611 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.164917 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.165226 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.165535 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.165845 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.166175 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.166486 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.166795 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.167103 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.167412 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.167721 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.168026 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.168333 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.168639 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.168952 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.169291 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.169614 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.169931 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.170268 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.171123 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.171435 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.171744 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.172053 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.172361 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.172674 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.173001 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.173312 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.173621 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.174035 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.174378 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.174697 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.175015 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.175323 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.175647 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.175967 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.176276 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.176595 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.176904 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.177235 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.177569 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.177893 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.178235 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.178540 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.178845 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.179147 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.179455 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.179772 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.180080 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.180381 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.180684 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.180987 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.181288 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.181685 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.181887 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.182208 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.182515 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.182813 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.183113 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.183419 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.183718 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.184036 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.184318 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.184626 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.184924 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.185223 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.185523 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.185823 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.186221 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.186554 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.186885 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.187199 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.187522 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.187832 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.188150 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.188458 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.188776 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.189092 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.189405 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.189714 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.190046 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.190379 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.190691 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.191005 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.191315 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.191627 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.191935 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.192263 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.192587 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.192892 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.193228 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.193538 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.193856 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.194198 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.194511 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.194838 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.195152 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.195461 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.195770 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.196081 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.196394 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.196707 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.197017 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.197346 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.197645 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.197956 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.198305 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.198632 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.198942 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.199266 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.199589 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.199930 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.200242 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.200583 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.200910 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.201225 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.201539 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.202400 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 27 17:23:25.202642 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 27 17:23:25.214637 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO dbcounter [None req-f9209543-fd43-4cee-9453-9a939b58f5a7 None None] Registered counter for database nova_api Sep 27 17:23:25.237310 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_db.sqlalchemy.engines [None req-f9209543-fd43-4cee-9453-9a939b58f5a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120416) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 27 17:23:25.245732 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writer thread running {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 27 17:23:25.282321 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO dbcounter [None req-91fa9698-3823-4f5a-9255-0f887c98d5e7 None None] Registered counter for database nova_api Sep 27 17:23:25.304162 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.context [None req-f9209543-fd43-4cee-9453-9a939b58f5a7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b2a4a363-82fa-43f0-a614-939b4985f9a0(cell1) {{(pid=120416) load_cells /opt/stack/nova/nova/context.py:464}} Sep 27 17:23:25.307056 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_db.sqlalchemy.engines [None req-91fa9698-3823-4f5a-9255-0f887c98d5e7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120415) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 27 17:23:25.308314 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f9209543-fd43-4cee-9453-9a939b58f5a7 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:23:25.308794 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f9209543-fd43-4cee-9453-9a939b58f5a7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:23:25.310411 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f9209543-fd43-4cee-9453-9a939b58f5a7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:23:25.311193 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f9209543-fd43-4cee-9453-9a939b58f5a7 None None] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:23:25.311639 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f9209543-fd43-4cee-9453-9a939b58f5a7 None None] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:23:25.313669 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f9209543-fd43-4cee-9453-9a939b58f5a7 None None] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:23:25.313895 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writer thread running {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 27 17:23:25.315754 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO dbcounter [None req-f9209543-fd43-4cee-9453-9a939b58f5a7 None None] Registered counter for database nova_cell0 Sep 27 17:23:25.319992 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO dbcounter [None req-f9209543-fd43-4cee-9453-9a939b58f5a7 None None] Registered counter for database nova_cell1 Sep 27 17:23:25.328300 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_db.sqlalchemy.engines [None req-f9209543-fd43-4cee-9453-9a939b58f5a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120416) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 27 17:23:25.329608 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_db.sqlalchemy.engines [None req-f9209543-fd43-4cee-9453-9a939b58f5a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120416) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 27 17:23:25.336265 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writer thread running {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 27 17:23:25.337533 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writer thread running {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 27 17:23:25.371889 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.context [None req-91fa9698-3823-4f5a-9255-0f887c98d5e7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b2a4a363-82fa-43f0-a614-939b4985f9a0(cell1) {{(pid=120415) load_cells /opt/stack/nova/nova/context.py:464}} Sep 27 17:23:25.376039 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-91fa9698-3823-4f5a-9255-0f887c98d5e7 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:23:25.377093 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-91fa9698-3823-4f5a-9255-0f887c98d5e7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:23:25.378746 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-91fa9698-3823-4f5a-9255-0f887c98d5e7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:23:25.379476 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-91fa9698-3823-4f5a-9255-0f887c98d5e7 None None] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:23:25.379923 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-91fa9698-3823-4f5a-9255-0f887c98d5e7 None None] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:23:25.381923 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-91fa9698-3823-4f5a-9255-0f887c98d5e7 None None] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:23:25.383945 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO dbcounter [None req-91fa9698-3823-4f5a-9255-0f887c98d5e7 None None] Registered counter for database nova_cell0 Sep 27 17:23:25.388037 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO dbcounter [None req-91fa9698-3823-4f5a-9255-0f887c98d5e7 None None] Registered counter for database nova_cell1 Sep 27 17:23:25.395661 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_db.sqlalchemy.engines [None req-91fa9698-3823-4f5a-9255-0f887c98d5e7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120415) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 27 17:23:25.397995 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_db.sqlalchemy.engines [None req-91fa9698-3823-4f5a-9255-0f887c98d5e7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120415) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 27 17:23:25.402710 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writer thread running {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 27 17:23:25.491667 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO dbcounter [None req-f9209543-fd43-4cee-9453-9a939b58f5a7 None None] Registered counter for database nova_cell0 Sep 27 17:23:25.500390 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_db.sqlalchemy.engines [None req-f9209543-fd43-4cee-9453-9a939b58f5a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120416) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 27 17:23:25.504993 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writer thread running {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 27 17:23:25.546327 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writer thread running {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 27 17:23:25.557096 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO dbcounter [None req-91fa9698-3823-4f5a-9255-0f887c98d5e7 None None] Registered counter for database nova_cell0 Sep 27 17:23:25.566430 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_db.sqlalchemy.engines [None req-91fa9698-3823-4f5a-9255-0f887c98d5e7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120415) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 27 17:23:25.571144 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writer thread running {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 27 17:23:25.839760 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: WARNING keystonemiddleware.auth_token [None req-f9209543-fd43-4cee-9453-9a939b58f5a7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 27 17:23:25.847217 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: WARNING keystonemiddleware.auth_token [None req-f9209543-fd43-4cee-9453-9a939b58f5a7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 27 17:23:25.904322 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: WARNING keystonemiddleware.auth_token [None req-91fa9698-3823-4f5a-9255-0f887c98d5e7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 27 17:23:25.911988 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: WARNING keystonemiddleware.auth_token [None req-91fa9698-3823-4f5a-9255-0f887c98d5e7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 27 17:23:26.207499 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: WARNING keystonemiddleware.auth_token [None req-f9209543-fd43-4cee-9453-9a939b58f5a7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 27 17:23:26.213468 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: WARNING keystonemiddleware.auth_token [None req-f9209543-fd43-4cee-9453-9a939b58f5a7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 27 17:23:26.218920 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56245a2579c0 pid: 120416 (default app) Sep 27 17:23:26.278945 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: WARNING keystonemiddleware.auth_token [None req-91fa9698-3823-4f5a-9255-0f887c98d5e7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 27 17:23:26.285053 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: WARNING keystonemiddleware.auth_token [None req-91fa9698-3823-4f5a-9255-0f887c98d5e7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 27 17:23:26.290503 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56245a2579c0 pid: 120415 (default app) Sep 27 17:24:00.903203 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_api:SELECT=3 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:00.904785 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_cell0:SELECT=3 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:00.905534 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_cell1:SELECT=3 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:00.906479 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_cell0:SELECT=3 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:02.092655 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-046412d0-c96c-4b36-bc46-84351a7904f8 tempest-VolumesSnapshotsTestJSON-1830509268 tempest-VolumesSnapshotsTestJSON-1830509268-project] Action: 'create', calling method: .version_select at 0x7fe725a6c4c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1874441307"}} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:24:02.469995 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_api:SELECT=3 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:02.470871 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell1:SELECT=3 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:02.471659 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell0:SELECT=3 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:02.472543 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell0:SELECT=3 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:03.791955 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-d01e68e3-4dcf-4e49-9739-ad9077c21123 tempest-VolumesNegativeTest-1917329784 tempest-VolumesNegativeTest-1917329784-project] Action: 'create', calling method: .version_select at 0x7fe725a6c4c0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-12449026", "metadata": {"Type": "work"}}} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:24:03.800036 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-d01e68e3-4dcf-4e49-9739-ad9077c21123 tempest-VolumesNegativeTest-1917329784 tempest-VolumesNegativeTest-1917329784-project] Request method failure captured: Sep 27 17:24:03.800036 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 27 17:24:03.800036 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Accept: application/json Sep 27 17:24:03.800036 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Accept-Encoding: identity Sep 27 17:24:03.800036 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Connection: close Sep 27 17:24:03.800036 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Content-Length: 120 Sep 27 17:24:03.800036 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Content-Type: application/json Sep 27 17:24:03.800036 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Host: 10.222.0.55 Sep 27 17:24:03.800036 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Openstack-System-Scope: None Sep 27 17:24:03.800036 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: User-Agent: python-urllib3/1.26.12 Sep 27 17:24:03.800036 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Auth-Token: gAAAAABjMzGyFUsqU4Xeg8KNXw25CWKUkcEbCnDcJeQZCNpTZK_n9M2kjwJ89IO4TQRuPZsCIi2IzGed3iTT1Uk_4Z73dBIjVavaOfbZVQZGe5g4eOyerMZbGdmp3RRiNUzLIogRPflgNw2OtwV2fATiCUI77pz8dcMysAMTwOYW-YC_2UF97UQ Sep 27 17:24:03.800036 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Domain-Id: None Sep 27 17:24:03.800036 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Domain-Name: None Sep 27 17:24:03.800036 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Identity-Status: Confirmed Sep 27 17:24:03.800036 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Is-Admin-Project: True Sep 27 17:24:03.800036 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Domain-Id: default Sep 27 17:24:03.800036 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Domain-Name: Default Sep 27 17:24:03.800036 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Id: 94de95e80dbc4006b100d487e0f0921c Sep 27 17:24:03.800036 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Name: tempest-VolumesNegativeTest-1917329784 Sep 27 17:24:03.800036 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Role: reader,member Sep 27 17:24:03.800036 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Roles: reader,member Sep 27 17:24:03.801854 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/94de95e80dbc4006b100d487e0f0921c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_94de95e80dbc4006b100d487e0f0921c", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/94de95e80dbc4006b100d487e0f0921c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/94de95e80dbc4006b100d487e0f0921c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 27 17:24:03.801854 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Tenant: tempest-VolumesNegativeTest-1917329784 Sep 27 17:24:03.801854 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Tenant-Id: 94de95e80dbc4006b100d487e0f0921c Sep 27 17:24:03.801854 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Tenant-Name: tempest-VolumesNegativeTest-1917329784 Sep 27 17:24:03.801854 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User: tempest-VolumesNegativeTest-1917329784-project Sep 27 17:24:03.801854 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Domain-Id: default Sep 27 17:24:03.801854 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Domain-Name: Default Sep 27 17:24:03.801854 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Id: f6525c9ecf4741f5a377126110bf6085 Sep 27 17:24:03.801854 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Name: tempest-VolumesNegativeTest-1917329784-project Sep 27 17:24:03.801854 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Sep 27 17:24:03.801854 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-12449026", "metadata": {"Type": "work"}}} Sep 27 17:24:03.801854 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: method: Sep 27 17:24:03.801854 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 27 17:24:03.802903 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-12449026', 'metadata': {'Type': 'work'}}}} Sep 27 17:24:03.802903 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 17:24:03.802903 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:24:03.802903 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 27 17:24:03.802903 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 27 17:24:03.802903 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 27 17:24:03.802903 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise error Sep 27 17:24:03.802903 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 27 17:24:03.802903 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:24:03.802903 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 27 17:24:03.802903 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 27 17:24:03.802903 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:24:03.802903 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 27 17:24:03.802903 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi '#$%' Sep 27 17:24:03.802903 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:24:03.802903 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:24:03.802903 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:24:03.802903 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:24:03.802903 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:24:03.802903 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:24:03.802903 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 17:24:03.802903 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 17:24:03.804607 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 17:24:03.804607 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 17:24:03.804607 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 17:24:03.804607 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 17:24:03.804607 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 27 17:24:03.804607 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 27 17:24:03.804607 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 27 17:24:03.804607 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 27 17:24:03.804607 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 27 17:24:03.804607 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 27 17:24:03.804607 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 27 17:24:03.804607 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:24:03.804607 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:24:03.804607 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:24:03.804607 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:24:03.804607 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:24:03.804607 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:24:03.804607 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 27 17:24:03.804607 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 27 17:24:03.806116 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 27 17:24:03.806116 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:24:03.810341 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-d01e68e3-4dcf-4e49-9739-ad9077c21123 tempest-VolumesNegativeTest-1917329784 tempest-VolumesNegativeTest-1917329784-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 17:24:03.815396 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-d01e68e3-4dcf-4e49-9739-ad9077c21123 tempest-VolumesNegativeTest-1917329784 tempest-VolumesNegativeTest-1917329784-project] 10.222.0.55 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.356307 Sep 27 17:24:03.816592 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 1/1] 10.222.0.55 () {60 vars in 1156 bytes} [Tue Sep 27 17:24:02 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1359 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 27 17:24:03.835773 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-046412d0-c96c-4b36-bc46-84351a7904f8 tempest-VolumesSnapshotsTestJSON-1830509268 tempest-VolumesSnapshotsTestJSON-1830509268-project] 10.222.0.55 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 2.940857 Sep 27 17:24:03.836650 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 1/2] 10.222.0.55 () {60 vars in 1155 bytes} [Tue Sep 27 17:24:00 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 2943 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 27 17:24:03.842857 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-6a734031-ca33-4edc-a093-06f3881d619f tempest-VolumesNegativeTest-1917329784 tempest-VolumesNegativeTest-1917329784-project] Action: 'create', calling method: .version_select at 0x7fe72593f310>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-271964541", "metadata": {"Type": "work"}}} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:24:03.861117 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-6a734031-ca33-4edc-a093-06f3881d619f tempest-VolumesNegativeTest-1917329784 tempest-VolumesNegativeTest-1917329784-project] Request method failure captured: Sep 27 17:24:03.861117 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 27 17:24:03.861117 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Accept: application/json Sep 27 17:24:03.861117 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Accept-Encoding: identity Sep 27 17:24:03.861117 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Connection: close Sep 27 17:24:03.861117 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Content-Length: 119 Sep 27 17:24:03.861117 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Content-Type: application/json Sep 27 17:24:03.861117 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Host: 10.222.0.55 Sep 27 17:24:03.861117 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Openstack-System-Scope: None Sep 27 17:24:03.861117 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: User-Agent: python-urllib3/1.26.12 Sep 27 17:24:03.861117 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Auth-Token: gAAAAABjMzGyFUsqU4Xeg8KNXw25CWKUkcEbCnDcJeQZCNpTZK_n9M2kjwJ89IO4TQRuPZsCIi2IzGed3iTT1Uk_4Z73dBIjVavaOfbZVQZGe5g4eOyerMZbGdmp3RRiNUzLIogRPflgNw2OtwV2fATiCUI77pz8dcMysAMTwOYW-YC_2UF97UQ Sep 27 17:24:03.861117 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Domain-Id: None Sep 27 17:24:03.861117 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Domain-Name: None Sep 27 17:24:03.861117 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Identity-Status: Confirmed Sep 27 17:24:03.861117 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Is-Admin-Project: True Sep 27 17:24:03.861117 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Domain-Id: default Sep 27 17:24:03.861117 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Domain-Name: Default Sep 27 17:24:03.861117 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Id: 94de95e80dbc4006b100d487e0f0921c Sep 27 17:24:03.861117 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Name: tempest-VolumesNegativeTest-1917329784 Sep 27 17:24:03.861117 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Role: reader,member Sep 27 17:24:03.861117 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Roles: reader,member Sep 27 17:24:03.862628 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/94de95e80dbc4006b100d487e0f0921c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_94de95e80dbc4006b100d487e0f0921c", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/94de95e80dbc4006b100d487e0f0921c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/94de95e80dbc4006b100d487e0f0921c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 27 17:24:03.862628 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Tenant: tempest-VolumesNegativeTest-1917329784 Sep 27 17:24:03.862628 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Tenant-Id: 94de95e80dbc4006b100d487e0f0921c Sep 27 17:24:03.862628 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Tenant-Name: tempest-VolumesNegativeTest-1917329784 Sep 27 17:24:03.862628 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User: tempest-VolumesNegativeTest-1917329784-project Sep 27 17:24:03.862628 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Domain-Id: default Sep 27 17:24:03.862628 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Domain-Name: Default Sep 27 17:24:03.862628 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Id: f6525c9ecf4741f5a377126110bf6085 Sep 27 17:24:03.862628 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Name: tempest-VolumesNegativeTest-1917329784-project Sep 27 17:24:03.862628 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Sep 27 17:24:03.862628 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-271964541", "metadata": {"Type": "work"}}} Sep 27 17:24:03.862628 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: method: Sep 27 17:24:03.862628 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 27 17:24:03.863658 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-271964541', 'metadata': {'Type': 'work'}}}} Sep 27 17:24:03.863658 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 17:24:03.863658 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:24:03.863658 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 27 17:24:03.863658 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 27 17:24:03.863658 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 27 17:24:03.863658 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise error Sep 27 17:24:03.863658 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 27 17:24:03.863658 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:24:03.863658 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 27 17:24:03.863658 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 27 17:24:03.863658 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:24:03.863658 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 27 17:24:03.863658 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi '0' Sep 27 17:24:03.863658 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:24:03.863658 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:24:03.863658 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:24:03.863658 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:24:03.863658 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:24:03.863658 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:24:03.863658 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 17:24:03.863658 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 17:24:03.865108 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 17:24:03.865108 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 17:24:03.865108 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 17:24:03.865108 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 17:24:03.865108 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 27 17:24:03.865108 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 27 17:24:03.865108 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 27 17:24:03.865108 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 27 17:24:03.865108 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 27 17:24:03.865108 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 27 17:24:03.865108 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 27 17:24:03.865108 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:24:03.865108 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:24:03.865108 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:24:03.865108 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:24:03.865108 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:24:03.865108 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:24:03.865108 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 27 17:24:03.865108 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 27 17:24:03.866347 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 27 17:24:03.866347 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:24:03.866347 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-6a734031-ca33-4edc-a093-06f3881d619f tempest-VolumesNegativeTest-1917329784 tempest-VolumesNegativeTest-1917329784-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120416) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 17:24:03.866347 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-6a734031-ca33-4edc-a093-06f3881d619f tempest-VolumesNegativeTest-1917329784 tempest-VolumesNegativeTest-1917329784-project] 10.222.0.55 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.026513 Sep 27 17:24:03.868272 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 2/3] 10.222.0.55 () {60 vars in 1156 bytes} [Tue Sep 27 17:24:03 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 27 17:24:03.880052 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-b01a5886-8ba7-4203-87c1-f1b32926403b tempest-VolumesSnapshotsTestJSON-1830509268 tempest-VolumesSnapshotsTestJSON-1830509268-project] Calling method '.version_select at 0x7fe7258d2e50>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:04.059635 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-b01a5886-8ba7-4203-87c1-f1b32926403b tempest-VolumesSnapshotsTestJSON-1830509268 tempest-VolumesSnapshotsTestJSON-1830509268-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/bbfe84f8-0d43-445f-9fc6-69b3d4afb003" status: 200 len: 345 microversion: 2.1 time: 0.187016 Sep 27 17:24:04.068141 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 3/4] 10.222.0.55 () {58 vars in 1245 bytes} [Tue Sep 27 17:24:03 2022] GET /compute/v2.1/os-volumes/bbfe84f8-0d43-445f-9fc6-69b3d4afb003 => generated 345 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:24:04.068141 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-6b8d9190-decc-48f1-b60c-da3f9079c211 tempest-VolumesNegativeTest-1917329784 tempest-VolumesNegativeTest-1917329784-project] Action: 'create', calling method: .version_select at 0x7fe7258d29d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1044849314", "metadata": {"Type": "work"}}} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:24:04.075470 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-6b8d9190-decc-48f1-b60c-da3f9079c211 tempest-VolumesNegativeTest-1917329784 tempest-VolumesNegativeTest-1917329784-project] Request method failure captured: Sep 27 17:24:04.075470 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 27 17:24:04.075470 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Accept: application/json Sep 27 17:24:04.075470 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Accept-Encoding: identity Sep 27 17:24:04.075470 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Connection: close Sep 27 17:24:04.075470 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Content-Length: 119 Sep 27 17:24:04.075470 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Content-Type: application/json Sep 27 17:24:04.075470 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Host: 10.222.0.55 Sep 27 17:24:04.075470 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Openstack-System-Scope: None Sep 27 17:24:04.075470 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: User-Agent: python-urllib3/1.26.12 Sep 27 17:24:04.075470 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Auth-Token: gAAAAABjMzGyFUsqU4Xeg8KNXw25CWKUkcEbCnDcJeQZCNpTZK_n9M2kjwJ89IO4TQRuPZsCIi2IzGed3iTT1Uk_4Z73dBIjVavaOfbZVQZGe5g4eOyerMZbGdmp3RRiNUzLIogRPflgNw2OtwV2fATiCUI77pz8dcMysAMTwOYW-YC_2UF97UQ Sep 27 17:24:04.075470 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Domain-Id: None Sep 27 17:24:04.075470 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Domain-Name: None Sep 27 17:24:04.075470 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Identity-Status: Confirmed Sep 27 17:24:04.075470 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Is-Admin-Project: True Sep 27 17:24:04.075470 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Domain-Id: default Sep 27 17:24:04.075470 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Domain-Name: Default Sep 27 17:24:04.075470 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Id: 94de95e80dbc4006b100d487e0f0921c Sep 27 17:24:04.075470 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Name: tempest-VolumesNegativeTest-1917329784 Sep 27 17:24:04.075470 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Role: reader,member Sep 27 17:24:04.075470 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Roles: reader,member Sep 27 17:24:04.076921 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/94de95e80dbc4006b100d487e0f0921c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_94de95e80dbc4006b100d487e0f0921c", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/94de95e80dbc4006b100d487e0f0921c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/94de95e80dbc4006b100d487e0f0921c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 27 17:24:04.076921 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Tenant: tempest-VolumesNegativeTest-1917329784 Sep 27 17:24:04.076921 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Tenant-Id: 94de95e80dbc4006b100d487e0f0921c Sep 27 17:24:04.076921 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Tenant-Name: tempest-VolumesNegativeTest-1917329784 Sep 27 17:24:04.076921 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User: tempest-VolumesNegativeTest-1917329784-project Sep 27 17:24:04.076921 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Domain-Id: default Sep 27 17:24:04.076921 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Domain-Name: Default Sep 27 17:24:04.076921 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Id: f6525c9ecf4741f5a377126110bf6085 Sep 27 17:24:04.076921 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Name: tempest-VolumesNegativeTest-1917329784-project Sep 27 17:24:04.076921 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Sep 27 17:24:04.076921 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1044849314", "metadata": {"Type": "work"}}} Sep 27 17:24:04.076921 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: method: Sep 27 17:24:04.076921 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 27 17:24:04.077766 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1044849314', 'metadata': {'Type': 'work'}}}} Sep 27 17:24:04.077766 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 17:24:04.077766 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:24:04.077766 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 27 17:24:04.077766 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 27 17:24:04.077766 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 27 17:24:04.077766 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise error Sep 27 17:24:04.077766 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 27 17:24:04.077766 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:24:04.077766 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 27 17:24:04.077766 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 27 17:24:04.077766 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:24:04.077766 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 27 17:24:04.077766 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi '' Sep 27 17:24:04.077766 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:24:04.077766 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:24:04.077766 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:24:04.077766 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:24:04.077766 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:24:04.077766 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:24:04.077766 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 17:24:04.077766 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 17:24:04.079361 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 17:24:04.079361 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 17:24:04.079361 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 17:24:04.079361 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 17:24:04.079361 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 27 17:24:04.079361 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 27 17:24:04.079361 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 27 17:24:04.079361 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 27 17:24:04.079361 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 27 17:24:04.079361 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 27 17:24:04.079361 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 27 17:24:04.079361 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:24:04.079361 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:24:04.079361 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:24:04.079361 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:24:04.079361 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:24:04.079361 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:24:04.079361 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 27 17:24:04.079361 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 27 17:24:04.080982 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 27 17:24:04.080982 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:24:04.080982 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-6b8d9190-decc-48f1-b60c-da3f9079c211 tempest-VolumesNegativeTest-1917329784 tempest-VolumesNegativeTest-1917329784-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120416) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 17:24:04.080982 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-6b8d9190-decc-48f1-b60c-da3f9079c211 tempest-VolumesNegativeTest-1917329784 tempest-VolumesNegativeTest-1917329784-project] 10.222.0.55 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.015169 Sep 27 17:24:04.082123 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 4/5] 10.222.0.55 () {60 vars in 1156 bytes} [Tue Sep 27 17:24:04 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 27 17:24:04.097590 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-bb5f85de-7452-4dfb-a6dc-e335ea3b5999 tempest-VolumesNegativeTest-1917329784 tempest-VolumesNegativeTest-1917329784-project] Calling method '.version_select at 0x7fe72593f4c0>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:04.156130 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.wsgi [None req-bb5f85de-7452-4dfb-a6dc-e335ea3b5999 tempest-VolumesNegativeTest-1917329784 tempest-VolumesNegativeTest-1917329784-project] HTTP exception thrown: Volume tempest-invalid-876045337 could not be found. Sep 27 17:24:04.162507 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-bb5f85de-7452-4dfb-a6dc-e335ea3b5999 tempest-VolumesNegativeTest-1917329784 tempest-VolumesNegativeTest-1917329784-project] Request method failure captured: Sep 27 17:24:04.162507 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-876045337 HTTP/1.1 Sep 27 17:24:04.162507 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Accept: application/json Sep 27 17:24:04.162507 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Accept-Encoding: identity Sep 27 17:24:04.162507 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Connection: close Sep 27 17:24:04.162507 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Content-Length: 0 Sep 27 17:24:04.162507 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Content-Type: application/json Sep 27 17:24:04.162507 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Host: 10.222.0.55 Sep 27 17:24:04.162507 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Openstack-System-Scope: None Sep 27 17:24:04.162507 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: User-Agent: python-urllib3/1.26.12 Sep 27 17:24:04.162507 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Auth-Token: gAAAAABjMzGyFUsqU4Xeg8KNXw25CWKUkcEbCnDcJeQZCNpTZK_n9M2kjwJ89IO4TQRuPZsCIi2IzGed3iTT1Uk_4Z73dBIjVavaOfbZVQZGe5g4eOyerMZbGdmp3RRiNUzLIogRPflgNw2OtwV2fATiCUI77pz8dcMysAMTwOYW-YC_2UF97UQ Sep 27 17:24:04.162507 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Domain-Id: None Sep 27 17:24:04.162507 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Domain-Name: None Sep 27 17:24:04.162507 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Identity-Status: Confirmed Sep 27 17:24:04.162507 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Is-Admin-Project: True Sep 27 17:24:04.162507 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Domain-Id: default Sep 27 17:24:04.162507 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Domain-Name: Default Sep 27 17:24:04.162507 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Id: 94de95e80dbc4006b100d487e0f0921c Sep 27 17:24:04.162507 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Name: tempest-VolumesNegativeTest-1917329784 Sep 27 17:24:04.162507 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Role: reader,member Sep 27 17:24:04.162507 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Roles: reader,member Sep 27 17:24:04.163924 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/94de95e80dbc4006b100d487e0f0921c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_94de95e80dbc4006b100d487e0f0921c", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/94de95e80dbc4006b100d487e0f0921c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/94de95e80dbc4006b100d487e0f0921c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 27 17:24:04.163924 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Tenant: tempest-VolumesNegativeTest-1917329784 Sep 27 17:24:04.163924 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Tenant-Id: 94de95e80dbc4006b100d487e0f0921c Sep 27 17:24:04.163924 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Tenant-Name: tempest-VolumesNegativeTest-1917329784 Sep 27 17:24:04.163924 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User: tempest-VolumesNegativeTest-1917329784-project Sep 27 17:24:04.163924 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Domain-Id: default Sep 27 17:24:04.163924 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Domain-Name: Default Sep 27 17:24:04.163924 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Id: f6525c9ecf4741f5a377126110bf6085 Sep 27 17:24:04.163924 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Name: tempest-VolumesNegativeTest-1917329784-project Sep 27 17:24:04.163924 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: method: Sep 27 17:24:04.163924 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: exception: Volume tempest-invalid-876045337 could not be found. Sep 27 17:24:04.163924 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: action_args: {'id': 'tempest-invalid-876045337'} Sep 27 17:24:04.163924 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 17:24:04.164811 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:24:04.164811 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 27 17:24:04.164811 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 27 17:24:04.164811 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 27 17:24:04.164811 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 27 17:24:04.164811 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 27 17:24:04.164811 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 27 17:24:04.164811 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 27 17:24:04.164811 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 27 17:24:04.164811 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 27 17:24:04.164811 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 27 17:24:04.164811 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 27 17:24:04.164811 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 27 17:24:04.164811 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 27 17:24:04.164811 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 27 17:24:04.164811 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-876045337 could not be found. (HTTP 404) (Request-ID: req-01da86bd-a34d-4422-a7fe-4042496e5234) Sep 27 17:24:04.164811 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:24:04.164811 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:24:04.164811 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:24:04.167516 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:24:04.167516 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 27 17:24:04.167516 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 27 17:24:04.167516 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 27 17:24:04.167516 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 27 17:24:04.167516 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 27 17:24:04.167516 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 27 17:24:04.167516 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 27 17:24:04.167516 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 27 17:24:04.167516 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 27 17:24:04.167516 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 27 17:24:04.167516 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 27 17:24:04.167516 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 27 17:24:04.167516 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 27 17:24:04.167516 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 27 17:24:04.167516 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 27 17:24:04.167516 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 27 17:24:04.167516 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 27 17:24:04.167516 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 27 17:24:04.170442 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 27 17:24:04.170442 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 27 17:24:04.170442 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 27 17:24:04.170442 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 27 17:24:04.170442 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-876045337 could not be found. Sep 27 17:24:04.170442 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:24:04.170442 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:24:04.170442 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:24:04.170442 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:24:04.170442 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:24:04.170442 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:24:04.170442 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 17:24:04.170442 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 17:24:04.170442 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 17:24:04.170442 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 17:24:04.170442 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 17:24:04.170442 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 17:24:04.170442 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 27 17:24:04.170442 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 17:24:04.170442 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-876045337 could not be found. Sep 27 17:24:04.174906 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:24:04.174906 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:24:04.174906 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:24:04.174906 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:24:04.174906 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:24:04.174906 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:24:04.174906 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 17:24:04.174906 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 17:24:04.174906 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-876045337 could not be found. Sep 27 17:24:04.174906 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:24:04.177454 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-bb5f85de-7452-4dfb-a6dc-e335ea3b5999 tempest-VolumesNegativeTest-1917329784 tempest-VolumesNegativeTest-1917329784-project] Returning 404 to user: Volume tempest-invalid-876045337 could not be found. {{(pid=120416) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 17:24:04.178970 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-bb5f85de-7452-4dfb-a6dc-e335ea3b5999 tempest-VolumesNegativeTest-1917329784 tempest-VolumesNegativeTest-1917329784-project] 10.222.0.55 "DELETE /compute/v2.1/os-volumes/tempest-invalid-876045337" status: 404 len: 98 microversion: 2.1 time: 0.093296 Sep 27 17:24:04.180226 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 5/6] 10.222.0.55 () {58 vars in 1215 bytes} [Tue Sep 27 17:24:04 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-876045337 => generated 98 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 27 17:24:04.202395 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-2bb2fa10-74da-4898-a3d1-da548dadf92d tempest-VolumesNegativeTest-1917329784 tempest-VolumesNegativeTest-1917329784-project] 10.222.0.55 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.008633 Sep 27 17:24:04.206384 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 6/7] 10.222.0.55 () {58 vars in 1140 bytes} [Tue Sep 27 17:24:04 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 14 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 27 17:24:04.237169 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-9cf5a962-2124-4d47-aa26-5cb71a390dc8 tempest-VolumesNegativeTest-1917329784 tempest-VolumesNegativeTest-1917329784-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.027507 Sep 27 17:24:04.238435 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 7/8] 10.222.0.55 () {58 vars in 1137 bytes} [Tue Sep 27 17:24:04 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 30 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 27 17:24:04.259006 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-15a0e616-9e96-4017-976b-badd7bfe7fc4 tempest-VolumesNegativeTest-1917329784 tempest-VolumesNegativeTest-1917329784-project] Calling method '.version_select at 0x7fe7258984c0>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:04.396751 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-92dc38fa-333d-435d-89df-0581f1b5df2d tempest-VolumesGetTestJSON-2018272340 tempest-VolumesGetTestJSON-2018272340-project] Action: 'create', calling method: .version_select at 0x7fe725a6cdc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-991267142", "metadata": {"Type": "work"}}} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:24:04.414045 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.wsgi [None req-15a0e616-9e96-4017-976b-badd7bfe7fc4 tempest-VolumesNegativeTest-1917329784 tempest-VolumesNegativeTest-1917329784-project] HTTP exception thrown: Volume e6483611-3bdb-4124-b6fc-0c5c36edd2f9 could not be found. Sep 27 17:24:04.417419 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-15a0e616-9e96-4017-976b-badd7bfe7fc4 tempest-VolumesNegativeTest-1917329784 tempest-VolumesNegativeTest-1917329784-project] Request method failure captured: Sep 27 17:24:04.417419 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: request: DELETE /compute/v2.1/os-volumes/e6483611-3bdb-4124-b6fc-0c5c36edd2f9 HTTP/1.1 Sep 27 17:24:04.417419 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Accept: application/json Sep 27 17:24:04.417419 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Accept-Encoding: identity Sep 27 17:24:04.417419 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Connection: close Sep 27 17:24:04.417419 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Content-Length: 0 Sep 27 17:24:04.417419 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Content-Type: application/json Sep 27 17:24:04.417419 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Host: 10.222.0.55 Sep 27 17:24:04.417419 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Openstack-System-Scope: None Sep 27 17:24:04.417419 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: User-Agent: python-urllib3/1.26.12 Sep 27 17:24:04.417419 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Auth-Token: gAAAAABjMzGyFUsqU4Xeg8KNXw25CWKUkcEbCnDcJeQZCNpTZK_n9M2kjwJ89IO4TQRuPZsCIi2IzGed3iTT1Uk_4Z73dBIjVavaOfbZVQZGe5g4eOyerMZbGdmp3RRiNUzLIogRPflgNw2OtwV2fATiCUI77pz8dcMysAMTwOYW-YC_2UF97UQ Sep 27 17:24:04.417419 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Domain-Id: None Sep 27 17:24:04.417419 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Domain-Name: None Sep 27 17:24:04.417419 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Identity-Status: Confirmed Sep 27 17:24:04.417419 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Is-Admin-Project: True Sep 27 17:24:04.417419 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Domain-Id: default Sep 27 17:24:04.417419 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Domain-Name: Default Sep 27 17:24:04.417419 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Id: 94de95e80dbc4006b100d487e0f0921c Sep 27 17:24:04.417419 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Name: tempest-VolumesNegativeTest-1917329784 Sep 27 17:24:04.417419 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Role: reader,member Sep 27 17:24:04.417419 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Roles: reader,member Sep 27 17:24:04.418986 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/94de95e80dbc4006b100d487e0f0921c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_94de95e80dbc4006b100d487e0f0921c", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/94de95e80dbc4006b100d487e0f0921c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/94de95e80dbc4006b100d487e0f0921c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 27 17:24:04.418986 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Tenant: tempest-VolumesNegativeTest-1917329784 Sep 27 17:24:04.418986 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Tenant-Id: 94de95e80dbc4006b100d487e0f0921c Sep 27 17:24:04.418986 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Tenant-Name: tempest-VolumesNegativeTest-1917329784 Sep 27 17:24:04.418986 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User: tempest-VolumesNegativeTest-1917329784-project Sep 27 17:24:04.418986 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Domain-Id: default Sep 27 17:24:04.418986 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Domain-Name: Default Sep 27 17:24:04.418986 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Id: f6525c9ecf4741f5a377126110bf6085 Sep 27 17:24:04.418986 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Name: tempest-VolumesNegativeTest-1917329784-project Sep 27 17:24:04.418986 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: method: Sep 27 17:24:04.418986 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: exception: Volume e6483611-3bdb-4124-b6fc-0c5c36edd2f9 could not be found. Sep 27 17:24:04.418986 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: action_args: {'id': 'e6483611-3bdb-4124-b6fc-0c5c36edd2f9'} Sep 27 17:24:04.418986 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 17:24:04.419991 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:24:04.419991 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 27 17:24:04.419991 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 27 17:24:04.419991 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 27 17:24:04.419991 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 27 17:24:04.419991 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 27 17:24:04.419991 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 27 17:24:04.419991 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 27 17:24:04.419991 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 27 17:24:04.419991 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 27 17:24:04.419991 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 27 17:24:04.419991 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 27 17:24:04.419991 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 27 17:24:04.419991 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 27 17:24:04.419991 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 27 17:24:04.419991 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e6483611-3bdb-4124-b6fc-0c5c36edd2f9 could not be found. (HTTP 404) (Request-ID: req-33bb160e-95d7-45a2-a035-cf536fcd2d60) Sep 27 17:24:04.419991 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:24:04.419991 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:24:04.419991 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:24:04.425432 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:24:04.425432 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 27 17:24:04.425432 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 27 17:24:04.425432 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 27 17:24:04.425432 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 27 17:24:04.425432 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 27 17:24:04.425432 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 27 17:24:04.425432 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 27 17:24:04.425432 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 27 17:24:04.425432 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 27 17:24:04.425432 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 27 17:24:04.425432 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 27 17:24:04.425432 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 27 17:24:04.425432 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 27 17:24:04.425432 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 27 17:24:04.425432 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 27 17:24:04.425432 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 27 17:24:04.425432 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 27 17:24:04.425432 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 27 17:24:04.427097 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 27 17:24:04.427097 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 27 17:24:04.427097 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 27 17:24:04.427097 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 27 17:24:04.427097 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e6483611-3bdb-4124-b6fc-0c5c36edd2f9 could not be found. Sep 27 17:24:04.427097 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:24:04.427097 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:24:04.427097 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:24:04.427097 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:24:04.427097 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:24:04.427097 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:24:04.427097 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 17:24:04.427097 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 17:24:04.427097 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 17:24:04.427097 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 17:24:04.427097 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 17:24:04.427097 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 17:24:04.427097 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 27 17:24:04.427097 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 17:24:04.429337 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e6483611-3bdb-4124-b6fc-0c5c36edd2f9 could not be found. Sep 27 17:24:04.429337 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:24:04.429337 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:24:04.429337 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:24:04.429337 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:24:04.429337 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:24:04.429337 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:24:04.429337 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 17:24:04.429337 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 17:24:04.429337 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e6483611-3bdb-4124-b6fc-0c5c36edd2f9 could not be found. Sep 27 17:24:04.429337 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:24:04.429337 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-15a0e616-9e96-4017-976b-badd7bfe7fc4 tempest-VolumesNegativeTest-1917329784 tempest-VolumesNegativeTest-1917329784-project] Returning 404 to user: Volume e6483611-3bdb-4124-b6fc-0c5c36edd2f9 could not be found. {{(pid=120416) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 17:24:04.429337 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-15a0e616-9e96-4017-976b-badd7bfe7fc4 tempest-VolumesNegativeTest-1917329784 tempest-VolumesNegativeTest-1917329784-project] 10.222.0.55 "DELETE /compute/v2.1/os-volumes/e6483611-3bdb-4124-b6fc-0c5c36edd2f9" status: 404 len: 109 microversion: 2.1 time: 0.174880 Sep 27 17:24:04.429337 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 8/9] 10.222.0.55 () {58 vars in 1248 bytes} [Tue Sep 27 17:24:04 2022] DELETE /compute/v2.1/os-volumes/e6483611-3bdb-4124-b6fc-0c5c36edd2f9 => generated 109 bytes in 177 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 27 17:24:04.443217 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-6733120a-6a91-48e6-940b-5c56f1256218 tempest-VolumesNegativeTest-1917329784 tempest-VolumesNegativeTest-1917329784-project] Calling method '.version_select at 0x7fe7258d2790>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:04.530739 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.wsgi [None req-6733120a-6a91-48e6-940b-5c56f1256218 tempest-VolumesNegativeTest-1917329784 tempest-VolumesNegativeTest-1917329784-project] HTTP exception thrown: Volume b86f7633-7dea-46b4-a4a2-8590959afea8 could not be found. Sep 27 17:24:04.534881 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-6733120a-6a91-48e6-940b-5c56f1256218 tempest-VolumesNegativeTest-1917329784 tempest-VolumesNegativeTest-1917329784-project] Request method failure captured: Sep 27 17:24:04.534881 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: request: GET /compute/v2.1/os-volumes/b86f7633-7dea-46b4-a4a2-8590959afea8 HTTP/1.1 Sep 27 17:24:04.534881 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Accept: application/json Sep 27 17:24:04.534881 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Accept-Encoding: identity Sep 27 17:24:04.534881 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Connection: close Sep 27 17:24:04.534881 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Content-Length: 0 Sep 27 17:24:04.534881 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Content-Type: application/json Sep 27 17:24:04.534881 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Host: 10.222.0.55 Sep 27 17:24:04.534881 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Openstack-System-Scope: None Sep 27 17:24:04.534881 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: User-Agent: python-urllib3/1.26.12 Sep 27 17:24:04.534881 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Auth-Token: gAAAAABjMzGyFUsqU4Xeg8KNXw25CWKUkcEbCnDcJeQZCNpTZK_n9M2kjwJ89IO4TQRuPZsCIi2IzGed3iTT1Uk_4Z73dBIjVavaOfbZVQZGe5g4eOyerMZbGdmp3RRiNUzLIogRPflgNw2OtwV2fATiCUI77pz8dcMysAMTwOYW-YC_2UF97UQ Sep 27 17:24:04.534881 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Domain-Id: None Sep 27 17:24:04.534881 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Domain-Name: None Sep 27 17:24:04.534881 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Identity-Status: Confirmed Sep 27 17:24:04.534881 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Is-Admin-Project: True Sep 27 17:24:04.534881 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Domain-Id: default Sep 27 17:24:04.534881 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Domain-Name: Default Sep 27 17:24:04.534881 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Id: 94de95e80dbc4006b100d487e0f0921c Sep 27 17:24:04.534881 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Name: tempest-VolumesNegativeTest-1917329784 Sep 27 17:24:04.534881 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Role: reader,member Sep 27 17:24:04.534881 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Roles: reader,member Sep 27 17:24:04.536511 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/94de95e80dbc4006b100d487e0f0921c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_94de95e80dbc4006b100d487e0f0921c", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/94de95e80dbc4006b100d487e0f0921c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/94de95e80dbc4006b100d487e0f0921c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 27 17:24:04.536511 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Tenant: tempest-VolumesNegativeTest-1917329784 Sep 27 17:24:04.536511 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Tenant-Id: 94de95e80dbc4006b100d487e0f0921c Sep 27 17:24:04.536511 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Tenant-Name: tempest-VolumesNegativeTest-1917329784 Sep 27 17:24:04.536511 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User: tempest-VolumesNegativeTest-1917329784-project Sep 27 17:24:04.536511 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Domain-Id: default Sep 27 17:24:04.536511 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Domain-Name: Default Sep 27 17:24:04.536511 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Id: f6525c9ecf4741f5a377126110bf6085 Sep 27 17:24:04.536511 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Name: tempest-VolumesNegativeTest-1917329784-project Sep 27 17:24:04.536511 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: method: Sep 27 17:24:04.536511 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: exception: Volume b86f7633-7dea-46b4-a4a2-8590959afea8 could not be found. Sep 27 17:24:04.536511 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: action_args: {'id': 'b86f7633-7dea-46b4-a4a2-8590959afea8'} Sep 27 17:24:04.536511 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 17:24:04.537666 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:24:04.537666 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 27 17:24:04.537666 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 27 17:24:04.537666 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 27 17:24:04.537666 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 27 17:24:04.537666 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 27 17:24:04.537666 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 27 17:24:04.537666 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 27 17:24:04.537666 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 27 17:24:04.537666 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 27 17:24:04.537666 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 27 17:24:04.537666 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 27 17:24:04.537666 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 27 17:24:04.537666 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 27 17:24:04.537666 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 27 17:24:04.537666 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b86f7633-7dea-46b4-a4a2-8590959afea8 could not be found. (HTTP 404) (Request-ID: req-6bf4ba60-5bb7-44de-b3ce-aeb9c6ff0f0d) Sep 27 17:24:04.537666 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:24:04.537666 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:24:04.537666 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:24:04.539140 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:24:04.539140 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 27 17:24:04.539140 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 27 17:24:04.539140 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 27 17:24:04.539140 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 27 17:24:04.539140 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 27 17:24:04.539140 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 27 17:24:04.539140 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 27 17:24:04.539140 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 27 17:24:04.539140 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 27 17:24:04.539140 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 27 17:24:04.539140 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 27 17:24:04.539140 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 27 17:24:04.539140 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 27 17:24:04.539140 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 27 17:24:04.539140 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 27 17:24:04.539140 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 27 17:24:04.539140 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 27 17:24:04.539140 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 27 17:24:04.540580 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 27 17:24:04.540580 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 27 17:24:04.540580 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 27 17:24:04.540580 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 27 17:24:04.540580 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b86f7633-7dea-46b4-a4a2-8590959afea8 could not be found. Sep 27 17:24:04.540580 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:24:04.540580 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:24:04.540580 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:24:04.540580 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:24:04.540580 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:24:04.540580 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:24:04.540580 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 17:24:04.540580 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 17:24:04.540580 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 17:24:04.540580 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 17:24:04.540580 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 17:24:04.540580 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 17:24:04.540580 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 27 17:24:04.540580 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 17:24:04.541911 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b86f7633-7dea-46b4-a4a2-8590959afea8 could not be found. Sep 27 17:24:04.541911 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:24:04.541911 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:24:04.541911 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:24:04.541911 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:24:04.541911 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:24:04.541911 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:24:04.541911 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 17:24:04.541911 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 17:24:04.541911 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b86f7633-7dea-46b4-a4a2-8590959afea8 could not be found. Sep 27 17:24:04.541911 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:24:04.549060 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-6733120a-6a91-48e6-940b-5c56f1256218 tempest-VolumesNegativeTest-1917329784 tempest-VolumesNegativeTest-1917329784-project] Returning 404 to user: Volume b86f7633-7dea-46b4-a4a2-8590959afea8 could not be found. {{(pid=120416) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 17:24:04.551332 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-6733120a-6a91-48e6-940b-5c56f1256218 tempest-VolumesNegativeTest-1917329784 tempest-VolumesNegativeTest-1917329784-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/b86f7633-7dea-46b4-a4a2-8590959afea8" status: 404 len: 109 microversion: 2.1 time: 0.124254 Sep 27 17:24:04.552064 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 9/10] 10.222.0.55 () {58 vars in 1245 bytes} [Tue Sep 27 17:24:04 2022] GET /compute/v2.1/os-volumes/b86f7633-7dea-46b4-a4a2-8590959afea8 => generated 109 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 27 17:24:05.077565 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-607185a9-cfb4-4da6-9518-c5148d7c920a tempest-VolumesSnapshotsTestJSON-1830509268 tempest-VolumesSnapshotsTestJSON-1830509268-project] Calling method '.version_select at 0x7fe725898670>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:05.237647 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-607185a9-cfb4-4da6-9518-c5148d7c920a tempest-VolumesSnapshotsTestJSON-1830509268 tempest-VolumesSnapshotsTestJSON-1830509268-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/bbfe84f8-0d43-445f-9fc6-69b3d4afb003" status: 200 len: 346 microversion: 2.1 time: 0.165589 Sep 27 17:24:05.239527 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 10/11] 10.222.0.55 () {58 vars in 1245 bytes} [Tue Sep 27 17:24:05 2022] GET /compute/v2.1/os-volumes/bbfe84f8-0d43-445f-9fc6-69b3d4afb003 => generated 346 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:24:05.255515 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-5436084a-064d-4523-a715-c42c9f927c17 tempest-VolumesSnapshotsTestJSON-1830509268 tempest-VolumesSnapshotsTestJSON-1830509268-project] Action: 'create', calling method: .version_select at 0x7fe725898e50>, body: {"snapshot": {"volume_id": "bbfe84f8-0d43-445f-9fc6-69b3d4afb003", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1327765881"}} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:24:06.023116 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-5436084a-064d-4523-a715-c42c9f927c17 tempest-VolumesSnapshotsTestJSON-1830509268 tempest-VolumesSnapshotsTestJSON-1830509268-project] 10.222.0.55 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.774287 Sep 27 17:24:06.024114 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 11/12] 10.222.0.55 () {60 vars in 1162 bytes} [Tue Sep 27 17:24:05 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:24:06.041014 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-b6031234-ef96-4ee7-b544-3d48a15e70b3 tempest-VolumesSnapshotsTestJSON-1830509268 tempest-VolumesSnapshotsTestJSON-1830509268-project] Calling method '.version_select at 0x7fe72593f790>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:06.129605 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-b6031234-ef96-4ee7-b544-3d48a15e70b3 tempest-VolumesSnapshotsTestJSON-1830509268 tempest-VolumesSnapshotsTestJSON-1830509268-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/2ee40e31-e5c5-41dd-bfdb-2279c3186f85" status: 200 len: 287 microversion: 2.1 time: 0.097543 Sep 27 17:24:06.130190 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 12/13] 10.222.0.55 () {58 vars in 1251 bytes} [Tue Sep 27 17:24:06 2022] GET /compute/v2.1/os-snapshots/2ee40e31-e5c5-41dd-bfdb-2279c3186f85 => generated 287 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 17:24:06.141937 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-2d0066a1-9e42-400d-a4b1-f86aaf396b17 tempest-VolumesSnapshotsTestJSON-1830509268 tempest-VolumesSnapshotsTestJSON-1830509268-project] Calling method '.version_select at 0x7fe7258d2820>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:06.312502 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-2d0066a1-9e42-400d-a4b1-f86aaf396b17 tempest-VolumesSnapshotsTestJSON-1830509268 tempest-VolumesSnapshotsTestJSON-1830509268-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.174398 Sep 27 17:24:06.313059 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 13/14] 10.222.0.55 () {58 vars in 1140 bytes} [Tue Sep 27 17:24:06 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:24:06.330771 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-8dfc4cd8-b731-45e4-bc54-c9f8e92e1362 tempest-VolumesSnapshotsTestJSON-1830509268 tempest-VolumesSnapshotsTestJSON-1830509268-project] Calling method '.version_select at 0x7fe725867280>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:06.533449 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-8dfc4cd8-b731-45e4-bc54-c9f8e92e1362 tempest-VolumesSnapshotsTestJSON-1830509268 tempest-VolumesSnapshotsTestJSON-1830509268-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/2ee40e31-e5c5-41dd-bfdb-2279c3186f85" status: 200 len: 287 microversion: 2.1 time: 0.210835 Sep 27 17:24:06.534001 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 14/15] 10.222.0.55 () {58 vars in 1251 bytes} [Tue Sep 27 17:24:06 2022] GET /compute/v2.1/os-snapshots/2ee40e31-e5c5-41dd-bfdb-2279c3186f85 => generated 287 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:24:06.632102 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-92dc38fa-333d-435d-89df-0581f1b5df2d tempest-VolumesGetTestJSON-2018272340 tempest-VolumesGetTestJSON-2018272340-project] 10.222.0.55 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 2.813047 Sep 27 17:24:06.649400 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 2/16] 10.222.0.55 () {60 vars in 1156 bytes} [Tue Sep 27 17:24:03 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 2832 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 27 17:24:06.650428 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-3e8ca084-424d-4dd8-a942-6f7b4966c425 tempest-VolumesGetTestJSON-2018272340 tempest-VolumesGetTestJSON-2018272340-project] Calling method '.version_select at 0x7fe72586a670>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:06.799911 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-3e8ca084-424d-4dd8-a942-6f7b4966c425 tempest-VolumesGetTestJSON-2018272340 tempest-VolumesGetTestJSON-2018272340-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/daf66e41-e3c0-402e-b915-54a725b3945e" status: 200 len: 352 microversion: 2.1 time: 0.152347 Sep 27 17:24:06.812009 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 15/17] 10.222.0.55 () {58 vars in 1245 bytes} [Tue Sep 27 17:24:06 2022] GET /compute/v2.1/os-volumes/daf66e41-e3c0-402e-b915-54a725b3945e => generated 352 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:24:07.555811 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-c74600e6-27fe-4884-84a2-8dc7e0a124a2 tempest-VolumesSnapshotsTestJSON-1830509268 tempest-VolumesSnapshotsTestJSON-1830509268-project] Calling method '.version_select at 0x7fe7258fe940>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:07.651703 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-c74600e6-27fe-4884-84a2-8dc7e0a124a2 tempest-VolumesSnapshotsTestJSON-1830509268 tempest-VolumesSnapshotsTestJSON-1830509268-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/2ee40e31-e5c5-41dd-bfdb-2279c3186f85" status: 200 len: 287 microversion: 2.1 time: 0.108748 Sep 27 17:24:07.659196 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 3/18] 10.222.0.55 () {58 vars in 1251 bytes} [Tue Sep 27 17:24:07 2022] GET /compute/v2.1/os-snapshots/2ee40e31-e5c5-41dd-bfdb-2279c3186f85 => generated 287 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:24:07.827791 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-7022c1cc-299c-46a7-92e9-c8a1b6e1c3e1 tempest-VolumesGetTestJSON-2018272340 tempest-VolumesGetTestJSON-2018272340-project] Calling method '.version_select at 0x7fe7258d21f0>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:08.023242 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-7022c1cc-299c-46a7-92e9-c8a1b6e1c3e1 tempest-VolumesGetTestJSON-2018272340 tempest-VolumesGetTestJSON-2018272340-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/daf66e41-e3c0-402e-b915-54a725b3945e" status: 200 len: 352 microversion: 2.1 time: 0.211898 Sep 27 17:24:08.024275 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 16/19] 10.222.0.55 () {58 vars in 1245 bytes} [Tue Sep 27 17:24:07 2022] GET /compute/v2.1/os-volumes/daf66e41-e3c0-402e-b915-54a725b3945e => generated 352 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:24:08.667973 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-50bcf7bf-09df-4287-bbad-3d77a7f85b14 tempest-VolumesSnapshotsTestJSON-1830509268 tempest-VolumesSnapshotsTestJSON-1830509268-project] Calling method '.version_select at 0x7fe7259110d0>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:08.867447 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-50bcf7bf-09df-4287-bbad-3d77a7f85b14 tempest-VolumesSnapshotsTestJSON-1830509268 tempest-VolumesSnapshotsTestJSON-1830509268-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/2ee40e31-e5c5-41dd-bfdb-2279c3186f85" status: 200 len: 287 microversion: 2.1 time: 0.204118 Sep 27 17:24:08.868212 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 4/20] 10.222.0.55 () {58 vars in 1251 bytes} [Tue Sep 27 17:24:08 2022] GET /compute/v2.1/os-snapshots/2ee40e31-e5c5-41dd-bfdb-2279c3186f85 => generated 287 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:24:09.039655 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-13b914eb-43e8-4ff6-9ad7-76ebc192ed9d tempest-VolumesGetTestJSON-2018272340 tempest-VolumesGetTestJSON-2018272340-project] Calling method '.version_select at 0x7fe72593fb80>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:09.184030 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-13b914eb-43e8-4ff6-9ad7-76ebc192ed9d tempest-VolumesGetTestJSON-2018272340 tempest-VolumesGetTestJSON-2018272340-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/daf66e41-e3c0-402e-b915-54a725b3945e" status: 200 len: 352 microversion: 2.1 time: 0.148826 Sep 27 17:24:09.193458 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 17/21] 10.222.0.55 () {58 vars in 1245 bytes} [Tue Sep 27 17:24:09 2022] GET /compute/v2.1/os-volumes/daf66e41-e3c0-402e-b915-54a725b3945e => generated 352 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:24:09.882450 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-e4214e10-b9bb-43e7-b9ad-12299b017231 tempest-VolumesSnapshotsTestJSON-1830509268 tempest-VolumesSnapshotsTestJSON-1830509268-project] Calling method '.version_select at 0x7fe7258feca0>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:09.963758 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-e4214e10-b9bb-43e7-b9ad-12299b017231 tempest-VolumesSnapshotsTestJSON-1830509268 tempest-VolumesSnapshotsTestJSON-1830509268-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/2ee40e31-e5c5-41dd-bfdb-2279c3186f85" status: 200 len: 287 microversion: 2.1 time: 0.086776 Sep 27 17:24:09.964813 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 5/22] 10.222.0.55 () {58 vars in 1251 bytes} [Tue Sep 27 17:24:09 2022] GET /compute/v2.1/os-snapshots/2ee40e31-e5c5-41dd-bfdb-2279c3186f85 => generated 287 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:24:10.201219 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-5166be2f-e2ef-4e10-bbde-189e398e0c52 tempest-VolumesGetTestJSON-2018272340 tempest-VolumesGetTestJSON-2018272340-project] Calling method '.version_select at 0x7fe7258988b0>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:10.342383 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-5166be2f-e2ef-4e10-bbde-189e398e0c52 tempest-VolumesGetTestJSON-2018272340 tempest-VolumesGetTestJSON-2018272340-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/daf66e41-e3c0-402e-b915-54a725b3945e" status: 200 len: 352 microversion: 2.1 time: 0.145659 Sep 27 17:24:10.343182 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 18/23] 10.222.0.55 () {58 vars in 1245 bytes} [Tue Sep 27 17:24:10 2022] GET /compute/v2.1/os-volumes/daf66e41-e3c0-402e-b915-54a725b3945e => generated 352 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:24:10.978414 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-acbe27e3-ae50-4b91-a19a-a56ed7434680 tempest-VolumesSnapshotsTestJSON-1830509268 tempest-VolumesSnapshotsTestJSON-1830509268-project] Calling method '.version_select at 0x7fe7259113a0>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:11.051807 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-acbe27e3-ae50-4b91-a19a-a56ed7434680 tempest-VolumesSnapshotsTestJSON-1830509268 tempest-VolumesSnapshotsTestJSON-1830509268-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/2ee40e31-e5c5-41dd-bfdb-2279c3186f85" status: 200 len: 287 microversion: 2.1 time: 0.078097 Sep 27 17:24:11.052571 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 6/24] 10.222.0.55 () {58 vars in 1251 bytes} [Tue Sep 27 17:24:10 2022] GET /compute/v2.1/os-snapshots/2ee40e31-e5c5-41dd-bfdb-2279c3186f85 => generated 287 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:24:11.358393 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-27314dea-18d5-4148-a301-1d03d13a4b0b tempest-VolumesGetTestJSON-2018272340 tempest-VolumesGetTestJSON-2018272340-project] Calling method '.version_select at 0x7fe72593f790>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:11.485542 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-27314dea-18d5-4148-a301-1d03d13a4b0b tempest-VolumesGetTestJSON-2018272340 tempest-VolumesGetTestJSON-2018272340-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/daf66e41-e3c0-402e-b915-54a725b3945e" status: 200 len: 352 microversion: 2.1 time: 0.132540 Sep 27 17:24:11.486175 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 19/25] 10.222.0.55 () {58 vars in 1245 bytes} [Tue Sep 27 17:24:11 2022] GET /compute/v2.1/os-volumes/daf66e41-e3c0-402e-b915-54a725b3945e => generated 352 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:24:12.065842 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-d35ac9c1-6cf0-4442-a7dd-54f2654abb14 tempest-VolumesSnapshotsTestJSON-1830509268 tempest-VolumesSnapshotsTestJSON-1830509268-project] Calling method '.version_select at 0x7fe725911820>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:12.138434 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-d35ac9c1-6cf0-4442-a7dd-54f2654abb14 tempest-VolumesSnapshotsTestJSON-1830509268 tempest-VolumesSnapshotsTestJSON-1830509268-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/2ee40e31-e5c5-41dd-bfdb-2279c3186f85" status: 200 len: 287 microversion: 2.1 time: 0.076454 Sep 27 17:24:12.143925 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 7/26] 10.222.0.55 () {58 vars in 1251 bytes} [Tue Sep 27 17:24:12 2022] GET /compute/v2.1/os-snapshots/2ee40e31-e5c5-41dd-bfdb-2279c3186f85 => generated 287 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:24:12.500899 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-061ad737-10ab-42f6-ac61-b403d19b2065 tempest-VolumesGetTestJSON-2018272340 tempest-VolumesGetTestJSON-2018272340-project] Calling method '.version_select at 0x7fe7258d2a60>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:12.678383 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-061ad737-10ab-42f6-ac61-b403d19b2065 tempest-VolumesGetTestJSON-2018272340 tempest-VolumesGetTestJSON-2018272340-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/daf66e41-e3c0-402e-b915-54a725b3945e" status: 200 len: 352 microversion: 2.1 time: 0.181816 Sep 27 17:24:12.679200 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 20/27] 10.222.0.55 () {58 vars in 1245 bytes} [Tue Sep 27 17:24:12 2022] GET /compute/v2.1/os-volumes/daf66e41-e3c0-402e-b915-54a725b3945e => generated 352 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:24:13.151767 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-62480e4c-c7cc-4802-a903-190599b144e9 tempest-VolumesSnapshotsTestJSON-1830509268 tempest-VolumesSnapshotsTestJSON-1830509268-project] Calling method '.version_select at 0x7fe725911ee0>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:13.243977 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-62480e4c-c7cc-4802-a903-190599b144e9 tempest-VolumesSnapshotsTestJSON-1830509268 tempest-VolumesSnapshotsTestJSON-1830509268-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/2ee40e31-e5c5-41dd-bfdb-2279c3186f85" status: 200 len: 288 microversion: 2.1 time: 0.096063 Sep 27 17:24:13.245098 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 8/28] 10.222.0.55 () {58 vars in 1251 bytes} [Tue Sep 27 17:24:13 2022] GET /compute/v2.1/os-snapshots/2ee40e31-e5c5-41dd-bfdb-2279c3186f85 => generated 288 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:24:13.256885 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-744d43e6-072c-446d-84bc-d2f0520dac3b tempest-VolumesSnapshotsTestJSON-1830509268 tempest-VolumesSnapshotsTestJSON-1830509268-project] Calling method '.version_select at 0x7fe72586aee0>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:13.501947 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-744d43e6-072c-446d-84bc-d2f0520dac3b tempest-VolumesSnapshotsTestJSON-1830509268 tempest-VolumesSnapshotsTestJSON-1830509268-project] 10.222.0.55 "DELETE /compute/v2.1/os-snapshots/2ee40e31-e5c5-41dd-bfdb-2279c3186f85" status: 202 len: 0 microversion: 2.1 time: 0.249565 Sep 27 17:24:13.505850 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 21/29] 10.222.0.55 () {58 vars in 1254 bytes} [Tue Sep 27 17:24:13 2022] DELETE /compute/v2.1/os-snapshots/2ee40e31-e5c5-41dd-bfdb-2279c3186f85 => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 27 17:24:13.511673 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-442e3fcf-a1c6-4f96-8cde-e01ac1a35a55 tempest-VolumesSnapshotsTestJSON-1830509268 tempest-VolumesSnapshotsTestJSON-1830509268-project] Calling method '.version_select at 0x7fe7258fe9d0>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:13.693726 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-aa22e9e4-baee-4535-a0e1-f0300ad68ffb tempest-VolumesGetTestJSON-2018272340 tempest-VolumesGetTestJSON-2018272340-project] Calling method '.version_select at 0x7fe72586a5e0>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:13.699131 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-442e3fcf-a1c6-4f96-8cde-e01ac1a35a55 tempest-VolumesSnapshotsTestJSON-1830509268 tempest-VolumesSnapshotsTestJSON-1830509268-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/2ee40e31-e5c5-41dd-bfdb-2279c3186f85" status: 200 len: 287 microversion: 2.1 time: 0.191312 Sep 27 17:24:13.704574 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 9/30] 10.222.0.55 () {58 vars in 1251 bytes} [Tue Sep 27 17:24:13 2022] GET /compute/v2.1/os-snapshots/2ee40e31-e5c5-41dd-bfdb-2279c3186f85 => generated 287 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 17:24:13.938577 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-aa22e9e4-baee-4535-a0e1-f0300ad68ffb tempest-VolumesGetTestJSON-2018272340 tempest-VolumesGetTestJSON-2018272340-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/daf66e41-e3c0-402e-b915-54a725b3945e" status: 200 len: 353 microversion: 2.1 time: 0.249016 Sep 27 17:24:13.939313 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 22/31] 10.222.0.55 () {58 vars in 1245 bytes} [Tue Sep 27 17:24:13 2022] GET /compute/v2.1/os-volumes/daf66e41-e3c0-402e-b915-54a725b3945e => generated 353 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 17:24:13.956796 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-711b2f2e-015a-4127-92ac-38013a1c746e tempest-VolumesGetTestJSON-2018272340 tempest-VolumesGetTestJSON-2018272340-project] Calling method '.version_select at 0x7fe725911dc0>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:14.114321 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-711b2f2e-015a-4127-92ac-38013a1c746e tempest-VolumesGetTestJSON-2018272340 tempest-VolumesGetTestJSON-2018272340-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/daf66e41-e3c0-402e-b915-54a725b3945e" status: 200 len: 353 microversion: 2.1 time: 0.161163 Sep 27 17:24:14.127094 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 10/32] 10.222.0.55 () {58 vars in 1245 bytes} [Tue Sep 27 17:24:13 2022] GET /compute/v2.1/os-volumes/daf66e41-e3c0-402e-b915-54a725b3945e => generated 353 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:24:14.136517 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-75769293-0fad-4fd7-98bf-6e3226d4182d tempest-VolumesGetTestJSON-2018272340 tempest-VolumesGetTestJSON-2018272340-project] Calling method '.version_select at 0x7fe72586aca0>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:14.379410 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-75769293-0fad-4fd7-98bf-6e3226d4182d tempest-VolumesGetTestJSON-2018272340 tempest-VolumesGetTestJSON-2018272340-project] 10.222.0.55 "DELETE /compute/v2.1/os-volumes/daf66e41-e3c0-402e-b915-54a725b3945e" status: 202 len: 0 microversion: 2.1 time: 0.246731 Sep 27 17:24:14.380241 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 23/33] 10.222.0.55 () {58 vars in 1248 bytes} [Tue Sep 27 17:24:14 2022] DELETE /compute/v2.1/os-volumes/daf66e41-e3c0-402e-b915-54a725b3945e => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 27 17:24:14.388220 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-9a13e029-932f-46cd-9cd0-24d2c952fea7 tempest-VolumesGetTestJSON-2018272340 tempest-VolumesGetTestJSON-2018272340-project] Calling method '.version_select at 0x7fe725911700>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:14.541062 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-9a13e029-932f-46cd-9cd0-24d2c952fea7 tempest-VolumesGetTestJSON-2018272340 tempest-VolumesGetTestJSON-2018272340-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/daf66e41-e3c0-402e-b915-54a725b3945e" status: 200 len: 352 microversion: 2.1 time: 0.156429 Sep 27 17:24:14.542373 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 11/34] 10.222.0.55 () {58 vars in 1245 bytes} [Tue Sep 27 17:24:14 2022] GET /compute/v2.1/os-volumes/daf66e41-e3c0-402e-b915-54a725b3945e => generated 352 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:24:14.712375 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-4a4f0994-e76c-497b-8b42-d73cfa3e44e4 tempest-VolumesSnapshotsTestJSON-1830509268 tempest-VolumesSnapshotsTestJSON-1830509268-project] Calling method '.version_select at 0x7fe7258d21f0>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:14.772814 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.wsgi [None req-4a4f0994-e76c-497b-8b42-d73cfa3e44e4 tempest-VolumesSnapshotsTestJSON-1830509268 tempest-VolumesSnapshotsTestJSON-1830509268-project] HTTP exception thrown: Snapshot 2ee40e31-e5c5-41dd-bfdb-2279c3186f85 could not be found. Sep 27 17:24:14.776353 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-4a4f0994-e76c-497b-8b42-d73cfa3e44e4 tempest-VolumesSnapshotsTestJSON-1830509268 tempest-VolumesSnapshotsTestJSON-1830509268-project] Request method failure captured: Sep 27 17:24:14.776353 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: request: GET /compute/v2.1/os-snapshots/2ee40e31-e5c5-41dd-bfdb-2279c3186f85 HTTP/1.1 Sep 27 17:24:14.776353 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Accept: application/json Sep 27 17:24:14.776353 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Accept-Encoding: identity Sep 27 17:24:14.776353 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Connection: close Sep 27 17:24:14.776353 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Content-Length: 0 Sep 27 17:24:14.776353 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Content-Type: application/json Sep 27 17:24:14.776353 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Host: 10.222.0.55 Sep 27 17:24:14.776353 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Openstack-System-Scope: None Sep 27 17:24:14.776353 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: User-Agent: python-urllib3/1.26.12 Sep 27 17:24:14.776353 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Auth-Token: gAAAAABjMzGwUuJdkgBP6xZWdw9RXLLFUnLnMxZYJKIDY_91CNqXz3honRWwk97_mHfGMg-IoFBXWoNxQgZbpBQV_xIFB0MHHyVQ-Y-gLBYz83e73zBAVGN2O12ctvaf5aiN24fYQKzvlmp9zQckreyX04K8gOzl6DBR-brjF9SwpWE3to3Keqo Sep 27 17:24:14.776353 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Domain-Id: None Sep 27 17:24:14.776353 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Domain-Name: None Sep 27 17:24:14.776353 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Identity-Status: Confirmed Sep 27 17:24:14.776353 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Is-Admin-Project: True Sep 27 17:24:14.776353 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Domain-Id: default Sep 27 17:24:14.776353 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Domain-Name: Default Sep 27 17:24:14.776353 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Id: 0b7fcad3ea934d18b26586a80661b549 Sep 27 17:24:14.776353 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1830509268 Sep 27 17:24:14.776353 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Role: reader,member Sep 27 17:24:14.776353 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Roles: reader,member Sep 27 17:24:14.777786 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/0b7fcad3ea934d18b26586a80661b549"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_0b7fcad3ea934d18b26586a80661b549", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/0b7fcad3ea934d18b26586a80661b549"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/0b7fcad3ea934d18b26586a80661b549"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 27 17:24:14.777786 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1830509268 Sep 27 17:24:14.777786 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Tenant-Id: 0b7fcad3ea934d18b26586a80661b549 Sep 27 17:24:14.777786 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1830509268 Sep 27 17:24:14.777786 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User: tempest-VolumesSnapshotsTestJSON-1830509268-project Sep 27 17:24:14.777786 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Domain-Id: default Sep 27 17:24:14.777786 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Domain-Name: Default Sep 27 17:24:14.777786 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Id: 766279c94408482a8438cb44bebadbc5 Sep 27 17:24:14.777786 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1830509268-project Sep 27 17:24:14.777786 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: method: Sep 27 17:24:14.777786 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: exception: Snapshot 2ee40e31-e5c5-41dd-bfdb-2279c3186f85 could not be found. Sep 27 17:24:14.777786 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: action_args: {'id': '2ee40e31-e5c5-41dd-bfdb-2279c3186f85'} Sep 27 17:24:14.777786 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 17:24:14.778701 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:24:14.778701 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 27 17:24:14.778701 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 27 17:24:14.778701 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 27 17:24:14.778701 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 27 17:24:14.778701 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 27 17:24:14.778701 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 27 17:24:14.778701 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 27 17:24:14.778701 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 27 17:24:14.778701 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 27 17:24:14.778701 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 27 17:24:14.778701 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 27 17:24:14.778701 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 27 17:24:14.778701 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 27 17:24:14.778701 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 27 17:24:14.778701 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 2ee40e31-e5c5-41dd-bfdb-2279c3186f85 could not be found. (HTTP 404) (Request-ID: req-38bb225d-104b-4faa-a134-c0265130ea61) Sep 27 17:24:14.778701 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:24:14.778701 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:24:14.779749 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:24:14.779749 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:24:14.779749 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 27 17:24:14.779749 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 27 17:24:14.779749 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 27 17:24:14.779749 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 27 17:24:14.779749 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 27 17:24:14.779749 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 27 17:24:14.779749 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 27 17:24:14.779749 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 27 17:24:14.779749 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 27 17:24:14.779749 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 27 17:24:14.779749 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 27 17:24:14.779749 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 27 17:24:14.779749 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 27 17:24:14.779749 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 27 17:24:14.779749 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 27 17:24:14.779749 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 27 17:24:14.779749 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 27 17:24:14.780891 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 27 17:24:14.780891 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 27 17:24:14.780891 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 27 17:24:14.780891 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 27 17:24:14.780891 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 27 17:24:14.780891 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 2ee40e31-e5c5-41dd-bfdb-2279c3186f85 could not be found. Sep 27 17:24:14.780891 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:24:14.780891 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:24:14.780891 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:24:14.780891 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:24:14.780891 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:24:14.780891 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:24:14.780891 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 17:24:14.780891 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 17:24:14.780891 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 17:24:14.780891 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 17:24:14.780891 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 17:24:14.780891 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 17:24:14.780891 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 27 17:24:14.780891 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 17:24:14.782362 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 2ee40e31-e5c5-41dd-bfdb-2279c3186f85 could not be found. Sep 27 17:24:14.782362 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:24:14.782362 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:24:14.782362 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:24:14.782362 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:24:14.782362 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:24:14.782362 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:24:14.782362 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 17:24:14.782362 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 17:24:14.782362 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 2ee40e31-e5c5-41dd-bfdb-2279c3186f85 could not be found. Sep 27 17:24:14.782362 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:24:14.782362 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-4a4f0994-e76c-497b-8b42-d73cfa3e44e4 tempest-VolumesSnapshotsTestJSON-1830509268 tempest-VolumesSnapshotsTestJSON-1830509268-project] Returning 404 to user: Snapshot 2ee40e31-e5c5-41dd-bfdb-2279c3186f85 could not be found. {{(pid=120416) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 17:24:14.784074 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-4a4f0994-e76c-497b-8b42-d73cfa3e44e4 tempest-VolumesSnapshotsTestJSON-1830509268 tempest-VolumesSnapshotsTestJSON-1830509268-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/2ee40e31-e5c5-41dd-bfdb-2279c3186f85" status: 404 len: 111 microversion: 2.1 time: 0.076413 Sep 27 17:24:14.785290 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 24/35] 10.222.0.55 () {58 vars in 1251 bytes} [Tue Sep 27 17:24:14 2022] GET /compute/v2.1/os-snapshots/2ee40e31-e5c5-41dd-bfdb-2279c3186f85 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 17:24:14.799306 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-dd0df60c-c12a-4fcb-8f5e-7e8f0b51bc9c tempest-VolumesSnapshotsTestJSON-1830509268 tempest-VolumesSnapshotsTestJSON-1830509268-project] Calling method '.version_select at 0x7fe7259110d0>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:15.002701 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-dd0df60c-c12a-4fcb-8f5e-7e8f0b51bc9c tempest-VolumesSnapshotsTestJSON-1830509268 tempest-VolumesSnapshotsTestJSON-1830509268-project] 10.222.0.55 "DELETE /compute/v2.1/os-volumes/bbfe84f8-0d43-445f-9fc6-69b3d4afb003" status: 202 len: 0 microversion: 2.1 time: 0.211676 Sep 27 17:24:15.003439 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 12/36] 10.222.0.55 () {58 vars in 1248 bytes} [Tue Sep 27 17:24:14 2022] DELETE /compute/v2.1/os-volumes/bbfe84f8-0d43-445f-9fc6-69b3d4afb003 => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 17:24:15.013386 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-f9d2e091-6c42-4fa7-95fb-f4007e653e63 tempest-VolumesSnapshotsTestJSON-1830509268 tempest-VolumesSnapshotsTestJSON-1830509268-project] Calling method '.version_select at 0x7fe7258d21f0>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:15.109681 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-f9d2e091-6c42-4fa7-95fb-f4007e653e63 tempest-VolumesSnapshotsTestJSON-1830509268 tempest-VolumesSnapshotsTestJSON-1830509268-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/bbfe84f8-0d43-445f-9fc6-69b3d4afb003" status: 200 len: 345 microversion: 2.1 time: 0.101779 Sep 27 17:24:15.117616 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 25/37] 10.222.0.55 () {58 vars in 1245 bytes} [Tue Sep 27 17:24:15 2022] GET /compute/v2.1/os-volumes/bbfe84f8-0d43-445f-9fc6-69b3d4afb003 => generated 345 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:24:15.556171 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-3a8c5fe4-0153-40a1-a4c5-b6a9e070349f tempest-VolumesGetTestJSON-2018272340 tempest-VolumesGetTestJSON-2018272340-project] Calling method '.version_select at 0x7fe7259114c0>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:15.609137 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.wsgi [None req-3a8c5fe4-0153-40a1-a4c5-b6a9e070349f tempest-VolumesGetTestJSON-2018272340 tempest-VolumesGetTestJSON-2018272340-project] HTTP exception thrown: Volume daf66e41-e3c0-402e-b915-54a725b3945e could not be found. Sep 27 17:24:15.613136 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-3a8c5fe4-0153-40a1-a4c5-b6a9e070349f tempest-VolumesGetTestJSON-2018272340 tempest-VolumesGetTestJSON-2018272340-project] Request method failure captured: Sep 27 17:24:15.613136 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: request: GET /compute/v2.1/os-volumes/daf66e41-e3c0-402e-b915-54a725b3945e HTTP/1.1 Sep 27 17:24:15.613136 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Accept: application/json Sep 27 17:24:15.613136 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Accept-Encoding: identity Sep 27 17:24:15.613136 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Connection: close Sep 27 17:24:15.613136 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Content-Length: 0 Sep 27 17:24:15.613136 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Content-Type: application/json Sep 27 17:24:15.613136 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Host: 10.222.0.55 Sep 27 17:24:15.613136 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Openstack-System-Scope: None Sep 27 17:24:15.613136 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: User-Agent: python-urllib3/1.26.12 Sep 27 17:24:15.613136 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Auth-Token: gAAAAABjMzGykzeUcFOnyAO9XQNeIdshP8KkPz86uGxoqHkscZ-l2h94-zoMNK4M_ESrgtWlXPC4CJ86efPr7t0O8dBd_cp1mUXv_Ak7EcYC5LxgRxHW2PL84Py7lJBt2C0LuDeSmrvgOp6POPd0tp49v7Nukkwy94VVNVkY0TtSkCdEON8fXEk Sep 27 17:24:15.613136 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Domain-Id: None Sep 27 17:24:15.613136 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Domain-Name: None Sep 27 17:24:15.613136 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Identity-Status: Confirmed Sep 27 17:24:15.613136 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Is-Admin-Project: True Sep 27 17:24:15.613136 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Domain-Id: default Sep 27 17:24:15.613136 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Domain-Name: Default Sep 27 17:24:15.613136 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Id: b475d9ed19fb470aa81d133feadb658a Sep 27 17:24:15.613136 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Name: tempest-VolumesGetTestJSON-2018272340 Sep 27 17:24:15.613136 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Role: reader,member Sep 27 17:24:15.613136 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Roles: reader,member Sep 27 17:24:15.614316 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b475d9ed19fb470aa81d133feadb658a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_b475d9ed19fb470aa81d133feadb658a", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b475d9ed19fb470aa81d133feadb658a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/b475d9ed19fb470aa81d133feadb658a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 27 17:24:15.614316 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Tenant: tempest-VolumesGetTestJSON-2018272340 Sep 27 17:24:15.614316 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Tenant-Id: b475d9ed19fb470aa81d133feadb658a Sep 27 17:24:15.614316 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Tenant-Name: tempest-VolumesGetTestJSON-2018272340 Sep 27 17:24:15.614316 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User: tempest-VolumesGetTestJSON-2018272340-project Sep 27 17:24:15.614316 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Domain-Id: default Sep 27 17:24:15.614316 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Domain-Name: Default Sep 27 17:24:15.614316 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Id: 1b0bf21eb066497db842c72c63a95f4a Sep 27 17:24:15.614316 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Name: tempest-VolumesGetTestJSON-2018272340-project Sep 27 17:24:15.614316 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: method: Sep 27 17:24:15.614316 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: exception: Volume daf66e41-e3c0-402e-b915-54a725b3945e could not be found. Sep 27 17:24:15.614316 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: action_args: {'id': 'daf66e41-e3c0-402e-b915-54a725b3945e'} Sep 27 17:24:15.614316 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 17:24:15.615024 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:24:15.615024 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 27 17:24:15.615024 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 27 17:24:15.615024 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 27 17:24:15.615024 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 27 17:24:15.615024 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 27 17:24:15.615024 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 27 17:24:15.615024 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 27 17:24:15.615024 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 27 17:24:15.615024 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 27 17:24:15.615024 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 27 17:24:15.615024 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 27 17:24:15.615024 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 27 17:24:15.615024 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 27 17:24:15.615024 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 27 17:24:15.615024 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume daf66e41-e3c0-402e-b915-54a725b3945e could not be found. (HTTP 404) (Request-ID: req-8ea0170f-25d6-4b06-bfdf-f0b9d13cdbe3) Sep 27 17:24:15.615024 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:24:15.615024 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:24:15.615024 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:24:15.615971 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:24:15.615971 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 27 17:24:15.615971 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 27 17:24:15.615971 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 27 17:24:15.615971 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 27 17:24:15.615971 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 27 17:24:15.615971 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 27 17:24:15.615971 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 27 17:24:15.615971 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 27 17:24:15.615971 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 27 17:24:15.615971 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 27 17:24:15.615971 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 27 17:24:15.615971 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 27 17:24:15.615971 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 27 17:24:15.615971 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 27 17:24:15.615971 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 27 17:24:15.615971 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 27 17:24:15.615971 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 27 17:24:15.615971 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 27 17:24:15.616899 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 27 17:24:15.616899 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 27 17:24:15.616899 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 27 17:24:15.616899 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 27 17:24:15.616899 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume daf66e41-e3c0-402e-b915-54a725b3945e could not be found. Sep 27 17:24:15.616899 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:24:15.616899 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:24:15.616899 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:24:15.616899 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:24:15.616899 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:24:15.616899 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:24:15.616899 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 17:24:15.616899 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 17:24:15.616899 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 17:24:15.616899 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 17:24:15.616899 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 17:24:15.616899 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 17:24:15.616899 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 27 17:24:15.616899 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 17:24:15.617790 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume daf66e41-e3c0-402e-b915-54a725b3945e could not be found. Sep 27 17:24:15.617790 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:24:15.617790 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:24:15.617790 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:24:15.617790 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:24:15.617790 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:24:15.617790 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:24:15.617790 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 17:24:15.617790 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 17:24:15.617790 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume daf66e41-e3c0-402e-b915-54a725b3945e could not be found. Sep 27 17:24:15.617790 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:24:15.633051 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-3a8c5fe4-0153-40a1-a4c5-b6a9e070349f tempest-VolumesGetTestJSON-2018272340 tempest-VolumesGetTestJSON-2018272340-project] Returning 404 to user: Volume daf66e41-e3c0-402e-b915-54a725b3945e could not be found. {{(pid=120415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 17:24:15.634748 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-3a8c5fe4-0153-40a1-a4c5-b6a9e070349f tempest-VolumesGetTestJSON-2018272340 tempest-VolumesGetTestJSON-2018272340-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/daf66e41-e3c0-402e-b915-54a725b3945e" status: 404 len: 109 microversion: 2.1 time: 0.082648 Sep 27 17:24:15.635696 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 13/38] 10.222.0.55 () {58 vars in 1245 bytes} [Tue Sep 27 17:24:15 2022] GET /compute/v2.1/os-volumes/daf66e41-e3c0-402e-b915-54a725b3945e => generated 109 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 17:24:15.926205 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-0ed9fe4a-046e-4580-96b3-f9db807768d5 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1188270145", "imageRef": "9355bd92-0a49-42cd-b079-ff9f0d54b91b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:24:16.125959 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-8e6e34c3-7844-47a9-a4c8-7128ef610a06 tempest-VolumesSnapshotsTestJSON-1830509268 tempest-VolumesSnapshotsTestJSON-1830509268-project] Calling method '.version_select at 0x7fe725911160>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:16.288860 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.wsgi [None req-8e6e34c3-7844-47a9-a4c8-7128ef610a06 tempest-VolumesSnapshotsTestJSON-1830509268 tempest-VolumesSnapshotsTestJSON-1830509268-project] HTTP exception thrown: Volume bbfe84f8-0d43-445f-9fc6-69b3d4afb003 could not be found. Sep 27 17:24:16.290760 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-8e6e34c3-7844-47a9-a4c8-7128ef610a06 tempest-VolumesSnapshotsTestJSON-1830509268 tempest-VolumesSnapshotsTestJSON-1830509268-project] Request method failure captured: Sep 27 17:24:16.290760 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: request: GET /compute/v2.1/os-volumes/bbfe84f8-0d43-445f-9fc6-69b3d4afb003 HTTP/1.1 Sep 27 17:24:16.290760 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Accept: application/json Sep 27 17:24:16.290760 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Accept-Encoding: identity Sep 27 17:24:16.290760 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Connection: close Sep 27 17:24:16.290760 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Content-Length: 0 Sep 27 17:24:16.290760 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Content-Type: application/json Sep 27 17:24:16.290760 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Host: 10.222.0.55 Sep 27 17:24:16.290760 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Openstack-System-Scope: None Sep 27 17:24:16.290760 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: User-Agent: python-urllib3/1.26.12 Sep 27 17:24:16.290760 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Auth-Token: gAAAAABjMzGwUuJdkgBP6xZWdw9RXLLFUnLnMxZYJKIDY_91CNqXz3honRWwk97_mHfGMg-IoFBXWoNxQgZbpBQV_xIFB0MHHyVQ-Y-gLBYz83e73zBAVGN2O12ctvaf5aiN24fYQKzvlmp9zQckreyX04K8gOzl6DBR-brjF9SwpWE3to3Keqo Sep 27 17:24:16.290760 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Domain-Id: None Sep 27 17:24:16.290760 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Domain-Name: None Sep 27 17:24:16.290760 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Identity-Status: Confirmed Sep 27 17:24:16.290760 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Is-Admin-Project: True Sep 27 17:24:16.290760 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Domain-Id: default Sep 27 17:24:16.290760 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Domain-Name: Default Sep 27 17:24:16.290760 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Id: 0b7fcad3ea934d18b26586a80661b549 Sep 27 17:24:16.290760 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1830509268 Sep 27 17:24:16.290760 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Role: reader,member Sep 27 17:24:16.290760 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Roles: reader,member Sep 27 17:24:16.291936 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/0b7fcad3ea934d18b26586a80661b549"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_0b7fcad3ea934d18b26586a80661b549", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/0b7fcad3ea934d18b26586a80661b549"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/0b7fcad3ea934d18b26586a80661b549"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 27 17:24:16.291936 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1830509268 Sep 27 17:24:16.291936 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Tenant-Id: 0b7fcad3ea934d18b26586a80661b549 Sep 27 17:24:16.291936 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1830509268 Sep 27 17:24:16.291936 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User: tempest-VolumesSnapshotsTestJSON-1830509268-project Sep 27 17:24:16.291936 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Domain-Id: default Sep 27 17:24:16.291936 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Domain-Name: Default Sep 27 17:24:16.291936 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Id: 766279c94408482a8438cb44bebadbc5 Sep 27 17:24:16.291936 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1830509268-project Sep 27 17:24:16.291936 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: method: Sep 27 17:24:16.291936 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: exception: Volume bbfe84f8-0d43-445f-9fc6-69b3d4afb003 could not be found. Sep 27 17:24:16.291936 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: action_args: {'id': 'bbfe84f8-0d43-445f-9fc6-69b3d4afb003'} Sep 27 17:24:16.291936 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 17:24:16.292739 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:24:16.292739 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 27 17:24:16.292739 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 27 17:24:16.292739 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 27 17:24:16.292739 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 27 17:24:16.292739 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 27 17:24:16.292739 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 27 17:24:16.292739 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 27 17:24:16.292739 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 27 17:24:16.292739 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 27 17:24:16.292739 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 27 17:24:16.292739 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 27 17:24:16.292739 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 27 17:24:16.292739 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 27 17:24:16.292739 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 27 17:24:16.292739 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bbfe84f8-0d43-445f-9fc6-69b3d4afb003 could not be found. (HTTP 404) (Request-ID: req-61b5d795-92b4-49cc-b84c-67addf41ad94) Sep 27 17:24:16.292739 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:24:16.292739 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:24:16.292739 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:24:16.294354 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:24:16.294354 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 27 17:24:16.294354 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 27 17:24:16.294354 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 27 17:24:16.294354 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 27 17:24:16.294354 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 27 17:24:16.294354 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 27 17:24:16.294354 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 27 17:24:16.294354 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 27 17:24:16.294354 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 27 17:24:16.294354 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 27 17:24:16.294354 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 27 17:24:16.294354 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 27 17:24:16.294354 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 27 17:24:16.294354 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 27 17:24:16.294354 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 27 17:24:16.294354 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 27 17:24:16.294354 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 27 17:24:16.294354 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 27 17:24:16.295425 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 27 17:24:16.295425 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 27 17:24:16.295425 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 27 17:24:16.295425 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 27 17:24:16.295425 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bbfe84f8-0d43-445f-9fc6-69b3d4afb003 could not be found. Sep 27 17:24:16.295425 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:24:16.295425 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:24:16.295425 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:24:16.295425 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:24:16.295425 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:24:16.295425 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:24:16.295425 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 17:24:16.295425 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 17:24:16.295425 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 17:24:16.295425 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 17:24:16.295425 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 17:24:16.295425 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 17:24:16.295425 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 27 17:24:16.295425 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 17:24:16.296492 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bbfe84f8-0d43-445f-9fc6-69b3d4afb003 could not be found. Sep 27 17:24:16.296492 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:24:16.296492 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:24:16.296492 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:24:16.296492 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:24:16.296492 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:24:16.296492 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:24:16.296492 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 17:24:16.296492 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 17:24:16.296492 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bbfe84f8-0d43-445f-9fc6-69b3d4afb003 could not be found. Sep 27 17:24:16.296492 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:24:16.296492 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-8e6e34c3-7844-47a9-a4c8-7128ef610a06 tempest-VolumesSnapshotsTestJSON-1830509268 tempest-VolumesSnapshotsTestJSON-1830509268-project] Returning 404 to user: Volume bbfe84f8-0d43-445f-9fc6-69b3d4afb003 could not be found. {{(pid=120415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 17:24:16.296492 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-8e6e34c3-7844-47a9-a4c8-7128ef610a06 tempest-VolumesSnapshotsTestJSON-1830509268 tempest-VolumesSnapshotsTestJSON-1830509268-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/bbfe84f8-0d43-445f-9fc6-69b3d4afb003" status: 404 len: 109 microversion: 2.1 time: 0.171285 Sep 27 17:24:16.297314 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 14/39] 10.222.0.55 () {58 vars in 1245 bytes} [Tue Sep 27 17:24:16 2022] GET /compute/v2.1/os-volumes/bbfe84f8-0d43-445f-9fc6-69b3d4afb003 => generated 109 bytes in 177 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 17:24:16.323405 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.network.neutron [None req-0ed9fe4a-046e-4580-96b3-f9db807768d5 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] validate_networks() for [('77098589-b75d-4cff-80ff-98fbc8a6384d', None, None, None, None, None)] {{(pid=120416) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 17:24:16.867386 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-60d6bc15-5526-4888-aacc-d74d549e7818 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Action: 'create', calling method: .version_select at 0x7fe72589b940>, body: {"keypair": {"name": "tempest-keypair-644058286", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD60bzTZaeL0X2lkOpK3Q2U7lg8dYHV6w0HQwuPcRtJUgrsBnz/lAE4PoKU1spj8l5QA5qDkvZZbOf56z/7Tv/MFyL48MR35Jhl2BmSu1nvbATw1Nk3a/McCoEjl+SRO9w=="}} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:24:16.991299 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.quota [None req-60d6bc15-5526-4888-aacc-d74d549e7818 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Getting quotas for project 37e99b06d94d4893963a88cd5333ec5b. Resources: {'key_pairs'} {{(pid=120415) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 17:24:17.004606 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.quota [None req-60d6bc15-5526-4888-aacc-d74d549e7818 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Getting quotas for user 1dde550901f04ea695b85db4e41d9628 and project 37e99b06d94d4893963a88cd5333ec5b. Resources: {'key_pairs'} {{(pid=120415) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 17:24:17.123464 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-60d6bc15-5526-4888-aacc-d74d549e7818 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.824233 Sep 27 17:24:17.124776 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 15/40] 10.222.0.55 () {62 vars in 1200 bytes} [Tue Sep 27 17:24:16 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 827 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 27 17:24:17.131477 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-2de35269-9a0f-4622-ac7b-0e05cb1c8146 tempest-VolumesSnapshotsTestJSON-1830509268 tempest-VolumesSnapshotsTestJSON-1830509268-project] Calling method '.version_select at 0x7fe7257e9160>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:17.189204 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.wsgi [None req-2de35269-9a0f-4622-ac7b-0e05cb1c8146 tempest-VolumesSnapshotsTestJSON-1830509268 tempest-VolumesSnapshotsTestJSON-1830509268-project] HTTP exception thrown: Volume bbfe84f8-0d43-445f-9fc6-69b3d4afb003 could not be found. Sep 27 17:24:17.191862 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-2de35269-9a0f-4622-ac7b-0e05cb1c8146 tempest-VolumesSnapshotsTestJSON-1830509268 tempest-VolumesSnapshotsTestJSON-1830509268-project] Request method failure captured: Sep 27 17:24:17.191862 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: request: DELETE /compute/v2.1/os-volumes/bbfe84f8-0d43-445f-9fc6-69b3d4afb003 HTTP/1.1 Sep 27 17:24:17.191862 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Accept: application/json Sep 27 17:24:17.191862 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Accept-Encoding: identity Sep 27 17:24:17.191862 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Connection: close Sep 27 17:24:17.191862 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Content-Length: 0 Sep 27 17:24:17.191862 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Content-Type: application/json Sep 27 17:24:17.191862 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Host: 10.222.0.55 Sep 27 17:24:17.191862 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Openstack-System-Scope: None Sep 27 17:24:17.191862 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: User-Agent: python-urllib3/1.26.12 Sep 27 17:24:17.191862 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Auth-Token: gAAAAABjMzGwUuJdkgBP6xZWdw9RXLLFUnLnMxZYJKIDY_91CNqXz3honRWwk97_mHfGMg-IoFBXWoNxQgZbpBQV_xIFB0MHHyVQ-Y-gLBYz83e73zBAVGN2O12ctvaf5aiN24fYQKzvlmp9zQckreyX04K8gOzl6DBR-brjF9SwpWE3to3Keqo Sep 27 17:24:17.191862 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Domain-Id: None Sep 27 17:24:17.191862 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Domain-Name: None Sep 27 17:24:17.191862 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Identity-Status: Confirmed Sep 27 17:24:17.191862 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Is-Admin-Project: True Sep 27 17:24:17.191862 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Domain-Id: default Sep 27 17:24:17.191862 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Domain-Name: Default Sep 27 17:24:17.191862 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Id: 0b7fcad3ea934d18b26586a80661b549 Sep 27 17:24:17.191862 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1830509268 Sep 27 17:24:17.191862 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Role: reader,member Sep 27 17:24:17.191862 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Roles: reader,member Sep 27 17:24:17.193271 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/0b7fcad3ea934d18b26586a80661b549"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_0b7fcad3ea934d18b26586a80661b549", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/0b7fcad3ea934d18b26586a80661b549"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/0b7fcad3ea934d18b26586a80661b549"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 27 17:24:17.193271 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1830509268 Sep 27 17:24:17.193271 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Tenant-Id: 0b7fcad3ea934d18b26586a80661b549 Sep 27 17:24:17.193271 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1830509268 Sep 27 17:24:17.193271 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User: tempest-VolumesSnapshotsTestJSON-1830509268-project Sep 27 17:24:17.193271 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Domain-Id: default Sep 27 17:24:17.193271 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Domain-Name: Default Sep 27 17:24:17.193271 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Id: 766279c94408482a8438cb44bebadbc5 Sep 27 17:24:17.193271 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1830509268-project Sep 27 17:24:17.193271 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: method: Sep 27 17:24:17.193271 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: exception: Volume bbfe84f8-0d43-445f-9fc6-69b3d4afb003 could not be found. Sep 27 17:24:17.193271 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: action_args: {'id': 'bbfe84f8-0d43-445f-9fc6-69b3d4afb003'} Sep 27 17:24:17.193271 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 17:24:17.194027 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:24:17.194027 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 27 17:24:17.194027 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 27 17:24:17.194027 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 27 17:24:17.194027 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 27 17:24:17.194027 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 27 17:24:17.194027 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 27 17:24:17.194027 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 27 17:24:17.194027 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 27 17:24:17.194027 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 27 17:24:17.194027 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 27 17:24:17.194027 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 27 17:24:17.194027 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 27 17:24:17.194027 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 27 17:24:17.194027 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 27 17:24:17.194027 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bbfe84f8-0d43-445f-9fc6-69b3d4afb003 could not be found. (HTTP 404) (Request-ID: req-9bcb145a-50ac-4905-b708-77e107e62fb7) Sep 27 17:24:17.194027 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:24:17.194027 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:24:17.194027 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:24:17.195256 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:24:17.195256 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 27 17:24:17.195256 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 27 17:24:17.195256 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 27 17:24:17.195256 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 27 17:24:17.195256 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 27 17:24:17.195256 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 27 17:24:17.195256 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 27 17:24:17.195256 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 27 17:24:17.195256 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 27 17:24:17.195256 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 27 17:24:17.195256 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 27 17:24:17.195256 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 27 17:24:17.195256 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 27 17:24:17.195256 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 27 17:24:17.195256 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 27 17:24:17.195256 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 27 17:24:17.195256 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 27 17:24:17.195256 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 27 17:24:17.196648 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 27 17:24:17.196648 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 27 17:24:17.196648 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 27 17:24:17.196648 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 27 17:24:17.196648 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bbfe84f8-0d43-445f-9fc6-69b3d4afb003 could not be found. Sep 27 17:24:17.196648 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:24:17.196648 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:24:17.196648 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:24:17.196648 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:24:17.196648 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:24:17.196648 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:24:17.196648 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 17:24:17.196648 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 17:24:17.196648 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 17:24:17.196648 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 17:24:17.196648 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 17:24:17.196648 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 17:24:17.196648 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 27 17:24:17.196648 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 17:24:17.198526 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bbfe84f8-0d43-445f-9fc6-69b3d4afb003 could not be found. Sep 27 17:24:17.198526 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:24:17.198526 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:24:17.198526 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:24:17.198526 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:24:17.198526 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:24:17.198526 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:24:17.198526 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 17:24:17.198526 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 17:24:17.198526 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bbfe84f8-0d43-445f-9fc6-69b3d4afb003 could not be found. Sep 27 17:24:17.198526 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:24:17.198526 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-2de35269-9a0f-4622-ac7b-0e05cb1c8146 tempest-VolumesSnapshotsTestJSON-1830509268 tempest-VolumesSnapshotsTestJSON-1830509268-project] Returning 404 to user: Volume bbfe84f8-0d43-445f-9fc6-69b3d4afb003 could not be found. {{(pid=120415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 17:24:17.198526 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-2de35269-9a0f-4622-ac7b-0e05cb1c8146 tempest-VolumesSnapshotsTestJSON-1830509268 tempest-VolumesSnapshotsTestJSON-1830509268-project] 10.222.0.55 "DELETE /compute/v2.1/os-volumes/bbfe84f8-0d43-445f-9fc6-69b3d4afb003" status: 404 len: 109 microversion: 2.1 time: 0.071758 Sep 27 17:24:17.203054 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 16/41] 10.222.0.55 () {58 vars in 1248 bytes} [Tue Sep 27 17:24:17 2022] DELETE /compute/v2.1/os-volumes/bbfe84f8-0d43-445f-9fc6-69b3d4afb003 => generated 109 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 17:24:17.755145 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-09131e0a-8f00-4dbe-a32a-b72a64869cad tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-469197786", "imageRef": "9355bd92-0a49-42cd-b079-ff9f0d54b91b", "flavorRef": "452", "networks": [{"uuid": "9ec76b38-4dd6-4948-baf3-dc0cadd14720"}]}} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:24:17.988047 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.network.neutron [None req-09131e0a-8f00-4dbe-a32a-b72a64869cad tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] validate_networks() for [('9ec76b38-4dd6-4948-baf3-dc0cadd14720', None, None, None, None, None)] {{(pid=120415) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 17:24:19.035366 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.virt.hardware [None req-0ed9fe4a-046e-4580-96b3-f9db807768d5 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Flavor limits 0:0:0 {{(pid=120416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 17:24:19.036579 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.virt.hardware [None req-0ed9fe4a-046e-4580-96b3-f9db807768d5 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Image limits 0:0:0 {{(pid=120416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 17:24:19.037253 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.virt.hardware [None req-0ed9fe4a-046e-4580-96b3-f9db807768d5 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Flavor pref 0:0:0 {{(pid=120416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 17:24:19.037878 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.virt.hardware [None req-0ed9fe4a-046e-4580-96b3-f9db807768d5 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Image pref 0:0:0 {{(pid=120416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 17:24:19.038789 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.virt.hardware [None req-0ed9fe4a-046e-4580-96b3-f9db807768d5 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 17:24:19.072384 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-0ed9fe4a-046e-4580-96b3-f9db807768d5 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:19.073989 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-0ed9fe4a-046e-4580-96b3-f9db807768d5 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:19.076532 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-0ed9fe4a-046e-4580-96b3-f9db807768d5 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:19.077701 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-0ed9fe4a-046e-4580-96b3-f9db807768d5 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:19.079879 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-0ed9fe4a-046e-4580-96b3-f9db807768d5 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:19.080575 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-0ed9fe4a-046e-4580-96b3-f9db807768d5 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:19.171924 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.quota [None req-0ed9fe4a-046e-4580-96b3-f9db807768d5 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Getting quotas for project fd5caa5782e74721a4c2991524182668. Resources: {'cores', 'ram', 'instances'} {{(pid=120416) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 17:24:19.192105 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.quota [None req-0ed9fe4a-046e-4580-96b3-f9db807768d5 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Getting quotas for user d23a498bde00483c8fdd68dcde975e5d and project fd5caa5782e74721a4c2991524182668. Resources: {'cores', 'ram', 'instances'} {{(pid=120416) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 17:24:19.220328 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-0ed9fe4a-046e-4580-96b3-f9db807768d5 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Going to run 1 instances... {{(pid=120416) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 17:24:19.226617 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-0ed9fe4a-046e-4580-96b3-f9db807768d5 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: 95a7693f-d1df-43fb-81e7-1c83b069e269] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9355bd92-0a49-42cd-b079-ff9f0d54b91b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120416) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 17:24:19.395709 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-0ed9fe4a-046e-4580-96b3-f9db807768d5 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.731096 Sep 27 17:24:19.406430 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 26/42] 10.222.0.55 () {60 vars in 1147 bytes} [Tue Sep 27 17:24:15 2022] POST /compute/v2.1/servers => generated 383 bytes in 3742 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 17:24:19.412828 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-8a04deea-2c8e-4b5a-9aa0-37d8a3f805d0 tempest-VolumesSnapshotsTestJSON-1830509268 tempest-VolumesSnapshotsTestJSON-1830509268-project] Calling method '.version_select at 0x7fe724f66820>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:19.470742 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.wsgi [None req-8a04deea-2c8e-4b5a-9aa0-37d8a3f805d0 tempest-VolumesSnapshotsTestJSON-1830509268 tempest-VolumesSnapshotsTestJSON-1830509268-project] HTTP exception thrown: Volume bbfe84f8-0d43-445f-9fc6-69b3d4afb003 could not be found. Sep 27 17:24:19.472819 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-8a04deea-2c8e-4b5a-9aa0-37d8a3f805d0 tempest-VolumesSnapshotsTestJSON-1830509268 tempest-VolumesSnapshotsTestJSON-1830509268-project] Request method failure captured: Sep 27 17:24:19.472819 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: request: GET /compute/v2.1/os-volumes/bbfe84f8-0d43-445f-9fc6-69b3d4afb003 HTTP/1.1 Sep 27 17:24:19.472819 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Accept: application/json Sep 27 17:24:19.472819 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Accept-Encoding: identity Sep 27 17:24:19.472819 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Connection: close Sep 27 17:24:19.472819 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Content-Length: 0 Sep 27 17:24:19.472819 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Content-Type: application/json Sep 27 17:24:19.472819 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Host: 10.222.0.55 Sep 27 17:24:19.472819 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Openstack-System-Scope: None Sep 27 17:24:19.472819 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: User-Agent: python-urllib3/1.26.12 Sep 27 17:24:19.472819 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Auth-Token: gAAAAABjMzGwUuJdkgBP6xZWdw9RXLLFUnLnMxZYJKIDY_91CNqXz3honRWwk97_mHfGMg-IoFBXWoNxQgZbpBQV_xIFB0MHHyVQ-Y-gLBYz83e73zBAVGN2O12ctvaf5aiN24fYQKzvlmp9zQckreyX04K8gOzl6DBR-brjF9SwpWE3to3Keqo Sep 27 17:24:19.472819 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Domain-Id: None Sep 27 17:24:19.472819 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Domain-Name: None Sep 27 17:24:19.472819 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Identity-Status: Confirmed Sep 27 17:24:19.472819 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Is-Admin-Project: True Sep 27 17:24:19.472819 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Domain-Id: default Sep 27 17:24:19.472819 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Domain-Name: Default Sep 27 17:24:19.472819 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Id: 0b7fcad3ea934d18b26586a80661b549 Sep 27 17:24:19.472819 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1830509268 Sep 27 17:24:19.472819 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Role: reader,member Sep 27 17:24:19.472819 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Roles: reader,member Sep 27 17:24:19.473927 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/0b7fcad3ea934d18b26586a80661b549"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_0b7fcad3ea934d18b26586a80661b549", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/0b7fcad3ea934d18b26586a80661b549"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/0b7fcad3ea934d18b26586a80661b549"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 27 17:24:19.473927 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1830509268 Sep 27 17:24:19.473927 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Tenant-Id: 0b7fcad3ea934d18b26586a80661b549 Sep 27 17:24:19.473927 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1830509268 Sep 27 17:24:19.473927 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User: tempest-VolumesSnapshotsTestJSON-1830509268-project Sep 27 17:24:19.473927 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Domain-Id: default Sep 27 17:24:19.473927 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Domain-Name: Default Sep 27 17:24:19.473927 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Id: 766279c94408482a8438cb44bebadbc5 Sep 27 17:24:19.473927 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1830509268-project Sep 27 17:24:19.473927 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: method: Sep 27 17:24:19.473927 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: exception: Volume bbfe84f8-0d43-445f-9fc6-69b3d4afb003 could not be found. Sep 27 17:24:19.473927 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: action_args: {'id': 'bbfe84f8-0d43-445f-9fc6-69b3d4afb003'} Sep 27 17:24:19.473927 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 17:24:19.474716 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:24:19.474716 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 27 17:24:19.474716 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 27 17:24:19.474716 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 27 17:24:19.474716 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 27 17:24:19.474716 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 27 17:24:19.474716 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 27 17:24:19.474716 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 27 17:24:19.474716 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 27 17:24:19.474716 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 27 17:24:19.474716 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 27 17:24:19.474716 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 27 17:24:19.474716 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 27 17:24:19.474716 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 27 17:24:19.474716 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 27 17:24:19.474716 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bbfe84f8-0d43-445f-9fc6-69b3d4afb003 could not be found. (HTTP 404) (Request-ID: req-5784e42b-3451-43d5-9fca-93b7a534cd66) Sep 27 17:24:19.474716 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:24:19.474716 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:24:19.474716 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:24:19.476309 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:24:19.476309 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 27 17:24:19.476309 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 27 17:24:19.476309 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 27 17:24:19.476309 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 27 17:24:19.476309 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 27 17:24:19.476309 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 27 17:24:19.476309 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 27 17:24:19.476309 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 27 17:24:19.476309 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 27 17:24:19.476309 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 27 17:24:19.476309 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 27 17:24:19.476309 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 27 17:24:19.476309 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 27 17:24:19.476309 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 27 17:24:19.476309 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 27 17:24:19.476309 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 27 17:24:19.476309 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 27 17:24:19.476309 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 27 17:24:19.480540 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 27 17:24:19.480540 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 27 17:24:19.480540 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 27 17:24:19.480540 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 27 17:24:19.480540 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bbfe84f8-0d43-445f-9fc6-69b3d4afb003 could not be found. Sep 27 17:24:19.480540 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:24:19.480540 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:24:19.480540 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:24:19.480540 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:24:19.480540 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:24:19.480540 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:24:19.480540 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 17:24:19.480540 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 17:24:19.480540 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 27 17:24:19.480540 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 27 17:24:19.480540 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 17:24:19.480540 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 17:24:19.480540 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 27 17:24:19.480540 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 17:24:19.483044 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bbfe84f8-0d43-445f-9fc6-69b3d4afb003 could not be found. Sep 27 17:24:19.483044 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:24:19.483044 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:24:19.483044 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:24:19.483044 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:24:19.483044 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:24:19.483044 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:24:19.483044 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 17:24:19.483044 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 17:24:19.483044 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bbfe84f8-0d43-445f-9fc6-69b3d4afb003 could not be found. Sep 27 17:24:19.483044 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:24:19.483044 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-8a04deea-2c8e-4b5a-9aa0-37d8a3f805d0 tempest-VolumesSnapshotsTestJSON-1830509268 tempest-VolumesSnapshotsTestJSON-1830509268-project] Returning 404 to user: Volume bbfe84f8-0d43-445f-9fc6-69b3d4afb003 could not be found. {{(pid=120416) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 17:24:19.483044 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-8a04deea-2c8e-4b5a-9aa0-37d8a3f805d0 tempest-VolumesSnapshotsTestJSON-1830509268 tempest-VolumesSnapshotsTestJSON-1830509268-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/bbfe84f8-0d43-445f-9fc6-69b3d4afb003" status: 404 len: 109 microversion: 2.1 time: 0.066181 Sep 27 17:24:19.483044 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 27/43] 10.222.0.55 () {58 vars in 1245 bytes} [Tue Sep 27 17:24:19 2022] GET /compute/v2.1/os-volumes/bbfe84f8-0d43-445f-9fc6-69b3d4afb003 => generated 109 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 17:24:19.485285 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-5e0c20d4-8882-4663-901e-141cd5eece11 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:19.485285 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-5e0c20d4-8882-4663-901e-141cd5eece11 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: 95a7693f-d1df-43fb-81e7-1c83b069e269] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:24:19.876328 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-5e0c20d4-8882-4663-901e-141cd5eece11 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:19.912947 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-5e0c20d4-8882-4663-901e-141cd5eece11 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/95a7693f-d1df-43fb-81e7-1c83b069e269" status: 200 len: 1222 microversion: 2.1 time: 0.436796 Sep 27 17:24:19.917635 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 28/44] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:24:19 2022] GET /compute/v2.1/servers/95a7693f-d1df-43fb-81e7-1c83b069e269 => generated 1222 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:24:19.964602 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-09131e0a-8f00-4dbe-a32a-b72a64869cad tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Flavor limits 0:0:0 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 17:24:19.965714 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-09131e0a-8f00-4dbe-a32a-b72a64869cad tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Image limits 0:0:0 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 17:24:19.966376 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-09131e0a-8f00-4dbe-a32a-b72a64869cad tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Flavor pref 0:0:0 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 17:24:19.966990 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-09131e0a-8f00-4dbe-a32a-b72a64869cad tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Image pref 0:0:0 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 17:24:19.967595 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-09131e0a-8f00-4dbe-a32a-b72a64869cad tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 17:24:19.998392 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-09131e0a-8f00-4dbe-a32a-b72a64869cad tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:20.000888 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-09131e0a-8f00-4dbe-a32a-b72a64869cad tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:20.002201 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-09131e0a-8f00-4dbe-a32a-b72a64869cad tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:20.005697 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-09131e0a-8f00-4dbe-a32a-b72a64869cad tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:20.006399 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-09131e0a-8f00-4dbe-a32a-b72a64869cad tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:20.007027 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-09131e0a-8f00-4dbe-a32a-b72a64869cad tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:20.089589 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.quota [None req-09131e0a-8f00-4dbe-a32a-b72a64869cad tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Getting quotas for project 9c16b9aaa5ac4e6dac613614c1a570c8. Resources: {'cores', 'ram', 'instances'} {{(pid=120415) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 17:24:20.101710 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.quota [None req-09131e0a-8f00-4dbe-a32a-b72a64869cad tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Getting quotas for user e48c146c0bba4583a92d157e2eed7f99 and project 9c16b9aaa5ac4e6dac613614c1a570c8. Resources: {'cores', 'ram', 'instances'} {{(pid=120415) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 17:24:20.141798 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-09131e0a-8f00-4dbe-a32a-b72a64869cad tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Going to run 1 instances... {{(pid=120415) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 17:24:20.153655 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-09131e0a-8f00-4dbe-a32a-b72a64869cad tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] [instance: 0e6c9900-b294-45b0-a692-18ed9f943669] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9355bd92-0a49-42cd-b079-ff9f0d54b91b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120415) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 17:24:20.345171 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-09131e0a-8f00-4dbe-a32a-b72a64869cad tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.140507 Sep 27 17:24:20.349771 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 17/45] 10.222.0.55 () {60 vars in 1147 bytes} [Tue Sep 27 17:24:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 3146 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 17:24:20.360137 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-2cea825b-4904-4449-a118-4ca9d25f1a02 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:20.365454 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-2cea825b-4904-4449-a118-4ca9d25f1a02 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] [instance: 0e6c9900-b294-45b0-a692-18ed9f943669] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:24:20.601163 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-2cea825b-4904-4449-a118-4ca9d25f1a02 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48c146c0bba4583a92d157e2eed7f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c16b9aaa5ac4e6dac613614c1a570c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:20.610146 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-2cea825b-4904-4449-a118-4ca9d25f1a02 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] 10.222.0.55 "GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669" status: 200 len: 1214 microversion: 2.1 time: 0.255850 Sep 27 17:24:20.610719 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 29/46] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:24:20 2022] GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669 => generated 1214 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:24:20.878763 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-0a35b6da-62b8-4ec4-bebb-b15eafc3e3a3 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-979921512", "imageRef": "9355bd92-0a49-42cd-b079-ff9f0d54b91b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:24:21.063032 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.network.neutron [None req-0a35b6da-62b8-4ec4-bebb-b15eafc3e3a3 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] validate_networks() for [('77098589-b75d-4cff-80ff-98fbc8a6384d', None, None, None, None, None)] {{(pid=120415) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 17:24:21.421682 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-90be664e-326b-4a62-92e1-8a7ab203bca0 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1075077918", "imageRef": "9355bd92-0a49-42cd-b079-ff9f0d54b91b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "39cd2f9e-bd9d-49da-a5a0-71ace359ff57"}], "security_groups": [{"name": "tempest-securitygroup--313023506"}], "key_name": "tempest-keypair-644058286", "user_data": "}} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:24:21.798814 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.network.neutron [None req-90be664e-326b-4a62-92e1-8a7ab203bca0 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] validate_networks() for [('39cd2f9e-bd9d-49da-a5a0-71ace359ff57', None, None, None, None, None)] {{(pid=120416) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 17:24:22.980745 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-0a35b6da-62b8-4ec4-bebb-b15eafc3e3a3 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Flavor limits 0:0:0 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 17:24:22.981799 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-0a35b6da-62b8-4ec4-bebb-b15eafc3e3a3 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Image limits 0:0:0 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 17:24:22.982603 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-0a35b6da-62b8-4ec4-bebb-b15eafc3e3a3 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Flavor pref 0:0:0 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 17:24:22.983292 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-0a35b6da-62b8-4ec4-bebb-b15eafc3e3a3 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Image pref 0:0:0 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 17:24:22.983879 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-0a35b6da-62b8-4ec4-bebb-b15eafc3e3a3 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 17:24:23.016401 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0a35b6da-62b8-4ec4-bebb-b15eafc3e3a3 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:23.017355 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0a35b6da-62b8-4ec4-bebb-b15eafc3e3a3 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:23.020324 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0a35b6da-62b8-4ec4-bebb-b15eafc3e3a3 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:23.024179 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0a35b6da-62b8-4ec4-bebb-b15eafc3e3a3 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:23.024179 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0a35b6da-62b8-4ec4-bebb-b15eafc3e3a3 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:23.027209 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0a35b6da-62b8-4ec4-bebb-b15eafc3e3a3 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:23.124678 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.quota [None req-0a35b6da-62b8-4ec4-bebb-b15eafc3e3a3 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Getting quotas for project fd5caa5782e74721a4c2991524182668. Resources: {'cores', 'ram', 'instances'} {{(pid=120415) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 17:24:23.138508 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.quota [None req-0a35b6da-62b8-4ec4-bebb-b15eafc3e3a3 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Getting quotas for user d23a498bde00483c8fdd68dcde975e5d and project fd5caa5782e74721a4c2991524182668. Resources: {'cores', 'ram', 'instances'} {{(pid=120415) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 17:24:23.198771 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-0a35b6da-62b8-4ec4-bebb-b15eafc3e3a3 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Going to run 1 instances... {{(pid=120415) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 17:24:23.211179 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-0a35b6da-62b8-4ec4-bebb-b15eafc3e3a3 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: d622d15d-b954-409c-a1f5-538da5de83db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9355bd92-0a49-42cd-b079-ff9f0d54b91b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120415) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 17:24:23.412594 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.virt.hardware [None req-90be664e-326b-4a62-92e1-8a7ab203bca0 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Flavor limits 0:0:0 {{(pid=120416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 17:24:23.413754 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.virt.hardware [None req-90be664e-326b-4a62-92e1-8a7ab203bca0 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Image limits 0:0:0 {{(pid=120416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 17:24:23.414348 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-0a35b6da-62b8-4ec4-bebb-b15eafc3e3a3 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.541511 Sep 27 17:24:23.414721 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.virt.hardware [None req-90be664e-326b-4a62-92e1-8a7ab203bca0 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Flavor pref 0:0:0 {{(pid=120416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 17:24:23.415052 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 18/47] 10.222.0.55 () {60 vars in 1147 bytes} [Tue Sep 27 17:24:20 2022] POST /compute/v2.1/servers => generated 383 bytes in 2554 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 17:24:23.415568 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.virt.hardware [None req-90be664e-326b-4a62-92e1-8a7ab203bca0 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Image pref 0:0:0 {{(pid=120416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 17:24:23.416309 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.virt.hardware [None req-90be664e-326b-4a62-92e1-8a7ab203bca0 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 17:24:23.440391 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-90be664e-326b-4a62-92e1-8a7ab203bca0 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:23.444877 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-094c302e-c604-4a44-b449-443ef8a6809f tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:23.445416 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-90be664e-326b-4a62-92e1-8a7ab203bca0 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:23.445530 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-094c302e-c604-4a44-b449-443ef8a6809f tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] [instance: 0e6c9900-b294-45b0-a692-18ed9f943669] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:24:23.445874 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-90be664e-326b-4a62-92e1-8a7ab203bca0 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:23.449338 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-90be664e-326b-4a62-92e1-8a7ab203bca0 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:23.449865 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-90be664e-326b-4a62-92e1-8a7ab203bca0 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:23.450362 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-90be664e-326b-4a62-92e1-8a7ab203bca0 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:23.494370 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-094c302e-c604-4a44-b449-443ef8a6809f tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:23.495802 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-094c302e-c604-4a44-b449-443ef8a6809f tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:23.498908 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-094c302e-c604-4a44-b449-443ef8a6809f tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:23.499863 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-094c302e-c604-4a44-b449-443ef8a6809f tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:23.500498 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-094c302e-c604-4a44-b449-443ef8a6809f tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:23.501546 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-094c302e-c604-4a44-b449-443ef8a6809f tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:23.529247 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.quota [None req-90be664e-326b-4a62-92e1-8a7ab203bca0 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Getting quotas for project 37e99b06d94d4893963a88cd5333ec5b. Resources: {'cores', 'ram', 'instances'} {{(pid=120416) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 17:24:23.540170 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.quota [None req-90be664e-326b-4a62-92e1-8a7ab203bca0 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Getting quotas for user 1dde550901f04ea695b85db4e41d9628 and project 37e99b06d94d4893963a88cd5333ec5b. Resources: {'cores', 'ram', 'instances'} {{(pid=120416) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 17:24:23.558360 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-90be664e-326b-4a62-92e1-8a7ab203bca0 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Going to run 1 instances... {{(pid=120416) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 17:24:23.563689 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-90be664e-326b-4a62-92e1-8a7ab203bca0 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9355bd92-0a49-42cd-b079-ff9f0d54b91b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120416) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 17:24:23.658594 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-90be664e-326b-4a62-92e1-8a7ab203bca0 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.245681 Sep 27 17:24:23.666376 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 30/48] 10.222.0.55 () {62 vars in 1188 bytes} [Tue Sep 27 17:24:21 2022] POST /compute/v2.1/servers => generated 401 bytes in 2255 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 27 17:24:23.682581 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-9935a416-5cc9-454d-b169-5c572b9a549a tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:23.686462 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-9935a416-5cc9-454d-b169-5c572b9a549a tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: d622d15d-b954-409c-a1f5-538da5de83db] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:24:23.931317 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-9935a416-5cc9-454d-b169-5c572b9a549a tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:23.957299 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-9935a416-5cc9-454d-b169-5c572b9a549a tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db" status: 200 len: 1221 microversion: 2.1 time: 0.271153 Sep 27 17:24:23.957956 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 31/49] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:24:23 2022] GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db => generated 1221 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:24:23.990940 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-fbce7685-412a-4545-9ba9-f54db47f2a24 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:23.992197 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-fbce7685-412a-4545-9ba9-f54db47f2a24 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:24:24.120890 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-094c302e-c604-4a44-b449-443ef8a6809f tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48c146c0bba4583a92d157e2eed7f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c16b9aaa5ac4e6dac613614c1a570c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:24.179289 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-094c302e-c604-4a44-b449-443ef8a6809f tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] 10.222.0.55 "GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669" status: 200 len: 1266 microversion: 2.1 time: 0.756446 Sep 27 17:24:24.182026 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 19/50] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:24:23 2022] GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669 => generated 1266 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:24:24.197923 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-fbce7685-412a-4545-9ba9-f54db47f2a24 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:24.209362 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-fbce7685-412a-4545-9ba9-f54db47f2a24 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:24.211208 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-fbce7685-412a-4545-9ba9-f54db47f2a24 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:24.212332 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-fbce7685-412a-4545-9ba9-f54db47f2a24 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1281 microversion: 2.20 time: 0.239196 Sep 27 17:24:24.213155 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 32/51] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:24:23 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1281 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:24:24.984272 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-48d7c84d-7e40-4ac0-a27e-3a9a570a2343 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:24.984890 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-48d7c84d-7e40-4ac0-a27e-3a9a570a2343 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: d622d15d-b954-409c-a1f5-538da5de83db] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:24:24.999575 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-48d7c84d-7e40-4ac0-a27e-3a9a570a2343 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:25.000080 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-48d7c84d-7e40-4ac0-a27e-3a9a570a2343 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:25.000524 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-48d7c84d-7e40-4ac0-a27e-3a9a570a2343 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:25.001363 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-48d7c84d-7e40-4ac0-a27e-3a9a570a2343 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:25.001862 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-48d7c84d-7e40-4ac0-a27e-3a9a570a2343 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:25.002350 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-48d7c84d-7e40-4ac0-a27e-3a9a570a2343 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:25.206973 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-7c0ff69b-0179-4dc0-9330-13f1d13e33f8 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:25.207690 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-7c0ff69b-0179-4dc0-9330-13f1d13e33f8 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] [instance: 0e6c9900-b294-45b0-a692-18ed9f943669] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:24:25.214677 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7c0ff69b-0179-4dc0-9330-13f1d13e33f8 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:25.215208 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7c0ff69b-0179-4dc0-9330-13f1d13e33f8 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:25.216164 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7c0ff69b-0179-4dc0-9330-13f1d13e33f8 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:25.216866 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7c0ff69b-0179-4dc0-9330-13f1d13e33f8 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:25.217322 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7c0ff69b-0179-4dc0-9330-13f1d13e33f8 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:25.217748 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7c0ff69b-0179-4dc0-9330-13f1d13e33f8 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:25.852840 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-48d7c84d-7e40-4ac0-a27e-3a9a570a2343 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:25.866782 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-48d7c84d-7e40-4ac0-a27e-3a9a570a2343 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db" status: 200 len: 1217 microversion: 2.1 time: 0.886644 Sep 27 17:24:25.877752 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 20/52] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:24:24 2022] GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db => generated 1217 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:24:25.892987 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-f78c7054-d47e-44a7-8ee3-8d7d7c63189f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:25.903504 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-f78c7054-d47e-44a7-8ee3-8d7d7c63189f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:24:25.940715 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f78c7054-d47e-44a7-8ee3-8d7d7c63189f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:25.943598 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f78c7054-d47e-44a7-8ee3-8d7d7c63189f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:25.944243 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f78c7054-d47e-44a7-8ee3-8d7d7c63189f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:25.945141 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f78c7054-d47e-44a7-8ee3-8d7d7c63189f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:25.945920 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f78c7054-d47e-44a7-8ee3-8d7d7c63189f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:25.949143 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f78c7054-d47e-44a7-8ee3-8d7d7c63189f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:26.109804 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-7c0ff69b-0179-4dc0-9330-13f1d13e33f8 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48c146c0bba4583a92d157e2eed7f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c16b9aaa5ac4e6dac613614c1a570c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:26.133998 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-7c0ff69b-0179-4dc0-9330-13f1d13e33f8 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] 10.222.0.55 "GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669" status: 200 len: 1272 microversion: 2.1 time: 0.930888 Sep 27 17:24:26.170955 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 33/53] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:24:25 2022] GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669 => generated 1272 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:24:26.435815 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-f78c7054-d47e-44a7-8ee3-8d7d7c63189f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:26.446574 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-f78c7054-d47e-44a7-8ee3-8d7d7c63189f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:26.455007 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-f78c7054-d47e-44a7-8ee3-8d7d7c63189f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:26.456557 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-f78c7054-d47e-44a7-8ee3-8d7d7c63189f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1333 microversion: 2.20 time: 0.577487 Sep 27 17:24:26.479427 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 21/54] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:24:25 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1333 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:24:26.899628 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-041f6a91-de28-479b-af38-c3499e642e6d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:26.900207 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-041f6a91-de28-479b-af38-c3499e642e6d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: d622d15d-b954-409c-a1f5-538da5de83db] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:24:26.911278 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-041f6a91-de28-479b-af38-c3499e642e6d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:26.917575 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-041f6a91-de28-479b-af38-c3499e642e6d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:26.919856 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-041f6a91-de28-479b-af38-c3499e642e6d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:26.931116 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-041f6a91-de28-479b-af38-c3499e642e6d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:26.933130 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-041f6a91-de28-479b-af38-c3499e642e6d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:26.937256 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-041f6a91-de28-479b-af38-c3499e642e6d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:27.202226 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-3ca531aa-dba3-4633-93df-b42523e7cd76 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:27.203903 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-3ca531aa-dba3-4633-93df-b42523e7cd76 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] [instance: 0e6c9900-b294-45b0-a692-18ed9f943669] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:24:27.239140 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3ca531aa-dba3-4633-93df-b42523e7cd76 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:27.257073 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3ca531aa-dba3-4633-93df-b42523e7cd76 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:27.259630 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3ca531aa-dba3-4633-93df-b42523e7cd76 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:27.285233 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3ca531aa-dba3-4633-93df-b42523e7cd76 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:27.285989 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3ca531aa-dba3-4633-93df-b42523e7cd76 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:27.286469 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3ca531aa-dba3-4633-93df-b42523e7cd76 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:28.098541 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-041f6a91-de28-479b-af38-c3499e642e6d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:28.107859 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-041f6a91-de28-479b-af38-c3499e642e6d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db" status: 200 len: 1279 microversion: 2.1 time: 1.212463 Sep 27 17:24:28.111240 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 34/55] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:24:26 2022] GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db => generated 1279 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:24:28.119097 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-a33be16b-1fba-4b2e-bca5-8eea247b0ade tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:28.119994 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-a33be16b-1fba-4b2e-bca5-8eea247b0ade tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:24:28.128298 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-3ca531aa-dba3-4633-93df-b42523e7cd76 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48c146c0bba4583a92d157e2eed7f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c16b9aaa5ac4e6dac613614c1a570c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:28.154900 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-3ca531aa-dba3-4633-93df-b42523e7cd76 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] 10.222.0.55 "GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669" status: 200 len: 1272 microversion: 2.1 time: 0.956320 Sep 27 17:24:28.155525 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 22/56] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:24:27 2022] GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669 => generated 1272 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:24:28.158783 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a33be16b-1fba-4b2e-bca5-8eea247b0ade tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:28.159221 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a33be16b-1fba-4b2e-bca5-8eea247b0ade tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:28.159774 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a33be16b-1fba-4b2e-bca5-8eea247b0ade tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:28.161843 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a33be16b-1fba-4b2e-bca5-8eea247b0ade tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:28.162901 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a33be16b-1fba-4b2e-bca5-8eea247b0ade tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:28.163338 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a33be16b-1fba-4b2e-bca5-8eea247b0ade tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:28.998253 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-a33be16b-1fba-4b2e-bca5-8eea247b0ade tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:29.029683 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-a33be16b-1fba-4b2e-bca5-8eea247b0ade tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:29.031768 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-a33be16b-1fba-4b2e-bca5-8eea247b0ade tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:29.033220 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-a33be16b-1fba-4b2e-bca5-8eea247b0ade tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1339 microversion: 2.20 time: 0.920747 Sep 27 17:24:29.050213 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 35/57] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:24:28 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1339 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:24:29.132986 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-c30eaf76-60d5-410f-890a-ecd8304d3501 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:29.133601 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-c30eaf76-60d5-410f-890a-ecd8304d3501 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: d622d15d-b954-409c-a1f5-538da5de83db] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:24:29.150171 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c30eaf76-60d5-410f-890a-ecd8304d3501 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:29.154058 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c30eaf76-60d5-410f-890a-ecd8304d3501 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:29.155379 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c30eaf76-60d5-410f-890a-ecd8304d3501 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:29.157260 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c30eaf76-60d5-410f-890a-ecd8304d3501 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:29.157736 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c30eaf76-60d5-410f-890a-ecd8304d3501 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:29.158205 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c30eaf76-60d5-410f-890a-ecd8304d3501 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:29.180283 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-edb09a2f-dbbf-4619-8492-d0cac9d4a184 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:29.180991 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-edb09a2f-dbbf-4619-8492-d0cac9d4a184 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] [instance: 0e6c9900-b294-45b0-a692-18ed9f943669] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:24:29.193126 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-edb09a2f-dbbf-4619-8492-d0cac9d4a184 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:29.193680 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-edb09a2f-dbbf-4619-8492-d0cac9d4a184 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:29.194054 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-edb09a2f-dbbf-4619-8492-d0cac9d4a184 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:29.197468 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-edb09a2f-dbbf-4619-8492-d0cac9d4a184 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:29.202502 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-edb09a2f-dbbf-4619-8492-d0cac9d4a184 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:29.203042 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-edb09a2f-dbbf-4619-8492-d0cac9d4a184 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:29.346606 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-c30eaf76-60d5-410f-890a-ecd8304d3501 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:29.362004 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-c30eaf76-60d5-410f-890a-ecd8304d3501 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db" status: 200 len: 1279 microversion: 2.1 time: 0.233202 Sep 27 17:24:29.371028 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 23/58] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:24:29 2022] GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db => generated 1279 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:24:29.382664 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-edb09a2f-dbbf-4619-8492-d0cac9d4a184 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48c146c0bba4583a92d157e2eed7f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c16b9aaa5ac4e6dac613614c1a570c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:29.396320 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-edb09a2f-dbbf-4619-8492-d0cac9d4a184 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] 10.222.0.55 "GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669" status: 200 len: 1272 microversion: 2.1 time: 0.220898 Sep 27 17:24:29.397509 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 36/59] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:24:29 2022] GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669 => generated 1272 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:24:29.680953 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [req-60c09158-6925-46e7-86ec-ea4da77e2684 req-59b64e1a-f5dc-41f7-8990-d5b042c29ce3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95a7693f-d1df-43fb-81e7-1c83b069e269", "tag": "c153b3a2-7878-4d7b-ac38-d30f63848b75"}]} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:24:29.697913 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-60c09158-6925-46e7-86ec-ea4da77e2684 req-59b64e1a-f5dc-41f7-8990-d5b042c29ce3 service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:29.698732 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-60c09158-6925-46e7-86ec-ea4da77e2684 req-59b64e1a-f5dc-41f7-8990-d5b042c29ce3 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:29.699367 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-60c09158-6925-46e7-86ec-ea4da77e2684 req-59b64e1a-f5dc-41f7-8990-d5b042c29ce3 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:29.734695 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.compute.server_external_events [req-60c09158-6925-46e7-86ec-ea4da77e2684 req-59b64e1a-f5dc-41f7-8990-d5b042c29ce3 service nova] Creating event network-changed:c153b3a2-7878-4d7b-ac38-d30f63848b75 for instance 95a7693f-d1df-43fb-81e7-1c83b069e269 on hv-cinder-84914 Sep 27 17:24:29.735506 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-60c09158-6925-46e7-86ec-ea4da77e2684 req-59b64e1a-f5dc-41f7-8990-d5b042c29ce3 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120415) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 27 17:24:29.736574 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-60c09158-6925-46e7-86ec-ea4da77e2684 req-59b64e1a-f5dc-41f7-8990-d5b042c29ce3 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120415) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 27 17:24:29.738999 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8003daca-36e8-459f-aca1-3a47639560db None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:29.739963 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8003daca-36e8-459f-aca1-3a47639560db None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:29.740655 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8003daca-36e8-459f-aca1-3a47639560db None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:29.741772 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8003daca-36e8-459f-aca1-3a47639560db None None] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:29.742757 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8003daca-36e8-459f-aca1-3a47639560db None None] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:29.743690 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8003daca-36e8-459f-aca1-3a47639560db None None] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:29.756852 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.compute.rpcapi [None req-8003daca-36e8-459f-aca1-3a47639560db None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 27 17:24:29.757894 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8003daca-36e8-459f-aca1-3a47639560db None None] Releasing lock "compute-rpcapi-router" {{(pid=120415) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 27 17:24:29.775360 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-8003daca-36e8-459f-aca1-3a47639560db None None] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.402165 Sep 27 17:24:29.777305 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 24/60] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:24:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:24:30.061541 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-79d9d2d4-d11c-4386-9420-28c3a4385b36 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:30.062518 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-79d9d2d4-d11c-4386-9420-28c3a4385b36 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:24:30.070158 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-79d9d2d4-d11c-4386-9420-28c3a4385b36 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:30.071267 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-79d9d2d4-d11c-4386-9420-28c3a4385b36 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:30.072064 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-79d9d2d4-d11c-4386-9420-28c3a4385b36 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:30.073225 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-79d9d2d4-d11c-4386-9420-28c3a4385b36 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:30.074003 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-79d9d2d4-d11c-4386-9420-28c3a4385b36 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:30.075326 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-79d9d2d4-d11c-4386-9420-28c3a4385b36 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:30.168115 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-79d9d2d4-d11c-4386-9420-28c3a4385b36 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:30.177891 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-79d9d2d4-d11c-4386-9420-28c3a4385b36 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:30.179424 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-79d9d2d4-d11c-4386-9420-28c3a4385b36 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:30.180575 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-79d9d2d4-d11c-4386-9420-28c3a4385b36 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1339 microversion: 2.20 time: 0.123550 Sep 27 17:24:30.190834 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 37/61] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:24:30 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1339 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:24:30.387129 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-49de2aa8-843f-4c81-ba5e-a26e555e4d3d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:30.387838 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-49de2aa8-843f-4c81-ba5e-a26e555e4d3d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: d622d15d-b954-409c-a1f5-538da5de83db] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:24:30.401536 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-49de2aa8-843f-4c81-ba5e-a26e555e4d3d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:30.402935 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-49de2aa8-843f-4c81-ba5e-a26e555e4d3d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:30.403725 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-49de2aa8-843f-4c81-ba5e-a26e555e4d3d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:30.406689 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-49de2aa8-843f-4c81-ba5e-a26e555e4d3d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:30.407393 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-49de2aa8-843f-4c81-ba5e-a26e555e4d3d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:30.408344 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-49de2aa8-843f-4c81-ba5e-a26e555e4d3d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:30.425277 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-3e63fb10-ef1d-4a14-a921-e6e34822ad82 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:30.425887 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-3e63fb10-ef1d-4a14-a921-e6e34822ad82 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] [instance: 0e6c9900-b294-45b0-a692-18ed9f943669] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:24:30.438857 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3e63fb10-ef1d-4a14-a921-e6e34822ad82 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:30.441656 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3e63fb10-ef1d-4a14-a921-e6e34822ad82 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:30.444948 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3e63fb10-ef1d-4a14-a921-e6e34822ad82 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:30.453000 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3e63fb10-ef1d-4a14-a921-e6e34822ad82 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:30.464118 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3e63fb10-ef1d-4a14-a921-e6e34822ad82 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:30.464912 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3e63fb10-ef1d-4a14-a921-e6e34822ad82 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:30.737637 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-49de2aa8-843f-4c81-ba5e-a26e555e4d3d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:30.754397 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-49de2aa8-843f-4c81-ba5e-a26e555e4d3d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db" status: 200 len: 1321 microversion: 2.1 time: 0.371655 Sep 27 17:24:30.755603 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 25/62] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:24:30 2022] GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db => generated 1321 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:24:30.804776 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-3e63fb10-ef1d-4a14-a921-e6e34822ad82 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48c146c0bba4583a92d157e2eed7f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c16b9aaa5ac4e6dac613614c1a570c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:30.824825 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-3e63fb10-ef1d-4a14-a921-e6e34822ad82 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] 10.222.0.55 "GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669" status: 200 len: 1314 microversion: 2.1 time: 0.403107 Sep 27 17:24:30.850492 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 38/63] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:24:30 2022] GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669 => generated 1314 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:24:31.210432 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-d0191070-0dc1-4d33-9594-7f86aa4a6c0a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:31.210432 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-d0191070-0dc1-4d33-9594-7f86aa4a6c0a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:24:31.218082 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d0191070-0dc1-4d33-9594-7f86aa4a6c0a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:31.218830 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d0191070-0dc1-4d33-9594-7f86aa4a6c0a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:31.219422 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d0191070-0dc1-4d33-9594-7f86aa4a6c0a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:31.220290 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d0191070-0dc1-4d33-9594-7f86aa4a6c0a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:31.221217 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d0191070-0dc1-4d33-9594-7f86aa4a6c0a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:31.221798 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d0191070-0dc1-4d33-9594-7f86aa4a6c0a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:31.333892 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-d0191070-0dc1-4d33-9594-7f86aa4a6c0a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:31.347533 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-d0191070-0dc1-4d33-9594-7f86aa4a6c0a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:31.350752 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-d0191070-0dc1-4d33-9594-7f86aa4a6c0a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:31.352685 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-d0191070-0dc1-4d33-9594-7f86aa4a6c0a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1339 microversion: 2.20 time: 0.149991 Sep 27 17:24:31.353874 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 26/64] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:24:31 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1339 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:24:31.782687 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-c2927bcb-deba-4fa6-9d96-99a42ed27655 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:31.784803 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-c2927bcb-deba-4fa6-9d96-99a42ed27655 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: d622d15d-b954-409c-a1f5-538da5de83db] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:24:31.792493 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c2927bcb-deba-4fa6-9d96-99a42ed27655 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:31.794584 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c2927bcb-deba-4fa6-9d96-99a42ed27655 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:31.795260 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c2927bcb-deba-4fa6-9d96-99a42ed27655 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:31.796659 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c2927bcb-deba-4fa6-9d96-99a42ed27655 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:31.797413 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c2927bcb-deba-4fa6-9d96-99a42ed27655 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:31.798474 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c2927bcb-deba-4fa6-9d96-99a42ed27655 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:31.857135 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-836bb90f-8779-49f8-b477-267c32fdb97e tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:31.859918 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-836bb90f-8779-49f8-b477-267c32fdb97e tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] [instance: 0e6c9900-b294-45b0-a692-18ed9f943669] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:24:31.895511 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-836bb90f-8779-49f8-b477-267c32fdb97e tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:31.898958 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-836bb90f-8779-49f8-b477-267c32fdb97e tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:31.899336 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-836bb90f-8779-49f8-b477-267c32fdb97e tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:31.905284 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-836bb90f-8779-49f8-b477-267c32fdb97e tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:31.912669 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-836bb90f-8779-49f8-b477-267c32fdb97e tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:31.913222 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-836bb90f-8779-49f8-b477-267c32fdb97e tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:32.124230 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-c2927bcb-deba-4fa6-9d96-99a42ed27655 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:32.133099 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-c2927bcb-deba-4fa6-9d96-99a42ed27655 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db" status: 200 len: 1321 microversion: 2.1 time: 0.355895 Sep 27 17:24:32.133678 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 39/65] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:24:31 2022] GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db => generated 1321 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:24:32.210487 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-836bb90f-8779-49f8-b477-267c32fdb97e tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48c146c0bba4583a92d157e2eed7f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c16b9aaa5ac4e6dac613614c1a570c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:32.222782 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-836bb90f-8779-49f8-b477-267c32fdb97e tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] 10.222.0.55 "GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669" status: 200 len: 1314 microversion: 2.1 time: 0.373998 Sep 27 17:24:32.240931 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 27/66] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:24:31 2022] GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669 => generated 1314 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:24:32.334392 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-156b17df-1bfd-4061-b019-94cbee61fef8 tempest-VolumesTestJSON-1592921641 tempest-VolumesTestJSON-1592921641-project] Calling method '.version_select at 0x7fe724e811f0>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:32.390020 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-630c69e0-e3a4-49fc-80cd-730800e234d7 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:32.392812 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-630c69e0-e3a4-49fc-80cd-730800e234d7 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:24:32.405422 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-156b17df-1bfd-4061-b019-94cbee61fef8 tempest-VolumesTestJSON-1592921641 tempest-VolumesTestJSON-1592921641-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/1d404c4f-c22a-48f8-9534-4ca00d39b7bf" status: 200 len: 351 microversion: 2.1 time: 0.075221 Sep 27 17:24:32.405984 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 40/67] 10.222.0.55 () {58 vars in 1245 bytes} [Tue Sep 27 17:24:32 2022] GET /compute/v2.1/os-volumes/1d404c4f-c22a-48f8-9534-4ca00d39b7bf => generated 351 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:24:32.409240 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-630c69e0-e3a4-49fc-80cd-730800e234d7 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:32.409717 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-630c69e0-e3a4-49fc-80cd-730800e234d7 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:32.413814 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-630c69e0-e3a4-49fc-80cd-730800e234d7 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:32.414254 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-630c69e0-e3a4-49fc-80cd-730800e234d7 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:32.414808 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-630c69e0-e3a4-49fc-80cd-730800e234d7 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:32.415245 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-630c69e0-e3a4-49fc-80cd-730800e234d7 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:32.538664 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-630c69e0-e3a4-49fc-80cd-730800e234d7 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:32.548916 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-630c69e0-e3a4-49fc-80cd-730800e234d7 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:32.557600 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-630c69e0-e3a4-49fc-80cd-730800e234d7 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:32.565660 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-630c69e0-e3a4-49fc-80cd-730800e234d7 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1339 microversion: 2.20 time: 0.187560 Sep 27 17:24:32.568917 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 28/68] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:24:32 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1339 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 17:24:33.155583 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-ff257b07-4f62-4f1c-b8e6-afd9bdcc997c tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:33.156186 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-ff257b07-4f62-4f1c-b8e6-afd9bdcc997c tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: d622d15d-b954-409c-a1f5-538da5de83db] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:24:33.162513 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ff257b07-4f62-4f1c-b8e6-afd9bdcc997c tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:33.163159 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ff257b07-4f62-4f1c-b8e6-afd9bdcc997c tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:33.163590 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ff257b07-4f62-4f1c-b8e6-afd9bdcc997c tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:33.164268 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ff257b07-4f62-4f1c-b8e6-afd9bdcc997c tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:33.164713 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ff257b07-4f62-4f1c-b8e6-afd9bdcc997c tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:33.165129 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ff257b07-4f62-4f1c-b8e6-afd9bdcc997c tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:33.250021 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-5874d811-d90b-4306-ad68-bba914803e0a tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:33.251450 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-5874d811-d90b-4306-ad68-bba914803e0a tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] [instance: 0e6c9900-b294-45b0-a692-18ed9f943669] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:24:33.253813 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell0:SELECT=16 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:33.260970 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5874d811-d90b-4306-ad68-bba914803e0a tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:33.261644 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5874d811-d90b-4306-ad68-bba914803e0a tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:33.262878 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5874d811-d90b-4306-ad68-bba914803e0a tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:33.263607 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5874d811-d90b-4306-ad68-bba914803e0a tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:33.265063 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5874d811-d90b-4306-ad68-bba914803e0a tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:33.265501 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5874d811-d90b-4306-ad68-bba914803e0a tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:33.505599 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_cell0:SELECT=4 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:33.541650 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-ff257b07-4f62-4f1c-b8e6-afd9bdcc997c tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:33.549304 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-ff257b07-4f62-4f1c-b8e6-afd9bdcc997c tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db" status: 200 len: 1321 microversion: 2.1 time: 0.397618 Sep 27 17:24:33.549872 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 41/69] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:24:33 2022] GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db => generated 1321 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:24:33.576783 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-5874d811-d90b-4306-ad68-bba914803e0a tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48c146c0bba4583a92d157e2eed7f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c16b9aaa5ac4e6dac613614c1a570c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:33.584433 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-5874d811-d90b-4306-ad68-bba914803e0a tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] 10.222.0.55 "GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669" status: 200 len: 1314 microversion: 2.1 time: 0.339174 Sep 27 17:24:33.585017 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 29/70] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:24:33 2022] GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669 => generated 1314 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:24:33.605483 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-6b7eedcb-8234-4b13-8e24-358b5094ae9e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:33.606899 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-6b7eedcb-8234-4b13-8e24-358b5094ae9e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:24:33.612844 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6b7eedcb-8234-4b13-8e24-358b5094ae9e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:33.613397 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6b7eedcb-8234-4b13-8e24-358b5094ae9e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:33.613925 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6b7eedcb-8234-4b13-8e24-358b5094ae9e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:33.614715 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6b7eedcb-8234-4b13-8e24-358b5094ae9e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:33.615278 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6b7eedcb-8234-4b13-8e24-358b5094ae9e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:33.615781 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6b7eedcb-8234-4b13-8e24-358b5094ae9e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:33.686951 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-6b7eedcb-8234-4b13-8e24-358b5094ae9e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:33.702982 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-6b7eedcb-8234-4b13-8e24-358b5094ae9e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:33.704524 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-6b7eedcb-8234-4b13-8e24-358b5094ae9e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:33.705787 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-6b7eedcb-8234-4b13-8e24-358b5094ae9e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1339 microversion: 2.20 time: 0.104513 Sep 27 17:24:33.706452 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 42/71] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:24:33 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1339 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:24:34.571172 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-52c8b0af-d669-459a-90ee-8d2f55d6bbef tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:34.571777 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-52c8b0af-d669-459a-90ee-8d2f55d6bbef tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: d622d15d-b954-409c-a1f5-538da5de83db] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:24:34.580206 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-52c8b0af-d669-459a-90ee-8d2f55d6bbef tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:34.580876 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-52c8b0af-d669-459a-90ee-8d2f55d6bbef tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:34.581298 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-52c8b0af-d669-459a-90ee-8d2f55d6bbef tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:34.582168 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-52c8b0af-d669-459a-90ee-8d2f55d6bbef tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:34.582619 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-52c8b0af-d669-459a-90ee-8d2f55d6bbef tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:34.583033 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-52c8b0af-d669-459a-90ee-8d2f55d6bbef tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:34.608983 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-650d43e6-5bb8-48ab-8e1e-40ad4af45396 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:34.609735 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-650d43e6-5bb8-48ab-8e1e-40ad4af45396 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] [instance: 0e6c9900-b294-45b0-a692-18ed9f943669] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:24:34.614994 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_cell0:SELECT=20 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:34.618571 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-650d43e6-5bb8-48ab-8e1e-40ad4af45396 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:34.619232 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-650d43e6-5bb8-48ab-8e1e-40ad4af45396 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:34.621051 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-650d43e6-5bb8-48ab-8e1e-40ad4af45396 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:34.622565 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-650d43e6-5bb8-48ab-8e1e-40ad4af45396 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:34.623153 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-650d43e6-5bb8-48ab-8e1e-40ad4af45396 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:34.623714 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-650d43e6-5bb8-48ab-8e1e-40ad4af45396 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:34.813194 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-52c8b0af-d669-459a-90ee-8d2f55d6bbef tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:34.823467 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-52c8b0af-d669-459a-90ee-8d2f55d6bbef tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db" status: 200 len: 1321 microversion: 2.1 time: 0.255820 Sep 27 17:24:34.825680 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 30/72] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:24:34 2022] GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db => generated 1321 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:24:34.834381 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-ee7c19c3-afbd-4254-8db3-471ffd2baf20 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:34.835293 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-ee7c19c3-afbd-4254-8db3-471ffd2baf20 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:24:34.847874 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ee7c19c3-afbd-4254-8db3-471ffd2baf20 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:34.849995 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ee7c19c3-afbd-4254-8db3-471ffd2baf20 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:34.851710 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ee7c19c3-afbd-4254-8db3-471ffd2baf20 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:34.852781 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ee7c19c3-afbd-4254-8db3-471ffd2baf20 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:34.853821 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ee7c19c3-afbd-4254-8db3-471ffd2baf20 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:34.853932 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-650d43e6-5bb8-48ab-8e1e-40ad4af45396 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48c146c0bba4583a92d157e2eed7f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c16b9aaa5ac4e6dac613614c1a570c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:34.854931 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ee7c19c3-afbd-4254-8db3-471ffd2baf20 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:34.863961 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-650d43e6-5bb8-48ab-8e1e-40ad4af45396 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] 10.222.0.55 "GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669" status: 200 len: 1314 microversion: 2.1 time: 0.260115 Sep 27 17:24:34.864803 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 43/73] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:24:34 2022] GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669 => generated 1314 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:24:34.930521 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-ee7c19c3-afbd-4254-8db3-471ffd2baf20 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:34.940014 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-ee7c19c3-afbd-4254-8db3-471ffd2baf20 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:34.942153 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-ee7c19c3-afbd-4254-8db3-471ffd2baf20 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:34.943427 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-ee7c19c3-afbd-4254-8db3-471ffd2baf20 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1339 microversion: 2.20 time: 0.116264 Sep 27 17:24:34.943985 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 31/74] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:24:34 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1339 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:24:35.848470 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-38a435c0-418e-4496-9820-84f2d1b8ac05 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:35.849085 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-38a435c0-418e-4496-9820-84f2d1b8ac05 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: d622d15d-b954-409c-a1f5-538da5de83db] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:24:35.854957 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-38a435c0-418e-4496-9820-84f2d1b8ac05 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:35.856202 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-38a435c0-418e-4496-9820-84f2d1b8ac05 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:35.856637 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-38a435c0-418e-4496-9820-84f2d1b8ac05 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:35.857334 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-38a435c0-418e-4496-9820-84f2d1b8ac05 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:35.857899 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-38a435c0-418e-4496-9820-84f2d1b8ac05 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:35.858224 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-38a435c0-418e-4496-9820-84f2d1b8ac05 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:35.888446 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-841b833d-20b1-4163-a933-1c9793668f86 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:35.890688 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-841b833d-20b1-4163-a933-1c9793668f86 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] [instance: 0e6c9900-b294-45b0-a692-18ed9f943669] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:24:35.897414 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-841b833d-20b1-4163-a933-1c9793668f86 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:35.898182 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-841b833d-20b1-4163-a933-1c9793668f86 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:35.898624 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-841b833d-20b1-4163-a933-1c9793668f86 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:35.899325 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-841b833d-20b1-4163-a933-1c9793668f86 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:35.899780 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-841b833d-20b1-4163-a933-1c9793668f86 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:35.900202 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-841b833d-20b1-4163-a933-1c9793668f86 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:36.067151 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-38a435c0-418e-4496-9820-84f2d1b8ac05 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:36.075998 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-38a435c0-418e-4496-9820-84f2d1b8ac05 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db" status: 200 len: 1321 microversion: 2.1 time: 0.231259 Sep 27 17:24:36.076815 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 44/75] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:24:35 2022] GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db => generated 1321 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:24:36.081881 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-63b76137-958c-4e54-bdf6-c42bcfab2b84 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:36.082584 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-63b76137-958c-4e54-bdf6-c42bcfab2b84 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:24:36.088916 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-63b76137-958c-4e54-bdf6-c42bcfab2b84 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:36.089473 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-63b76137-958c-4e54-bdf6-c42bcfab2b84 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:36.090560 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-63b76137-958c-4e54-bdf6-c42bcfab2b84 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:36.091473 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-63b76137-958c-4e54-bdf6-c42bcfab2b84 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:36.091954 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-841b833d-20b1-4163-a933-1c9793668f86 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48c146c0bba4583a92d157e2eed7f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c16b9aaa5ac4e6dac613614c1a570c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:36.092085 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-63b76137-958c-4e54-bdf6-c42bcfab2b84 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:36.092488 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-63b76137-958c-4e54-bdf6-c42bcfab2b84 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:36.099761 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-841b833d-20b1-4163-a933-1c9793668f86 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] 10.222.0.55 "GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669" status: 200 len: 1314 microversion: 2.1 time: 0.216001 Sep 27 17:24:36.100334 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 32/76] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:24:35 2022] GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669 => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:24:36.164442 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-63b76137-958c-4e54-bdf6-c42bcfab2b84 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:36.173617 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-63b76137-958c-4e54-bdf6-c42bcfab2b84 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:36.176107 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-63b76137-958c-4e54-bdf6-c42bcfab2b84 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:36.177513 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-63b76137-958c-4e54-bdf6-c42bcfab2b84 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1339 microversion: 2.20 time: 0.099444 Sep 27 17:24:36.178063 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 45/77] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:24:36 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1339 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:24:37.106754 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-126f8b83-98d0-4bb1-9df9-d401f62b55dc tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:37.106754 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-126f8b83-98d0-4bb1-9df9-d401f62b55dc tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: d622d15d-b954-409c-a1f5-538da5de83db] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:24:37.108797 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-126f8b83-98d0-4bb1-9df9-d401f62b55dc tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:37.110170 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-126f8b83-98d0-4bb1-9df9-d401f62b55dc tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:37.112547 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-126f8b83-98d0-4bb1-9df9-d401f62b55dc tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:37.113523 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-126f8b83-98d0-4bb1-9df9-d401f62b55dc tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:37.114150 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-126f8b83-98d0-4bb1-9df9-d401f62b55dc tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:37.114743 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-126f8b83-98d0-4bb1-9df9-d401f62b55dc tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:37.123853 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-9f803bdd-1f8f-4ae8-b5f1-bff48c8616c1 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:37.124550 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-9f803bdd-1f8f-4ae8-b5f1-bff48c8616c1 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] [instance: 0e6c9900-b294-45b0-a692-18ed9f943669] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:24:37.131328 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9f803bdd-1f8f-4ae8-b5f1-bff48c8616c1 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:37.132253 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9f803bdd-1f8f-4ae8-b5f1-bff48c8616c1 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:37.132668 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9f803bdd-1f8f-4ae8-b5f1-bff48c8616c1 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:37.133682 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9f803bdd-1f8f-4ae8-b5f1-bff48c8616c1 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:37.134088 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9f803bdd-1f8f-4ae8-b5f1-bff48c8616c1 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:37.134798 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9f803bdd-1f8f-4ae8-b5f1-bff48c8616c1 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:37.381298 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-9f803bdd-1f8f-4ae8-b5f1-bff48c8616c1 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48c146c0bba4583a92d157e2eed7f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c16b9aaa5ac4e6dac613614c1a570c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:37.383551 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-126f8b83-98d0-4bb1-9df9-d401f62b55dc tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:37.391280 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-9f803bdd-1f8f-4ae8-b5f1-bff48c8616c1 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] 10.222.0.55 "GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669" status: 200 len: 1314 microversion: 2.1 time: 0.271518 Sep 27 17:24:37.392017 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 46/78] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:24:37 2022] GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669 => generated 1314 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:24:37.398275 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-126f8b83-98d0-4bb1-9df9-d401f62b55dc tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db" status: 200 len: 1321 microversion: 2.1 time: 0.295857 Sep 27 17:24:37.398275 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 33/79] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:24:37 2022] GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db => generated 1321 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:24:37.398275 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-8ca8f9a2-89ca-4949-9b52-a89696d2e2e4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:37.398901 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-8ca8f9a2-89ca-4949-9b52-a89696d2e2e4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:24:37.404587 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8ca8f9a2-89ca-4949-9b52-a89696d2e2e4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:37.405062 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8ca8f9a2-89ca-4949-9b52-a89696d2e2e4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:37.405494 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8ca8f9a2-89ca-4949-9b52-a89696d2e2e4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:37.406206 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8ca8f9a2-89ca-4949-9b52-a89696d2e2e4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:37.407052 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8ca8f9a2-89ca-4949-9b52-a89696d2e2e4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:37.407649 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8ca8f9a2-89ca-4949-9b52-a89696d2e2e4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:37.471547 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-8ca8f9a2-89ca-4949-9b52-a89696d2e2e4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:37.479944 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-8ca8f9a2-89ca-4949-9b52-a89696d2e2e4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:37.481735 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-8ca8f9a2-89ca-4949-9b52-a89696d2e2e4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:37.482861 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-8ca8f9a2-89ca-4949-9b52-a89696d2e2e4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1339 microversion: 2.20 time: 0.088490 Sep 27 17:24:37.483401 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 34/80] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:24:37 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1339 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:24:38.415943 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-373c2253-a689-48a0-8c59-d8a559f38a0f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:38.416558 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-373c2253-a689-48a0-8c59-d8a559f38a0f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: d622d15d-b954-409c-a1f5-538da5de83db] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:24:38.420011 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-d4f1db17-9743-439a-8e37-86587291730a tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:38.420719 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-d4f1db17-9743-439a-8e37-86587291730a tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] [instance: 0e6c9900-b294-45b0-a692-18ed9f943669] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:24:38.422828 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-373c2253-a689-48a0-8c59-d8a559f38a0f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:38.423303 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-373c2253-a689-48a0-8c59-d8a559f38a0f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:38.423727 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-373c2253-a689-48a0-8c59-d8a559f38a0f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:38.424415 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-373c2253-a689-48a0-8c59-d8a559f38a0f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:38.424887 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-373c2253-a689-48a0-8c59-d8a559f38a0f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:38.425575 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-373c2253-a689-48a0-8c59-d8a559f38a0f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:38.427335 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d4f1db17-9743-439a-8e37-86587291730a tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:38.427820 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d4f1db17-9743-439a-8e37-86587291730a tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:38.428256 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d4f1db17-9743-439a-8e37-86587291730a tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:38.428992 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d4f1db17-9743-439a-8e37-86587291730a tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:38.429658 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d4f1db17-9743-439a-8e37-86587291730a tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:38.430134 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d4f1db17-9743-439a-8e37-86587291730a tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:38.436130 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell1:SELECT=100 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:38.624373 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-373c2253-a689-48a0-8c59-d8a559f38a0f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:38.635371 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-373c2253-a689-48a0-8c59-d8a559f38a0f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db" status: 200 len: 1321 microversion: 2.1 time: 0.224151 Sep 27 17:24:38.647441 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-d4f1db17-9743-439a-8e37-86587291730a tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48c146c0bba4583a92d157e2eed7f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c16b9aaa5ac4e6dac613614c1a570c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:38.661530 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 47/81] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:24:38 2022] GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db => generated 1321 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:24:38.663799 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-d4f1db17-9743-439a-8e37-86587291730a tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] 10.222.0.55 "GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669" status: 200 len: 1314 microversion: 2.1 time: 0.242790 Sep 27 17:24:38.678511 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 35/82] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:24:38 2022] GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669 => generated 1314 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:24:38.685066 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-5c689ab9-aeed-4165-be69-689651d4cd4e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:38.685680 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-5c689ab9-aeed-4165-be69-689651d4cd4e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:24:38.692863 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5c689ab9-aeed-4165-be69-689651d4cd4e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:38.693352 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5c689ab9-aeed-4165-be69-689651d4cd4e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:38.694395 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5c689ab9-aeed-4165-be69-689651d4cd4e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:38.695455 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5c689ab9-aeed-4165-be69-689651d4cd4e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:38.695979 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5c689ab9-aeed-4165-be69-689651d4cd4e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:38.696398 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5c689ab9-aeed-4165-be69-689651d4cd4e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:38.779692 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-5c689ab9-aeed-4165-be69-689651d4cd4e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:38.785009 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-5c689ab9-aeed-4165-be69-689651d4cd4e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:38.786794 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-5c689ab9-aeed-4165-be69-689651d4cd4e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:38.788231 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-5c689ab9-aeed-4165-be69-689651d4cd4e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1339 microversion: 2.20 time: 0.122866 Sep 27 17:24:38.789329 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 48/83] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:24:38 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1339 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:24:39.660681 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-f3dea34f-0b83-490c-a4bd-d410649bd24e tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:39.661288 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-f3dea34f-0b83-490c-a4bd-d410649bd24e tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: d622d15d-b954-409c-a1f5-538da5de83db] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:24:39.667189 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f3dea34f-0b83-490c-a4bd-d410649bd24e tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:39.667666 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f3dea34f-0b83-490c-a4bd-d410649bd24e tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:39.668131 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f3dea34f-0b83-490c-a4bd-d410649bd24e tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:39.668815 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f3dea34f-0b83-490c-a4bd-d410649bd24e tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:39.669267 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f3dea34f-0b83-490c-a4bd-d410649bd24e tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:39.669688 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f3dea34f-0b83-490c-a4bd-d410649bd24e tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:39.687600 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-362ef762-8b10-43be-a391-dd1fcb88614e tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:39.688838 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-362ef762-8b10-43be-a391-dd1fcb88614e tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] [instance: 0e6c9900-b294-45b0-a692-18ed9f943669] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:24:39.696801 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-362ef762-8b10-43be-a391-dd1fcb88614e tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:39.697524 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-362ef762-8b10-43be-a391-dd1fcb88614e tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:39.698232 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-362ef762-8b10-43be-a391-dd1fcb88614e tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:39.699087 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-362ef762-8b10-43be-a391-dd1fcb88614e tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:39.700295 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-362ef762-8b10-43be-a391-dd1fcb88614e tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:39.700858 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-362ef762-8b10-43be-a391-dd1fcb88614e tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:39.754303 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell0:SELECT=6 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:39.880245 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-f3dea34f-0b83-490c-a4bd-d410649bd24e tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:39.882325 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-362ef762-8b10-43be-a391-dd1fcb88614e tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48c146c0bba4583a92d157e2eed7f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c16b9aaa5ac4e6dac613614c1a570c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:39.885696 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_cell1:SELECT=100 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:39.890033 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-f3dea34f-0b83-490c-a4bd-d410649bd24e tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db" status: 200 len: 1321 microversion: 2.1 time: 0.232992 Sep 27 17:24:39.900604 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-362ef762-8b10-43be-a391-dd1fcb88614e tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] 10.222.0.55 "GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669" status: 200 len: 1314 microversion: 2.1 time: 0.208149 Sep 27 17:24:39.900604 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 49/84] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:24:39 2022] GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669 => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:24:39.900604 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-7af6f955-7ae9-4a14-a5a3-71d45e623750 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:39.900604 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-7af6f955-7ae9-4a14-a5a3-71d45e623750 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:24:39.904934 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7af6f955-7ae9-4a14-a5a3-71d45e623750 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:39.905836 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7af6f955-7ae9-4a14-a5a3-71d45e623750 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:39.906820 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7af6f955-7ae9-4a14-a5a3-71d45e623750 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:39.908045 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 36/85] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:24:39 2022] GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db => generated 1321 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:24:39.908769 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7af6f955-7ae9-4a14-a5a3-71d45e623750 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:39.910225 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7af6f955-7ae9-4a14-a5a3-71d45e623750 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:39.911096 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7af6f955-7ae9-4a14-a5a3-71d45e623750 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:39.981195 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-7af6f955-7ae9-4a14-a5a3-71d45e623750 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:39.990542 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-7af6f955-7ae9-4a14-a5a3-71d45e623750 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:39.992143 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-7af6f955-7ae9-4a14-a5a3-71d45e623750 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:39.993240 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-7af6f955-7ae9-4a14-a5a3-71d45e623750 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1339 microversion: 2.20 time: 0.099981 Sep 27 17:24:39.993871 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 50/86] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:24:39 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1339 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:24:40.915769 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-1fdab089-7d17-491a-a6b0-9ddc3e7078ee tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:40.916625 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-1fdab089-7d17-491a-a6b0-9ddc3e7078ee tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: d622d15d-b954-409c-a1f5-538da5de83db] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:24:40.923093 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1fdab089-7d17-491a-a6b0-9ddc3e7078ee tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:40.923865 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1fdab089-7d17-491a-a6b0-9ddc3e7078ee tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:40.924303 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1fdab089-7d17-491a-a6b0-9ddc3e7078ee tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:40.925003 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1fdab089-7d17-491a-a6b0-9ddc3e7078ee tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:40.925586 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1fdab089-7d17-491a-a6b0-9ddc3e7078ee tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:40.926008 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1fdab089-7d17-491a-a6b0-9ddc3e7078ee tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:40.928962 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-b5ac2fed-5f88-49a2-892d-8e953aa5dbca tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:40.929637 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-b5ac2fed-5f88-49a2-892d-8e953aa5dbca tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] [instance: 0e6c9900-b294-45b0-a692-18ed9f943669] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:24:40.936273 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b5ac2fed-5f88-49a2-892d-8e953aa5dbca tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:40.936760 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b5ac2fed-5f88-49a2-892d-8e953aa5dbca tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:40.937192 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b5ac2fed-5f88-49a2-892d-8e953aa5dbca tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:40.937899 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b5ac2fed-5f88-49a2-892d-8e953aa5dbca tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:40.941000 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b5ac2fed-5f88-49a2-892d-8e953aa5dbca tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:40.941458 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b5ac2fed-5f88-49a2-892d-8e953aa5dbca tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:41.193458 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-b5ac2fed-5f88-49a2-892d-8e953aa5dbca tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48c146c0bba4583a92d157e2eed7f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c16b9aaa5ac4e6dac613614c1a570c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:41.204871 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-b5ac2fed-5f88-49a2-892d-8e953aa5dbca tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] 10.222.0.55 "GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669" status: 200 len: 1314 microversion: 2.1 time: 0.279761 Sep 27 17:24:41.207166 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 51/87] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:24:40 2022] GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669 => generated 1314 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:24:41.211742 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-1fdab089-7d17-491a-a6b0-9ddc3e7078ee tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:41.215784 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-9499f087-f3af-4bb2-a941-06c7618425a4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:41.222243 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-1fdab089-7d17-491a-a6b0-9ddc3e7078ee tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db" status: 200 len: 1321 microversion: 2.1 time: 0.309868 Sep 27 17:24:41.223028 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-9499f087-f3af-4bb2-a941-06c7618425a4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:24:41.234791 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 37/88] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:24:40 2022] GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db => generated 1321 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:24:41.236546 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9499f087-f3af-4bb2-a941-06c7618425a4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:41.237319 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9499f087-f3af-4bb2-a941-06c7618425a4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:41.238969 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9499f087-f3af-4bb2-a941-06c7618425a4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:41.241492 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9499f087-f3af-4bb2-a941-06c7618425a4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:41.242023 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9499f087-f3af-4bb2-a941-06c7618425a4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:41.242545 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9499f087-f3af-4bb2-a941-06c7618425a4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:41.350012 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-9499f087-f3af-4bb2-a941-06c7618425a4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:41.362698 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-9499f087-f3af-4bb2-a941-06c7618425a4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:41.364354 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-9499f087-f3af-4bb2-a941-06c7618425a4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:41.365672 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-9499f087-f3af-4bb2-a941-06c7618425a4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1339 microversion: 2.20 time: 0.154264 Sep 27 17:24:41.366910 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 52/89] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:24:41 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1339 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:24:42.237652 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-929e4fda-9066-4aa4-bad2-73cdfd044a54 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:42.238349 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-929e4fda-9066-4aa4-bad2-73cdfd044a54 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] [instance: 0e6c9900-b294-45b0-a692-18ed9f943669] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:24:42.246293 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-a58f5ab3-9608-4657-942a-e29856aca9cd tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:42.246985 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-a58f5ab3-9608-4657-942a-e29856aca9cd tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: d622d15d-b954-409c-a1f5-538da5de83db] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:24:42.248489 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-929e4fda-9066-4aa4-bad2-73cdfd044a54 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:42.248979 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-929e4fda-9066-4aa4-bad2-73cdfd044a54 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:42.249412 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-929e4fda-9066-4aa4-bad2-73cdfd044a54 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:42.250132 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-929e4fda-9066-4aa4-bad2-73cdfd044a54 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:42.250590 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-929e4fda-9066-4aa4-bad2-73cdfd044a54 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:42.251039 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-929e4fda-9066-4aa4-bad2-73cdfd044a54 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:42.252940 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=6 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:42.255261 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a58f5ab3-9608-4657-942a-e29856aca9cd tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:42.255999 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a58f5ab3-9608-4657-942a-e29856aca9cd tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:42.257036 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a58f5ab3-9608-4657-942a-e29856aca9cd tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:42.257586 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a58f5ab3-9608-4657-942a-e29856aca9cd tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:42.258145 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a58f5ab3-9608-4657-942a-e29856aca9cd tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:42.258643 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a58f5ab3-9608-4657-942a-e29856aca9cd tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:42.462317 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-929e4fda-9066-4aa4-bad2-73cdfd044a54 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48c146c0bba4583a92d157e2eed7f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c16b9aaa5ac4e6dac613614c1a570c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:42.471464 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-929e4fda-9066-4aa4-bad2-73cdfd044a54 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] 10.222.0.55 "GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669" status: 200 len: 1314 microversion: 2.1 time: 0.237612 Sep 27 17:24:42.472805 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 38/90] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:24:42 2022] GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669 => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:24:42.478561 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-abdc8df0-c153-49ef-a29c-d71685767f6b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:42.479769 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-abdc8df0-c153-49ef-a29c-d71685767f6b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:24:42.488982 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-abdc8df0-c153-49ef-a29c-d71685767f6b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:42.489526 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-abdc8df0-c153-49ef-a29c-d71685767f6b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:42.490234 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-abdc8df0-c153-49ef-a29c-d71685767f6b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:42.491040 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-abdc8df0-c153-49ef-a29c-d71685767f6b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:42.492588 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-a58f5ab3-9608-4657-942a-e29856aca9cd tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:42.494410 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-abdc8df0-c153-49ef-a29c-d71685767f6b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:42.495028 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-abdc8df0-c153-49ef-a29c-d71685767f6b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:42.500545 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-a58f5ab3-9608-4657-942a-e29856aca9cd tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db" status: 200 len: 1321 microversion: 2.1 time: 0.258356 Sep 27 17:24:42.501111 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 53/91] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:24:42 2022] GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db => generated 1321 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:24:42.564505 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-abdc8df0-c153-49ef-a29c-d71685767f6b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:42.572907 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-abdc8df0-c153-49ef-a29c-d71685767f6b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:42.574501 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-abdc8df0-c153-49ef-a29c-d71685767f6b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:42.575627 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-abdc8df0-c153-49ef-a29c-d71685767f6b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1339 microversion: 2.20 time: 0.101496 Sep 27 17:24:42.576179 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 39/92] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:24:42 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1339 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:24:43.498861 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-db51af67-8304-4139-a567-adc8daf3c031 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:43.499481 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-db51af67-8304-4139-a567-adc8daf3c031 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] [instance: 0e6c9900-b294-45b0-a692-18ed9f943669] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:24:43.505291 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-db51af67-8304-4139-a567-adc8daf3c031 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:43.505770 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-db51af67-8304-4139-a567-adc8daf3c031 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:43.506254 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-db51af67-8304-4139-a567-adc8daf3c031 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:43.506940 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-db51af67-8304-4139-a567-adc8daf3c031 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:43.507398 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-db51af67-8304-4139-a567-adc8daf3c031 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:43.507819 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-db51af67-8304-4139-a567-adc8daf3c031 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:43.525143 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-b3eb8df6-e32c-4b52-ab2b-1caff8a23e51 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:43.525777 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-b3eb8df6-e32c-4b52-ab2b-1caff8a23e51 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: d622d15d-b954-409c-a1f5-538da5de83db] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:24:43.529285 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=7 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:43.532885 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b3eb8df6-e32c-4b52-ab2b-1caff8a23e51 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:43.533384 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b3eb8df6-e32c-4b52-ab2b-1caff8a23e51 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:43.533811 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b3eb8df6-e32c-4b52-ab2b-1caff8a23e51 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:43.534519 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b3eb8df6-e32c-4b52-ab2b-1caff8a23e51 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:43.534961 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b3eb8df6-e32c-4b52-ab2b-1caff8a23e51 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:43.535379 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b3eb8df6-e32c-4b52-ab2b-1caff8a23e51 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:43.708780 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-db51af67-8304-4139-a567-adc8daf3c031 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48c146c0bba4583a92d157e2eed7f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c16b9aaa5ac4e6dac613614c1a570c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:43.712838 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-b3eb8df6-e32c-4b52-ab2b-1caff8a23e51 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:43.716801 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-db51af67-8304-4139-a567-adc8daf3c031 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] 10.222.0.55 "GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669" status: 200 len: 1314 microversion: 2.1 time: 0.222017 Sep 27 17:24:43.717395 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 54/93] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:24:43 2022] GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:24:43.720897 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-b3eb8df6-e32c-4b52-ab2b-1caff8a23e51 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db" status: 200 len: 1321 microversion: 2.1 time: 0.199832 Sep 27 17:24:43.721610 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 40/94] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:24:43 2022] GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db => generated 1321 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:24:43.721877 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-e3418aa1-37bf-4c52-a570-a63bfbbd1199 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:43.722497 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-e3418aa1-37bf-4c52-a570-a63bfbbd1199 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:24:43.728136 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e3418aa1-37bf-4c52-a570-a63bfbbd1199 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:43.728604 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e3418aa1-37bf-4c52-a570-a63bfbbd1199 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:43.729033 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e3418aa1-37bf-4c52-a570-a63bfbbd1199 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:43.729706 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e3418aa1-37bf-4c52-a570-a63bfbbd1199 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:43.730439 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e3418aa1-37bf-4c52-a570-a63bfbbd1199 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:43.731445 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e3418aa1-37bf-4c52-a570-a63bfbbd1199 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:43.790035 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-e3418aa1-37bf-4c52-a570-a63bfbbd1199 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:43.798620 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-e3418aa1-37bf-4c52-a570-a63bfbbd1199 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:43.800055 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-e3418aa1-37bf-4c52-a570-a63bfbbd1199 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:43.801131 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-e3418aa1-37bf-4c52-a570-a63bfbbd1199 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1339 microversion: 2.20 time: 0.082816 Sep 27 17:24:43.801676 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 55/95] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:24:43 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1339 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:24:44.740002 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-e2acedae-73c6-40d9-9448-a20670b49218 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:44.740611 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-e2acedae-73c6-40d9-9448-a20670b49218 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] [instance: 0e6c9900-b294-45b0-a692-18ed9f943669] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:24:44.744486 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-f9f30ce7-d71e-49b2-a024-3fddad2add32 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:44.745145 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-f9f30ce7-d71e-49b2-a024-3fddad2add32 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: d622d15d-b954-409c-a1f5-538da5de83db] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:24:44.747188 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e2acedae-73c6-40d9-9448-a20670b49218 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:44.747663 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e2acedae-73c6-40d9-9448-a20670b49218 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:44.748088 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e2acedae-73c6-40d9-9448-a20670b49218 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:44.748767 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e2acedae-73c6-40d9-9448-a20670b49218 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:44.749211 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e2acedae-73c6-40d9-9448-a20670b49218 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:44.749622 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e2acedae-73c6-40d9-9448-a20670b49218 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:44.751830 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f9f30ce7-d71e-49b2-a024-3fddad2add32 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:44.752308 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f9f30ce7-d71e-49b2-a024-3fddad2add32 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:44.752741 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f9f30ce7-d71e-49b2-a024-3fddad2add32 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:44.753430 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f9f30ce7-d71e-49b2-a024-3fddad2add32 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:44.753882 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f9f30ce7-d71e-49b2-a024-3fddad2add32 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:44.754332 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f9f30ce7-d71e-49b2-a024-3fddad2add32 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:44.937701 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-e2acedae-73c6-40d9-9448-a20670b49218 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48c146c0bba4583a92d157e2eed7f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c16b9aaa5ac4e6dac613614c1a570c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:44.941961 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-f9f30ce7-d71e-49b2-a024-3fddad2add32 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:44.945318 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-e2acedae-73c6-40d9-9448-a20670b49218 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] 10.222.0.55 "GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669" status: 200 len: 1314 microversion: 2.1 time: 0.209172 Sep 27 17:24:44.945890 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 41/96] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:24:44 2022] GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669 => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:24:44.949690 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-f9f30ce7-d71e-49b2-a024-3fddad2add32 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db" status: 200 len: 1321 microversion: 2.1 time: 0.209037 Sep 27 17:24:44.950269 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 56/97] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:24:44 2022] GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db => generated 1321 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:24:44.952635 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-6d3f20c7-85cd-49d3-a28c-4f861d1ba06d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:44.953339 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-6d3f20c7-85cd-49d3-a28c-4f861d1ba06d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:24:44.959338 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6d3f20c7-85cd-49d3-a28c-4f861d1ba06d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:44.959827 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6d3f20c7-85cd-49d3-a28c-4f861d1ba06d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:44.960262 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6d3f20c7-85cd-49d3-a28c-4f861d1ba06d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:44.960982 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6d3f20c7-85cd-49d3-a28c-4f861d1ba06d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:44.961436 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6d3f20c7-85cd-49d3-a28c-4f861d1ba06d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:44.961858 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6d3f20c7-85cd-49d3-a28c-4f861d1ba06d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:45.023192 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-6d3f20c7-85cd-49d3-a28c-4f861d1ba06d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:45.031870 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-6d3f20c7-85cd-49d3-a28c-4f861d1ba06d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:45.033369 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-6d3f20c7-85cd-49d3-a28c-4f861d1ba06d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:45.034530 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-6d3f20c7-85cd-49d3-a28c-4f861d1ba06d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1339 microversion: 2.20 time: 0.085772 Sep 27 17:24:45.035086 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 42/98] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:24:44 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1339 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:24:45.967197 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-b4b47d4b-663e-4bef-a475-c77c4bebc7f5 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:45.967870 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-b4b47d4b-663e-4bef-a475-c77c4bebc7f5 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] [instance: 0e6c9900-b294-45b0-a692-18ed9f943669] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:24:45.972892 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-eb8ff997-4d14-4da8-ad1f-d4241a0447a1 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:45.973493 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-eb8ff997-4d14-4da8-ad1f-d4241a0447a1 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: d622d15d-b954-409c-a1f5-538da5de83db] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:24:45.974043 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b4b47d4b-663e-4bef-a475-c77c4bebc7f5 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:45.974599 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b4b47d4b-663e-4bef-a475-c77c4bebc7f5 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:45.975046 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b4b47d4b-663e-4bef-a475-c77c4bebc7f5 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:45.975754 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b4b47d4b-663e-4bef-a475-c77c4bebc7f5 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:45.976210 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b4b47d4b-663e-4bef-a475-c77c4bebc7f5 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:45.976680 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b4b47d4b-663e-4bef-a475-c77c4bebc7f5 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:45.979279 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-eb8ff997-4d14-4da8-ad1f-d4241a0447a1 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:45.979750 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-eb8ff997-4d14-4da8-ad1f-d4241a0447a1 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:45.980440 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-eb8ff997-4d14-4da8-ad1f-d4241a0447a1 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:45.981120 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-eb8ff997-4d14-4da8-ad1f-d4241a0447a1 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:45.981562 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-eb8ff997-4d14-4da8-ad1f-d4241a0447a1 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:45.981982 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-eb8ff997-4d14-4da8-ad1f-d4241a0447a1 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:46.366235 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-b4b47d4b-663e-4bef-a475-c77c4bebc7f5 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48c146c0bba4583a92d157e2eed7f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c16b9aaa5ac4e6dac613614c1a570c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:46.374652 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-b4b47d4b-663e-4bef-a475-c77c4bebc7f5 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] 10.222.0.55 "GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669" status: 200 len: 1314 microversion: 2.1 time: 0.411307 Sep 27 17:24:46.377726 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-eb8ff997-4d14-4da8-ad1f-d4241a0447a1 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:46.385319 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-eb8ff997-4d14-4da8-ad1f-d4241a0447a1 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db" status: 200 len: 1321 microversion: 2.1 time: 0.416198 Sep 27 17:24:46.385894 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 43/99] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:24:45 2022] GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db => generated 1321 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:24:46.386648 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 57/100] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:24:45 2022] GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669 => generated 1314 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:24:46.391641 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-745240a1-95fb-46a2-8d75-62563ca827c7 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:46.392410 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-745240a1-95fb-46a2-8d75-62563ca827c7 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:24:46.398522 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-745240a1-95fb-46a2-8d75-62563ca827c7 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:46.399203 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-745240a1-95fb-46a2-8d75-62563ca827c7 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:46.399794 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-745240a1-95fb-46a2-8d75-62563ca827c7 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:46.400639 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-745240a1-95fb-46a2-8d75-62563ca827c7 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:46.401237 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-745240a1-95fb-46a2-8d75-62563ca827c7 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:46.401807 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-745240a1-95fb-46a2-8d75-62563ca827c7 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:46.537347 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-745240a1-95fb-46a2-8d75-62563ca827c7 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:46.547576 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-745240a1-95fb-46a2-8d75-62563ca827c7 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:46.549367 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-745240a1-95fb-46a2-8d75-62563ca827c7 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:46.550494 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-745240a1-95fb-46a2-8d75-62563ca827c7 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1339 microversion: 2.20 time: 0.162699 Sep 27 17:24:46.551035 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 58/101] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:24:46 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1339 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:24:47.428591 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-dc39e7b7-465e-447f-b0a8-e3bbf45eff6c tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:47.429127 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-3e9e3b72-3716-4c02-828d-0f34c1e56be8 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:47.429490 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-dc39e7b7-465e-447f-b0a8-e3bbf45eff6c tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] [instance: 0e6c9900-b294-45b0-a692-18ed9f943669] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:24:47.429569 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-3e9e3b72-3716-4c02-828d-0f34c1e56be8 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: d622d15d-b954-409c-a1f5-538da5de83db] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:24:47.435994 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3e9e3b72-3716-4c02-828d-0f34c1e56be8 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:47.436148 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-dc39e7b7-465e-447f-b0a8-e3bbf45eff6c tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:47.436477 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3e9e3b72-3716-4c02-828d-0f34c1e56be8 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:47.436623 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-dc39e7b7-465e-447f-b0a8-e3bbf45eff6c tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:47.436906 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3e9e3b72-3716-4c02-828d-0f34c1e56be8 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:47.437247 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-dc39e7b7-465e-447f-b0a8-e3bbf45eff6c tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:47.437948 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-dc39e7b7-465e-447f-b0a8-e3bbf45eff6c tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:47.438165 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3e9e3b72-3716-4c02-828d-0f34c1e56be8 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:47.438433 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3e9e3b72-3716-4c02-828d-0f34c1e56be8 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:47.438553 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-dc39e7b7-465e-447f-b0a8-e3bbf45eff6c tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:47.438979 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3e9e3b72-3716-4c02-828d-0f34c1e56be8 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:47.439227 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-dc39e7b7-465e-447f-b0a8-e3bbf45eff6c tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:47.915510 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-dc39e7b7-465e-447f-b0a8-e3bbf45eff6c tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48c146c0bba4583a92d157e2eed7f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c16b9aaa5ac4e6dac613614c1a570c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:47.921960 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-dc39e7b7-465e-447f-b0a8-e3bbf45eff6c tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] 10.222.0.55 "GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669" status: 200 len: 1314 microversion: 2.1 time: 0.497277 Sep 27 17:24:47.922585 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 44/102] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:24:47 2022] GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669 => generated 1314 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:24:47.927886 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-3e9e3b72-3716-4c02-828d-0f34c1e56be8 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:47.938253 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-3e9e3b72-3716-4c02-828d-0f34c1e56be8 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db" status: 200 len: 1321 microversion: 2.1 time: 0.513191 Sep 27 17:24:47.939823 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 59/103] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:24:47 2022] GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db => generated 1321 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:24:47.943165 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-5944b4d9-339f-414e-9851-ee2df2fe81da tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:47.943774 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-5944b4d9-339f-414e-9851-ee2df2fe81da tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:24:47.947040 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-1ad18b70-37d4-403d-87d3-c67155d49e23 tempest-VolumesTestJSON-1592921641 tempest-VolumesTestJSON-1592921641-project] Calling method '.version_select at 0x7fe724ecdf70>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:47.950215 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5944b4d9-339f-414e-9851-ee2df2fe81da tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:47.951061 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5944b4d9-339f-414e-9851-ee2df2fe81da tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:47.951789 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5944b4d9-339f-414e-9851-ee2df2fe81da tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:47.952703 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5944b4d9-339f-414e-9851-ee2df2fe81da tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:47.953542 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5944b4d9-339f-414e-9851-ee2df2fe81da tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:47.954586 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5944b4d9-339f-414e-9851-ee2df2fe81da tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:48.006818 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-1ad18b70-37d4-403d-87d3-c67155d49e23 tempest-VolumesTestJSON-1592921641 tempest-VolumesTestJSON-1592921641-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/0d5618cc-90b4-483a-9738-2b79b0429adb" status: 200 len: 350 microversion: 2.1 time: 0.064642 Sep 27 17:24:48.007619 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 60/104] 10.222.0.55 () {58 vars in 1245 bytes} [Tue Sep 27 17:24:47 2022] GET /compute/v2.1/os-volumes/0d5618cc-90b4-483a-9738-2b79b0429adb => generated 350 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:24:48.461694 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-5944b4d9-339f-414e-9851-ee2df2fe81da tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:48.471073 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-5944b4d9-339f-414e-9851-ee2df2fe81da tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:48.472738 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-5944b4d9-339f-414e-9851-ee2df2fe81da tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:48.473863 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-5944b4d9-339f-414e-9851-ee2df2fe81da tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1406 microversion: 2.20 time: 0.537871 Sep 27 17:24:48.474466 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 45/105] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:24:47 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1406 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:24:48.612186 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [req-596d0e7a-8791-46af-a0b2-a7f7c9739f75 req-f6eaf672-e9d4-45cc-a499-d179ad46fe02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d622d15d-b954-409c-a1f5-538da5de83db", "tag": "636a119c-4ac6-4298-8d42-f47c495d9a5b"}]} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:24:48.627947 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-596d0e7a-8791-46af-a0b2-a7f7c9739f75 req-f6eaf672-e9d4-45cc-a499-d179ad46fe02 service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:48.628462 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-596d0e7a-8791-46af-a0b2-a7f7c9739f75 req-f6eaf672-e9d4-45cc-a499-d179ad46fe02 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:48.628893 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-596d0e7a-8791-46af-a0b2-a7f7c9739f75 req-f6eaf672-e9d4-45cc-a499-d179ad46fe02 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:48.647854 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.compute.server_external_events [req-596d0e7a-8791-46af-a0b2-a7f7c9739f75 req-f6eaf672-e9d4-45cc-a499-d179ad46fe02 service nova] Creating event network-changed:636a119c-4ac6-4298-8d42-f47c495d9a5b for instance d622d15d-b954-409c-a1f5-538da5de83db on hv-cinder-84914 Sep 27 17:24:48.648369 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-596d0e7a-8791-46af-a0b2-a7f7c9739f75 req-f6eaf672-e9d4-45cc-a499-d179ad46fe02 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120416) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 27 17:24:48.648759 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-596d0e7a-8791-46af-a0b2-a7f7c9739f75 req-f6eaf672-e9d4-45cc-a499-d179ad46fe02 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120416) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 27 17:24:48.649768 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3e844b75-a09c-42a0-a06b-8b60fb52a774 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:48.650286 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3e844b75-a09c-42a0-a06b-8b60fb52a774 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:48.650713 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3e844b75-a09c-42a0-a06b-8b60fb52a774 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:48.652667 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3e844b75-a09c-42a0-a06b-8b60fb52a774 None None] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:48.652667 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3e844b75-a09c-42a0-a06b-8b60fb52a774 None None] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:48.652878 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3e844b75-a09c-42a0-a06b-8b60fb52a774 None None] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:48.661982 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.compute.rpcapi [None req-3e844b75-a09c-42a0-a06b-8b60fb52a774 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 27 17:24:48.662952 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3e844b75-a09c-42a0-a06b-8b60fb52a774 None None] Releasing lock "compute-rpcapi-router" {{(pid=120416) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 27 17:24:48.680382 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-3e844b75-a09c-42a0-a06b-8b60fb52a774 None None] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137413 Sep 27 17:24:48.681339 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 61/106] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:24:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:24:48.954369 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-49b8cdb8-dab7-465e-b00c-96ee603722c3 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:48.954369 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-49b8cdb8-dab7-465e-b00c-96ee603722c3 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] [instance: 0e6c9900-b294-45b0-a692-18ed9f943669] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:24:48.957492 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-49b8cdb8-dab7-465e-b00c-96ee603722c3 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:48.957984 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-49b8cdb8-dab7-465e-b00c-96ee603722c3 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:48.958481 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-49b8cdb8-dab7-465e-b00c-96ee603722c3 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:48.959180 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-49b8cdb8-dab7-465e-b00c-96ee603722c3 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:48.961240 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-49b8cdb8-dab7-465e-b00c-96ee603722c3 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:48.961702 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-49b8cdb8-dab7-465e-b00c-96ee603722c3 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:48.967368 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-ce8f2766-43ea-4d6e-94b4-6c705f4621aa tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:48.968106 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-ce8f2766-43ea-4d6e-94b4-6c705f4621aa tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: d622d15d-b954-409c-a1f5-538da5de83db] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:24:48.974636 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ce8f2766-43ea-4d6e-94b4-6c705f4621aa tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:48.975357 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ce8f2766-43ea-4d6e-94b4-6c705f4621aa tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:48.976039 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ce8f2766-43ea-4d6e-94b4-6c705f4621aa tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:48.977100 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ce8f2766-43ea-4d6e-94b4-6c705f4621aa tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:48.977788 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ce8f2766-43ea-4d6e-94b4-6c705f4621aa tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:48.978494 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ce8f2766-43ea-4d6e-94b4-6c705f4621aa tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:49.209277 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-49b8cdb8-dab7-465e-b00c-96ee603722c3 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48c146c0bba4583a92d157e2eed7f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c16b9aaa5ac4e6dac613614c1a570c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:49.217677 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-49b8cdb8-dab7-465e-b00c-96ee603722c3 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] 10.222.0.55 "GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669" status: 200 len: 1314 microversion: 2.1 time: 0.272023 Sep 27 17:24:49.218369 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 46/107] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:24:48 2022] GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669 => generated 1314 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:24:49.224535 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-ce8f2766-43ea-4d6e-94b4-6c705f4621aa tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:49.232635 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-ce8f2766-43ea-4d6e-94b4-6c705f4621aa tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db" status: 200 len: 1321 microversion: 2.1 time: 0.269971 Sep 27 17:24:49.233538 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 62/108] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:24:48 2022] GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db => generated 1321 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:24:49.500743 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-848d8f6b-3391-4560-b5b3-ed32c136b79a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:49.501854 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-848d8f6b-3391-4560-b5b3-ed32c136b79a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:24:49.507224 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-848d8f6b-3391-4560-b5b3-ed32c136b79a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:49.507872 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-848d8f6b-3391-4560-b5b3-ed32c136b79a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:49.508304 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-848d8f6b-3391-4560-b5b3-ed32c136b79a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:49.509627 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-848d8f6b-3391-4560-b5b3-ed32c136b79a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:49.510100 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-848d8f6b-3391-4560-b5b3-ed32c136b79a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:49.510525 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-848d8f6b-3391-4560-b5b3-ed32c136b79a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:49.820772 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-848d8f6b-3391-4560-b5b3-ed32c136b79a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:49.829527 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-848d8f6b-3391-4560-b5b3-ed32c136b79a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:49.830996 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-848d8f6b-3391-4560-b5b3-ed32c136b79a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:49.832099 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-848d8f6b-3391-4560-b5b3-ed32c136b79a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1406 microversion: 2.20 time: 0.335356 Sep 27 17:24:49.832647 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 47/109] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:24:49 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1406 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:24:50.242092 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-dde3d8c7-10f6-49e8-ac44-f9ff5ff33333 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:50.242917 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-dde3d8c7-10f6-49e8-ac44-f9ff5ff33333 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] [instance: 0e6c9900-b294-45b0-a692-18ed9f943669] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:24:50.249582 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-dde3d8c7-10f6-49e8-ac44-f9ff5ff33333 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:50.250199 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-dde3d8c7-10f6-49e8-ac44-f9ff5ff33333 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:50.250633 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-dde3d8c7-10f6-49e8-ac44-f9ff5ff33333 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:50.251503 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-dde3d8c7-10f6-49e8-ac44-f9ff5ff33333 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:50.252162 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-dde3d8c7-10f6-49e8-ac44-f9ff5ff33333 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:50.252601 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-dde3d8c7-10f6-49e8-ac44-f9ff5ff33333 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:50.258287 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-7799ba09-7752-4c5d-96d3-62fe5957c593 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:50.258287 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-7799ba09-7752-4c5d-96d3-62fe5957c593 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: d622d15d-b954-409c-a1f5-538da5de83db] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:24:50.265434 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7799ba09-7752-4c5d-96d3-62fe5957c593 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:50.266112 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7799ba09-7752-4c5d-96d3-62fe5957c593 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:50.266639 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7799ba09-7752-4c5d-96d3-62fe5957c593 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:50.267456 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7799ba09-7752-4c5d-96d3-62fe5957c593 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:50.268500 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7799ba09-7752-4c5d-96d3-62fe5957c593 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:50.269028 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7799ba09-7752-4c5d-96d3-62fe5957c593 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:50.465887 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-dde3d8c7-10f6-49e8-ac44-f9ff5ff33333 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48c146c0bba4583a92d157e2eed7f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c16b9aaa5ac4e6dac613614c1a570c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:50.468054 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-7799ba09-7752-4c5d-96d3-62fe5957c593 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:50.476346 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-dde3d8c7-10f6-49e8-ac44-f9ff5ff33333 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] 10.222.0.55 "GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669" status: 200 len: 1314 microversion: 2.1 time: 0.238996 Sep 27 17:24:50.477323 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-7799ba09-7752-4c5d-96d3-62fe5957c593 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db" status: 200 len: 1321 microversion: 2.1 time: 0.224307 Sep 27 17:24:50.477780 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 63/110] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:24:50 2022] GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669 => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:24:50.477886 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 48/111] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:24:50 2022] GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db => generated 1321 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:24:50.696156 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [req-6872cdbc-7040-4eaf-b187-45b39a9df0d8 req-8dd6592a-68c6-4431-9037-8af9e03bd387 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e6c9900-b294-45b0-a692-18ed9f943669", "tag": "8da35e49-fd42-450d-b5d6-f220c2448d60"}]} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:24:50.706601 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-6872cdbc-7040-4eaf-b187-45b39a9df0d8 req-8dd6592a-68c6-4431-9037-8af9e03bd387 service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:50.707102 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-6872cdbc-7040-4eaf-b187-45b39a9df0d8 req-8dd6592a-68c6-4431-9037-8af9e03bd387 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:50.707523 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-6872cdbc-7040-4eaf-b187-45b39a9df0d8 req-8dd6592a-68c6-4431-9037-8af9e03bd387 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:50.720062 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.compute.server_external_events [req-6872cdbc-7040-4eaf-b187-45b39a9df0d8 req-8dd6592a-68c6-4431-9037-8af9e03bd387 service nova] Creating event network-changed:8da35e49-fd42-450d-b5d6-f220c2448d60 for instance 0e6c9900-b294-45b0-a692-18ed9f943669 on hv-cinder-84914 Sep 27 17:24:50.725153 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [req-6872cdbc-7040-4eaf-b187-45b39a9df0d8 req-8dd6592a-68c6-4431-9037-8af9e03bd387 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032585 Sep 27 17:24:50.725743 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 49/112] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:24:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:24:50.857497 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-037b7608-4250-41f8-a8c3-2b1fbfb4015f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:50.858122 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-037b7608-4250-41f8-a8c3-2b1fbfb4015f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:24:50.863893 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-037b7608-4250-41f8-a8c3-2b1fbfb4015f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:50.864370 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-037b7608-4250-41f8-a8c3-2b1fbfb4015f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:50.864799 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-037b7608-4250-41f8-a8c3-2b1fbfb4015f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:50.865485 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-037b7608-4250-41f8-a8c3-2b1fbfb4015f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:50.865938 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-037b7608-4250-41f8-a8c3-2b1fbfb4015f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:50.866398 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-037b7608-4250-41f8-a8c3-2b1fbfb4015f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:51.004648 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-037b7608-4250-41f8-a8c3-2b1fbfb4015f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:51.019809 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-037b7608-4250-41f8-a8c3-2b1fbfb4015f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:51.021251 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-037b7608-4250-41f8-a8c3-2b1fbfb4015f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:51.022378 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-037b7608-4250-41f8-a8c3-2b1fbfb4015f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1406 microversion: 2.20 time: 0.169073 Sep 27 17:24:51.022927 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 64/113] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:24:50 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1406 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:24:51.501803 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-4da54612-3e05-4d58-8220-94c76a105931 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:51.502533 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-4da54612-3e05-4d58-8220-94c76a105931 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] [instance: 0e6c9900-b294-45b0-a692-18ed9f943669] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:24:51.503852 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-c0e9e21a-50fe-4084-b30f-f9fe30124a33 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:51.504470 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-c0e9e21a-50fe-4084-b30f-f9fe30124a33 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: d622d15d-b954-409c-a1f5-538da5de83db] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:24:51.508653 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4da54612-3e05-4d58-8220-94c76a105931 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:51.509136 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4da54612-3e05-4d58-8220-94c76a105931 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:51.509570 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4da54612-3e05-4d58-8220-94c76a105931 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:51.510290 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4da54612-3e05-4d58-8220-94c76a105931 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:51.510395 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c0e9e21a-50fe-4084-b30f-f9fe30124a33 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:51.510744 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4da54612-3e05-4d58-8220-94c76a105931 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:51.510865 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c0e9e21a-50fe-4084-b30f-f9fe30124a33 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:51.511170 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4da54612-3e05-4d58-8220-94c76a105931 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:51.511405 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c0e9e21a-50fe-4084-b30f-f9fe30124a33 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:51.512231 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c0e9e21a-50fe-4084-b30f-f9fe30124a33 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:51.512790 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c0e9e21a-50fe-4084-b30f-f9fe30124a33 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:51.513276 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c0e9e21a-50fe-4084-b30f-f9fe30124a33 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:51.710393 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-4da54612-3e05-4d58-8220-94c76a105931 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48c146c0bba4583a92d157e2eed7f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c16b9aaa5ac4e6dac613614c1a570c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:51.714329 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-c0e9e21a-50fe-4084-b30f-f9fe30124a33 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:51.718542 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-4da54612-3e05-4d58-8220-94c76a105931 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] 10.222.0.55 "GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669" status: 200 len: 1314 microversion: 2.1 time: 0.220981 Sep 27 17:24:51.719113 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 50/114] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:24:51 2022] GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:24:51.722540 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-c0e9e21a-50fe-4084-b30f-f9fe30124a33 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db" status: 200 len: 1321 microversion: 2.1 time: 0.222492 Sep 27 17:24:51.723096 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 65/115] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:24:51 2022] GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db => generated 1321 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:24:52.047438 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-5dc393d5-34e2-4194-b893-90b13c1096c3 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:52.048086 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-5dc393d5-34e2-4194-b893-90b13c1096c3 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:24:52.053910 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5dc393d5-34e2-4194-b893-90b13c1096c3 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:52.054427 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5dc393d5-34e2-4194-b893-90b13c1096c3 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:52.054859 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5dc393d5-34e2-4194-b893-90b13c1096c3 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:52.055542 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5dc393d5-34e2-4194-b893-90b13c1096c3 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:52.055993 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5dc393d5-34e2-4194-b893-90b13c1096c3 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:52.056414 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5dc393d5-34e2-4194-b893-90b13c1096c3 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:52.180561 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-5dc393d5-34e2-4194-b893-90b13c1096c3 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:52.188445 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-5dc393d5-34e2-4194-b893-90b13c1096c3 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:52.189894 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-5dc393d5-34e2-4194-b893-90b13c1096c3 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:52.191024 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-5dc393d5-34e2-4194-b893-90b13c1096c3 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1406 microversion: 2.20 time: 0.148106 Sep 27 17:24:52.191584 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 51/116] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:24:52 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1406 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:24:52.743326 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-10a5299f-d944-4b7d-9453-dcb7b90d8c5b tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:52.743957 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-10a5299f-d944-4b7d-9453-dcb7b90d8c5b tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] [instance: 0e6c9900-b294-45b0-a692-18ed9f943669] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:24:52.744855 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-da52e450-8451-4978-98d7-205cb58203f1 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:52.745468 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-da52e450-8451-4978-98d7-205cb58203f1 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: d622d15d-b954-409c-a1f5-538da5de83db] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:24:52.750473 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-10a5299f-d944-4b7d-9453-dcb7b90d8c5b tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:52.750947 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-10a5299f-d944-4b7d-9453-dcb7b90d8c5b tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:52.751371 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-10a5299f-d944-4b7d-9453-dcb7b90d8c5b tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:52.752052 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-10a5299f-d944-4b7d-9453-dcb7b90d8c5b tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:52.752155 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-da52e450-8451-4978-98d7-205cb58203f1 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:52.752498 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-10a5299f-d944-4b7d-9453-dcb7b90d8c5b tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:52.752615 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-da52e450-8451-4978-98d7-205cb58203f1 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:52.752912 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-10a5299f-d944-4b7d-9453-dcb7b90d8c5b tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:52.753013 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-da52e450-8451-4978-98d7-205cb58203f1 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:52.753687 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-da52e450-8451-4978-98d7-205cb58203f1 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:52.754161 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-da52e450-8451-4978-98d7-205cb58203f1 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:52.754588 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-da52e450-8451-4978-98d7-205cb58203f1 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:52.773592 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell1:SELECT=100 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:52.941468 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-10a5299f-d944-4b7d-9453-dcb7b90d8c5b tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48c146c0bba4583a92d157e2eed7f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c16b9aaa5ac4e6dac613614c1a570c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:52.949878 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-10a5299f-d944-4b7d-9453-dcb7b90d8c5b tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] 10.222.0.55 "GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669" status: 200 len: 1314 microversion: 2.1 time: 0.210332 Sep 27 17:24:52.950514 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 66/117] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:24:52 2022] GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669 => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:24:52.950643 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-da52e450-8451-4978-98d7-205cb58203f1 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:52.959452 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-da52e450-8451-4978-98d7-205cb58203f1 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db" status: 200 len: 1321 microversion: 2.1 time: 0.218238 Sep 27 17:24:52.960805 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 52/118] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:24:52 2022] GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db => generated 1321 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:24:53.215967 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-ca089168-d2f7-4598-9fcc-232b2a0c574d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:53.216574 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-ca089168-d2f7-4598-9fcc-232b2a0c574d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:24:53.222368 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ca089168-d2f7-4598-9fcc-232b2a0c574d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:53.222848 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ca089168-d2f7-4598-9fcc-232b2a0c574d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:53.223284 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ca089168-d2f7-4598-9fcc-232b2a0c574d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:53.223965 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ca089168-d2f7-4598-9fcc-232b2a0c574d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:53.224416 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ca089168-d2f7-4598-9fcc-232b2a0c574d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:53.224836 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ca089168-d2f7-4598-9fcc-232b2a0c574d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:53.365884 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-ca089168-d2f7-4598-9fcc-232b2a0c574d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:53.369356 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_cell1:SELECT=100 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:53.375688 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-ca089168-d2f7-4598-9fcc-232b2a0c574d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:53.377133 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-ca089168-d2f7-4598-9fcc-232b2a0c574d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:53.378292 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-ca089168-d2f7-4598-9fcc-232b2a0c574d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1406 microversion: 2.20 time: 0.166194 Sep 27 17:24:53.382118 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 67/119] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:24:53 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 17:24:53.979107 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-a39bfed8-4a95-420c-8ed3-3d8cdc867bef tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:53.979761 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-a39bfed8-4a95-420c-8ed3-3d8cdc867bef tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] [instance: 0e6c9900-b294-45b0-a692-18ed9f943669] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:24:53.987089 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-9acd1505-4849-46d0-b077-d50e23490a8a tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:53.987693 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-9acd1505-4849-46d0-b077-d50e23490a8a tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: d622d15d-b954-409c-a1f5-538da5de83db] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:24:53.987887 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a39bfed8-4a95-420c-8ed3-3d8cdc867bef tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:53.988633 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a39bfed8-4a95-420c-8ed3-3d8cdc867bef tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:53.989303 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a39bfed8-4a95-420c-8ed3-3d8cdc867bef tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:53.990151 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a39bfed8-4a95-420c-8ed3-3d8cdc867bef tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:53.990603 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a39bfed8-4a95-420c-8ed3-3d8cdc867bef tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:53.991050 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a39bfed8-4a95-420c-8ed3-3d8cdc867bef tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:53.993853 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9acd1505-4849-46d0-b077-d50e23490a8a tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:53.994380 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9acd1505-4849-46d0-b077-d50e23490a8a tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:53.994820 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9acd1505-4849-46d0-b077-d50e23490a8a tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:53.995511 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9acd1505-4849-46d0-b077-d50e23490a8a tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:53.996079 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9acd1505-4849-46d0-b077-d50e23490a8a tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:53.996506 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9acd1505-4849-46d0-b077-d50e23490a8a tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:54.199641 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-9acd1505-4849-46d0-b077-d50e23490a8a tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:54.202689 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-a39bfed8-4a95-420c-8ed3-3d8cdc867bef tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48c146c0bba4583a92d157e2eed7f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c16b9aaa5ac4e6dac613614c1a570c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:54.209070 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-9acd1505-4849-46d0-b077-d50e23490a8a tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db" status: 200 len: 1321 microversion: 2.1 time: 0.227449 Sep 27 17:24:54.216342 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-a39bfed8-4a95-420c-8ed3-3d8cdc867bef tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] 10.222.0.55 "GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669" status: 200 len: 1314 microversion: 2.1 time: 0.243242 Sep 27 17:24:54.226094 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 68/120] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:24:53 2022] GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db => generated 1321 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:24:54.231080 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 53/121] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:24:53 2022] GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669 => generated 1314 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:24:54.405921 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-a550e149-ad5f-4307-987e-a51251076a65 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:54.406555 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-a550e149-ad5f-4307-987e-a51251076a65 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:24:54.412341 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a550e149-ad5f-4307-987e-a51251076a65 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:54.412817 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a550e149-ad5f-4307-987e-a51251076a65 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:54.413248 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a550e149-ad5f-4307-987e-a51251076a65 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:54.413935 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a550e149-ad5f-4307-987e-a51251076a65 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:54.414419 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a550e149-ad5f-4307-987e-a51251076a65 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:54.414844 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a550e149-ad5f-4307-987e-a51251076a65 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:54.567660 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-a550e149-ad5f-4307-987e-a51251076a65 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:54.576723 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-a550e149-ad5f-4307-987e-a51251076a65 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:54.578212 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-a550e149-ad5f-4307-987e-a51251076a65 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:54.579351 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-a550e149-ad5f-4307-987e-a51251076a65 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1406 microversion: 2.20 time: 0.178483 Sep 27 17:24:54.579908 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 69/122] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:24:54 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1406 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:24:54.771233 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-4dfa2a17-ce8f-42cc-a037-8c0d66f0dda0 tempest-VolumesTestJSON-1592921641 tempest-VolumesTestJSON-1592921641-project] Calling method '.version_select at 0x7fe724f18040>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:54.872853 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-4dfa2a17-ce8f-42cc-a037-8c0d66f0dda0 tempest-VolumesTestJSON-1592921641 tempest-VolumesTestJSON-1592921641-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/812b8afd-5322-4130-a90f-850074a12120" status: 200 len: 351 microversion: 2.1 time: 0.103852 Sep 27 17:24:54.874125 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 54/123] 10.222.0.55 () {58 vars in 1245 bytes} [Tue Sep 27 17:24:54 2022] GET /compute/v2.1/os-volumes/812b8afd-5322-4130-a90f-850074a12120 => generated 351 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:24:54.894456 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-4795bafb-5a12-4bfb-b291-269ab9663296 tempest-VolumesTestJSON-1592921641 tempest-VolumesTestJSON-1592921641-project] Calling method '.version_select at 0x7fe724e4b700>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:55.090604 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-4795bafb-5a12-4bfb-b291-269ab9663296 tempest-VolumesTestJSON-1592921641 tempest-VolumesTestJSON-1592921641-project] 10.222.0.55 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.199249 Sep 27 17:24:55.094712 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 70/124] 10.222.0.55 () {58 vars in 1134 bytes} [Tue Sep 27 17:24:54 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:24:55.108711 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-748b2855-72c6-4e87-9e3c-b7de0bd3d9f8 tempest-VolumesTestJSON-1592921641 tempest-VolumesTestJSON-1592921641-project] Calling method '.version_select at 0x7fe724e57ca0>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:55.235098 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-17aac028-6282-4484-ae08-e7bcef4a29ee tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:55.235736 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-17aac028-6282-4484-ae08-e7bcef4a29ee tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: d622d15d-b954-409c-a1f5-538da5de83db] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:24:55.247759 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-748b2855-72c6-4e87-9e3c-b7de0bd3d9f8 tempest-VolumesTestJSON-1592921641 tempest-VolumesTestJSON-1592921641-project] 10.222.0.55 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.144220 Sep 27 17:24:55.249513 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 55/125] 10.222.0.55 () {58 vars in 1149 bytes} [Tue Sep 27 17:24:55 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:24:55.254436 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-0e092617-2fa8-4468-8f8b-f9c46bd62321 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:55.255238 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-0e092617-2fa8-4468-8f8b-f9c46bd62321 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] [instance: 0e6c9900-b294-45b0-a692-18ed9f943669] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:24:55.258456 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-17aac028-6282-4484-ae08-e7bcef4a29ee tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:55.259234 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-17aac028-6282-4484-ae08-e7bcef4a29ee tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:55.259783 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-17aac028-6282-4484-ae08-e7bcef4a29ee tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:55.260596 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-17aac028-6282-4484-ae08-e7bcef4a29ee tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:55.261094 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-17aac028-6282-4484-ae08-e7bcef4a29ee tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:55.262100 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-17aac028-6282-4484-ae08-e7bcef4a29ee tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:55.270407 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0e092617-2fa8-4468-8f8b-f9c46bd62321 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:55.270988 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0e092617-2fa8-4468-8f8b-f9c46bd62321 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:55.271684 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0e092617-2fa8-4468-8f8b-f9c46bd62321 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:55.272385 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0e092617-2fa8-4468-8f8b-f9c46bd62321 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:55.273206 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0e092617-2fa8-4468-8f8b-f9c46bd62321 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:55.273772 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0e092617-2fa8-4468-8f8b-f9c46bd62321 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:56.134031 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-17aac028-6282-4484-ae08-e7bcef4a29ee tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:56.144235 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-17aac028-6282-4484-ae08-e7bcef4a29ee tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db" status: 200 len: 1321 microversion: 2.1 time: 0.914950 Sep 27 17:24:56.145261 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 71/126] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:24:55 2022] GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db => generated 1321 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:24:56.153053 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-7d45ef2e-812e-4145-b3f0-7b400864ccd3 tempest-VolumesTestJSON-1592921641 tempest-VolumesTestJSON-1592921641-project] Calling method '.version_select at 0x7fe724eb5310>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:56.188907 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-0e092617-2fa8-4468-8f8b-f9c46bd62321 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48c146c0bba4583a92d157e2eed7f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c16b9aaa5ac4e6dac613614c1a570c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:56.202949 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-0e092617-2fa8-4468-8f8b-f9c46bd62321 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] 10.222.0.55 "GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669" status: 200 len: 1314 microversion: 2.1 time: 0.952033 Sep 27 17:24:56.204083 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 56/127] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:24:55 2022] GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669 => generated 1314 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:24:56.216573 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-230fa6ac-79d9-4654-bcd0-cd3e605dbe6d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:56.216573 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-230fa6ac-79d9-4654-bcd0-cd3e605dbe6d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:24:56.232758 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-230fa6ac-79d9-4654-bcd0-cd3e605dbe6d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:56.233095 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-230fa6ac-79d9-4654-bcd0-cd3e605dbe6d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:56.233517 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-230fa6ac-79d9-4654-bcd0-cd3e605dbe6d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:56.234282 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-230fa6ac-79d9-4654-bcd0-cd3e605dbe6d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:56.234799 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-230fa6ac-79d9-4654-bcd0-cd3e605dbe6d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:56.235137 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-230fa6ac-79d9-4654-bcd0-cd3e605dbe6d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:56.253894 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-7d45ef2e-812e-4145-b3f0-7b400864ccd3 tempest-VolumesTestJSON-1592921641 tempest-VolumesTestJSON-1592921641-project] 10.222.0.55 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.107581 Sep 27 17:24:56.263809 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 72/128] 10.222.0.55 () {58 vars in 1134 bytes} [Tue Sep 27 17:24:56 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:24:56.268672 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-f7939541-6fd4-4e2a-825f-23232314b653 tempest-VolumesTestJSON-1592921641 tempest-VolumesTestJSON-1592921641-project] Calling method '.version_select at 0x7fe724e4b4c0>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:56.380822 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-f7939541-6fd4-4e2a-825f-23232314b653 tempest-VolumesTestJSON-1592921641 tempest-VolumesTestJSON-1592921641-project] 10.222.0.55 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.115779 Sep 27 17:24:56.383039 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 73/129] 10.222.0.55 () {58 vars in 1167 bytes} [Tue Sep 27 17:24:56 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:24:56.403215 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-1dee3eb7-3585-4a8f-9bdf-c986f948d399 tempest-VolumesTestJSON-1592921641 tempest-VolumesTestJSON-1592921641-project] Calling method '.version_select at 0x7fe724e820d0>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:56.484977 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-230fa6ac-79d9-4654-bcd0-cd3e605dbe6d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:56.493137 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-230fa6ac-79d9-4654-bcd0-cd3e605dbe6d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:56.497306 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-1dee3eb7-3585-4a8f-9bdf-c986f948d399 tempest-VolumesTestJSON-1592921641 tempest-VolumesTestJSON-1592921641-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.101156 Sep 27 17:24:56.497306 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 74/130] 10.222.0.55 () {58 vars in 1170 bytes} [Tue Sep 27 17:24:56 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 17:24:56.498718 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-230fa6ac-79d9-4654-bcd0-cd3e605dbe6d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:56.499879 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-230fa6ac-79d9-4654-bcd0-cd3e605dbe6d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1406 microversion: 2.20 time: 0.294562 Sep 27 17:24:56.500421 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 57/131] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:24:56 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1406 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:24:56.520459 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-ae5b22dd-ebf6-4506-bfe3-f473800ab28a tempest-VolumesTestJSON-1592921641 tempest-VolumesTestJSON-1592921641-project] Calling method '.version_select at 0x7fe724e4bb80>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:56.618958 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-ae5b22dd-ebf6-4506-bfe3-f473800ab28a tempest-VolumesTestJSON-1592921641 tempest-VolumesTestJSON-1592921641-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.102726 Sep 27 17:24:56.626735 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 75/132] 10.222.0.55 () {58 vars in 1155 bytes} [Tue Sep 27 17:24:56 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:24:56.636040 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-43885591-c306-4b4a-ac71-00f3c0a6b8dd tempest-VolumesTestJSON-1592921641 tempest-VolumesTestJSON-1592921641-project] Calling method '.version_select at 0x7fe724e3ce50>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:56.751364 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [req-b6299115-17a9-4606-a2a2-787b202def59 req-91214f15-340c-4734-a4a0-f47fa0f20ddb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d209f2ce-43c8-422a-a703-cdc9a9fb5cee", "tag": "5a5276d6-632d-4adb-a46b-8471fb0bf332"}]} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:24:56.768330 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-43885591-c306-4b4a-ac71-00f3c0a6b8dd tempest-VolumesTestJSON-1592921641 tempest-VolumesTestJSON-1592921641-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.138332 Sep 27 17:24:56.769205 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 58/133] 10.222.0.55 () {58 vars in 1188 bytes} [Tue Sep 27 17:24:56 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:24:56.775849 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-b6299115-17a9-4606-a2a2-787b202def59 req-91214f15-340c-4734-a4a0-f47fa0f20ddb service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:56.777317 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-b6299115-17a9-4606-a2a2-787b202def59 req-91214f15-340c-4734-a4a0-f47fa0f20ddb service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:56.777317 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-b6299115-17a9-4606-a2a2-787b202def59 req-91214f15-340c-4734-a4a0-f47fa0f20ddb service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:56.785729 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-12fbea3d-1a7e-4d3e-87b6-d6351ea87d7d tempest-VolumesTestJSON-1592921641 tempest-VolumesTestJSON-1592921641-project] Calling method '.version_select at 0x7fe724e70820>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:56.797888 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.compute.server_external_events [req-b6299115-17a9-4606-a2a2-787b202def59 req-91214f15-340c-4734-a4a0-f47fa0f20ddb service nova] Creating event network-changed:5a5276d6-632d-4adb-a46b-8471fb0bf332 for instance d209f2ce-43c8-422a-a703-cdc9a9fb5cee on hv-cinder-84914 Sep 27 17:24:56.807129 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [req-b6299115-17a9-4606-a2a2-787b202def59 req-91214f15-340c-4734-a4a0-f47fa0f20ddb service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058597 Sep 27 17:24:56.807992 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 76/134] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:24:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:24:56.881326 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-12fbea3d-1a7e-4d3e-87b6-d6351ea87d7d tempest-VolumesTestJSON-1592921641 tempest-VolumesTestJSON-1592921641-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.101031 Sep 27 17:24:56.882059 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 59/135] 10.222.0.55 () {58 vars in 1155 bytes} [Tue Sep 27 17:24:56 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:24:57.170682 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-386f8534-d67d-4c36-b3db-60dbc704ccef tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:57.171390 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-386f8534-d67d-4c36-b3db-60dbc704ccef tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: d622d15d-b954-409c-a1f5-538da5de83db] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:24:57.177363 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-386f8534-d67d-4c36-b3db-60dbc704ccef tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:57.177832 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-386f8534-d67d-4c36-b3db-60dbc704ccef tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:57.178282 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-386f8534-d67d-4c36-b3db-60dbc704ccef tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:57.178963 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-386f8534-d67d-4c36-b3db-60dbc704ccef tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:57.179428 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-386f8534-d67d-4c36-b3db-60dbc704ccef tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:57.179848 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-386f8534-d67d-4c36-b3db-60dbc704ccef tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:57.226728 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-574d7090-45ea-453f-a69d-188757ce92ab tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:57.227402 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-574d7090-45ea-453f-a69d-188757ce92ab tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] [instance: 0e6c9900-b294-45b0-a692-18ed9f943669] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:24:57.235129 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-574d7090-45ea-453f-a69d-188757ce92ab tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:57.235613 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-574d7090-45ea-453f-a69d-188757ce92ab tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:57.236046 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-574d7090-45ea-453f-a69d-188757ce92ab tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:57.236736 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-574d7090-45ea-453f-a69d-188757ce92ab tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:57.237189 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-574d7090-45ea-453f-a69d-188757ce92ab tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:57.237614 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-574d7090-45ea-453f-a69d-188757ce92ab tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:57.346791 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-386f8534-d67d-4c36-b3db-60dbc704ccef tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:57.355920 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-386f8534-d67d-4c36-b3db-60dbc704ccef tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db" status: 200 len: 1321 microversion: 2.1 time: 0.189678 Sep 27 17:24:57.356499 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 77/136] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:24:57 2022] GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db => generated 1321 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:24:57.393949 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-574d7090-45ea-453f-a69d-188757ce92ab tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48c146c0bba4583a92d157e2eed7f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c16b9aaa5ac4e6dac613614c1a570c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:57.401553 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-574d7090-45ea-453f-a69d-188757ce92ab tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] 10.222.0.55 "GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669" status: 200 len: 1314 microversion: 2.1 time: 0.178627 Sep 27 17:24:57.402787 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 60/137] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:24:57 2022] GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:24:57.524678 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-1c6629a3-8aa8-4b59-9f1c-5379b6688906 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:57.525282 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-1c6629a3-8aa8-4b59-9f1c-5379b6688906 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:24:57.531976 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1c6629a3-8aa8-4b59-9f1c-5379b6688906 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:57.532458 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1c6629a3-8aa8-4b59-9f1c-5379b6688906 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:57.532890 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1c6629a3-8aa8-4b59-9f1c-5379b6688906 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:57.533576 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1c6629a3-8aa8-4b59-9f1c-5379b6688906 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:57.534028 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1c6629a3-8aa8-4b59-9f1c-5379b6688906 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:57.534479 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1c6629a3-8aa8-4b59-9f1c-5379b6688906 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:57.658463 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-1c6629a3-8aa8-4b59-9f1c-5379b6688906 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:57.666586 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-1c6629a3-8aa8-4b59-9f1c-5379b6688906 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:57.668105 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-1c6629a3-8aa8-4b59-9f1c-5379b6688906 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:57.669213 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-1c6629a3-8aa8-4b59-9f1c-5379b6688906 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1406 microversion: 2.20 time: 0.148542 Sep 27 17:24:57.669773 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 78/138] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:24:57 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1406 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:24:58.378266 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-a5bdbdf7-bbb6-44bd-98df-b145b61ee668 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:58.378803 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-a5bdbdf7-bbb6-44bd-98df-b145b61ee668 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: d622d15d-b954-409c-a1f5-538da5de83db] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:24:58.384753 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a5bdbdf7-bbb6-44bd-98df-b145b61ee668 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:58.385220 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a5bdbdf7-bbb6-44bd-98df-b145b61ee668 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:58.385645 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a5bdbdf7-bbb6-44bd-98df-b145b61ee668 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:58.386343 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a5bdbdf7-bbb6-44bd-98df-b145b61ee668 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:58.386786 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a5bdbdf7-bbb6-44bd-98df-b145b61ee668 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:58.387197 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a5bdbdf7-bbb6-44bd-98df-b145b61ee668 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:58.425113 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-800a161a-ed5a-4c6d-92f9-d569dfbac60b tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:58.425726 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-800a161a-ed5a-4c6d-92f9-d569dfbac60b tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] [instance: 0e6c9900-b294-45b0-a692-18ed9f943669] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:24:58.431642 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-800a161a-ed5a-4c6d-92f9-d569dfbac60b tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:58.432120 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-800a161a-ed5a-4c6d-92f9-d569dfbac60b tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:58.432546 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-800a161a-ed5a-4c6d-92f9-d569dfbac60b tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:58.433258 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-800a161a-ed5a-4c6d-92f9-d569dfbac60b tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:58.433709 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-800a161a-ed5a-4c6d-92f9-d569dfbac60b tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:58.434147 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-800a161a-ed5a-4c6d-92f9-d569dfbac60b tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:58.557831 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-a5bdbdf7-bbb6-44bd-98df-b145b61ee668 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:58.565439 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-a5bdbdf7-bbb6-44bd-98df-b145b61ee668 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db" status: 200 len: 1321 microversion: 2.1 time: 0.191065 Sep 27 17:24:58.566184 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 61/139] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:24:58 2022] GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db => generated 1321 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:24:58.591610 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-800a161a-ed5a-4c6d-92f9-d569dfbac60b tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48c146c0bba4583a92d157e2eed7f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c16b9aaa5ac4e6dac613614c1a570c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:58.599197 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-800a161a-ed5a-4c6d-92f9-d569dfbac60b tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] 10.222.0.55 "GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669" status: 200 len: 1314 microversion: 2.1 time: 0.177818 Sep 27 17:24:58.599749 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 79/140] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:24:58 2022] GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:24:58.694751 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-b4a791ee-9c9b-4b76-a872-40e5341356c4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:58.695271 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-b4a791ee-9c9b-4b76-a872-40e5341356c4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:24:58.701195 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b4a791ee-9c9b-4b76-a872-40e5341356c4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:58.701674 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b4a791ee-9c9b-4b76-a872-40e5341356c4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:58.702135 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b4a791ee-9c9b-4b76-a872-40e5341356c4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:58.702826 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b4a791ee-9c9b-4b76-a872-40e5341356c4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:58.703278 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b4a791ee-9c9b-4b76-a872-40e5341356c4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:58.703697 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b4a791ee-9c9b-4b76-a872-40e5341356c4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:58.833307 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-b4a791ee-9c9b-4b76-a872-40e5341356c4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:58.841911 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-b4a791ee-9c9b-4b76-a872-40e5341356c4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:58.843385 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-b4a791ee-9c9b-4b76-a872-40e5341356c4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:58.844488 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-b4a791ee-9c9b-4b76-a872-40e5341356c4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1406 microversion: 2.20 time: 0.153759 Sep 27 17:24:58.845041 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 62/141] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:24:58 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:24:59.588161 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-a472ff0c-aa95-45b9-823f-0be8a92525e5 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:59.588694 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-a472ff0c-aa95-45b9-823f-0be8a92525e5 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: d622d15d-b954-409c-a1f5-538da5de83db] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:24:59.591258 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_cell0:SELECT=2 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:24:59.597476 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a472ff0c-aa95-45b9-823f-0be8a92525e5 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:59.597996 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a472ff0c-aa95-45b9-823f-0be8a92525e5 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:59.598460 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a472ff0c-aa95-45b9-823f-0be8a92525e5 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:59.599151 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a472ff0c-aa95-45b9-823f-0be8a92525e5 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:59.599599 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a472ff0c-aa95-45b9-823f-0be8a92525e5 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:59.600054 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a472ff0c-aa95-45b9-823f-0be8a92525e5 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:59.623054 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-944587e6-c27d-4005-aa3a-37aa9e09211b tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:59.623655 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-944587e6-c27d-4005-aa3a-37aa9e09211b tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] [instance: 0e6c9900-b294-45b0-a692-18ed9f943669] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:24:59.629666 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-944587e6-c27d-4005-aa3a-37aa9e09211b tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:59.630164 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-944587e6-c27d-4005-aa3a-37aa9e09211b tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:59.630595 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-944587e6-c27d-4005-aa3a-37aa9e09211b tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:59.631267 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-944587e6-c27d-4005-aa3a-37aa9e09211b tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:59.631710 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-944587e6-c27d-4005-aa3a-37aa9e09211b tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:59.632126 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-944587e6-c27d-4005-aa3a-37aa9e09211b tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:59.785310 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-a472ff0c-aa95-45b9-823f-0be8a92525e5 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:59.794584 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-a472ff0c-aa95-45b9-823f-0be8a92525e5 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db" status: 200 len: 1321 microversion: 2.1 time: 0.210283 Sep 27 17:24:59.795152 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 80/142] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:24:59 2022] GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db => generated 1321 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:24:59.810943 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-944587e6-c27d-4005-aa3a-37aa9e09211b tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48c146c0bba4583a92d157e2eed7f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c16b9aaa5ac4e6dac613614c1a570c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:24:59.818630 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-944587e6-c27d-4005-aa3a-37aa9e09211b tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] 10.222.0.55 "GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669" status: 200 len: 1314 microversion: 2.1 time: 0.199332 Sep 27 17:24:59.819203 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 63/143] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:24:59 2022] GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669 => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:24:59.868629 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-f074896f-068a-4fae-ab28-3c331340552e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:24:59.869236 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-f074896f-068a-4fae-ab28-3c331340552e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:24:59.875654 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f074896f-068a-4fae-ab28-3c331340552e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:59.876223 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f074896f-068a-4fae-ab28-3c331340552e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:59.876751 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f074896f-068a-4fae-ab28-3c331340552e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:24:59.877575 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f074896f-068a-4fae-ab28-3c331340552e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:24:59.878090 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f074896f-068a-4fae-ab28-3c331340552e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:24:59.878546 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f074896f-068a-4fae-ab28-3c331340552e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:00.006774 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-f074896f-068a-4fae-ab28-3c331340552e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:00.018494 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-f074896f-068a-4fae-ab28-3c331340552e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:00.019955 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-f074896f-068a-4fae-ab28-3c331340552e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:00.021065 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-f074896f-068a-4fae-ab28-3c331340552e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1406 microversion: 2.20 time: 0.156317 Sep 27 17:25:00.021647 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 81/144] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:24:59 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:25:00.816816 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-de2c75f1-1334-4561-8e6b-a37b7a39d417 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:00.817342 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-de2c75f1-1334-4561-8e6b-a37b7a39d417 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: d622d15d-b954-409c-a1f5-538da5de83db] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:00.823123 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-de2c75f1-1334-4561-8e6b-a37b7a39d417 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:00.823593 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-de2c75f1-1334-4561-8e6b-a37b7a39d417 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:00.824015 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-de2c75f1-1334-4561-8e6b-a37b7a39d417 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:00.824695 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-de2c75f1-1334-4561-8e6b-a37b7a39d417 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:00.825136 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-de2c75f1-1334-4561-8e6b-a37b7a39d417 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:00.825550 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-de2c75f1-1334-4561-8e6b-a37b7a39d417 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:00.843040 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-d44ad9c0-746e-4067-bc1d-634d52971cac tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:00.843742 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-d44ad9c0-746e-4067-bc1d-634d52971cac tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] [instance: 0e6c9900-b294-45b0-a692-18ed9f943669] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:00.850562 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d44ad9c0-746e-4067-bc1d-634d52971cac tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:00.851043 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d44ad9c0-746e-4067-bc1d-634d52971cac tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:00.851482 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d44ad9c0-746e-4067-bc1d-634d52971cac tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:00.854062 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d44ad9c0-746e-4067-bc1d-634d52971cac tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:00.854547 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d44ad9c0-746e-4067-bc1d-634d52971cac tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:00.855595 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d44ad9c0-746e-4067-bc1d-634d52971cac tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:01.016272 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-de2c75f1-1334-4561-8e6b-a37b7a39d417 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:01.025523 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-de2c75f1-1334-4561-8e6b-a37b7a39d417 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db" status: 200 len: 1321 microversion: 2.1 time: 0.212530 Sep 27 17:25:01.026134 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 64/145] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:00 2022] GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db => generated 1321 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:25:01.045802 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-d44ad9c0-746e-4067-bc1d-634d52971cac tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48c146c0bba4583a92d157e2eed7f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c16b9aaa5ac4e6dac613614c1a570c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:01.047801 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-0c678027-ec4e-4a30-8860-f9e45015e231 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:01.048711 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-0c678027-ec4e-4a30-8860-f9e45015e231 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:01.054474 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-d44ad9c0-746e-4067-bc1d-634d52971cac tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] 10.222.0.55 "GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669" status: 200 len: 1314 microversion: 2.1 time: 0.215946 Sep 27 17:25:01.055022 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 82/146] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:00 2022] GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669 => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:25:01.066453 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0c678027-ec4e-4a30-8860-f9e45015e231 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:01.066453 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0c678027-ec4e-4a30-8860-f9e45015e231 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:01.066453 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0c678027-ec4e-4a30-8860-f9e45015e231 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:01.066453 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0c678027-ec4e-4a30-8860-f9e45015e231 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:01.066884 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0c678027-ec4e-4a30-8860-f9e45015e231 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:01.066884 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0c678027-ec4e-4a30-8860-f9e45015e231 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:01.194770 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-0c678027-ec4e-4a30-8860-f9e45015e231 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:01.203675 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-0c678027-ec4e-4a30-8860-f9e45015e231 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:01.205265 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-0c678027-ec4e-4a30-8860-f9e45015e231 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:01.206440 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-0c678027-ec4e-4a30-8860-f9e45015e231 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1406 microversion: 2.20 time: 0.164256 Sep 27 17:25:01.207059 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 65/147] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:25:01 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 17:25:02.051202 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-8ab352f8-c86e-4e36-a0ce-f155f4eba795 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:02.052061 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-8ab352f8-c86e-4e36-a0ce-f155f4eba795 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: d622d15d-b954-409c-a1f5-538da5de83db] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:02.058555 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8ab352f8-c86e-4e36-a0ce-f155f4eba795 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:02.059050 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8ab352f8-c86e-4e36-a0ce-f155f4eba795 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:02.059483 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8ab352f8-c86e-4e36-a0ce-f155f4eba795 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:02.060178 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8ab352f8-c86e-4e36-a0ce-f155f4eba795 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:02.060628 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8ab352f8-c86e-4e36-a0ce-f155f4eba795 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:02.061079 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8ab352f8-c86e-4e36-a0ce-f155f4eba795 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:02.082348 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-42eb6802-8112-4ce2-a2a3-c509c0461672 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:02.083054 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-42eb6802-8112-4ce2-a2a3-c509c0461672 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] [instance: 0e6c9900-b294-45b0-a692-18ed9f943669] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:02.089713 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-42eb6802-8112-4ce2-a2a3-c509c0461672 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:02.090231 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-42eb6802-8112-4ce2-a2a3-c509c0461672 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:02.090659 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-42eb6802-8112-4ce2-a2a3-c509c0461672 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:02.091349 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-42eb6802-8112-4ce2-a2a3-c509c0461672 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:02.091791 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-42eb6802-8112-4ce2-a2a3-c509c0461672 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:02.092203 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-42eb6802-8112-4ce2-a2a3-c509c0461672 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:02.271361 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-8ab352f8-c86e-4e36-a0ce-f155f4eba795 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:02.278573 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-42eb6802-8112-4ce2-a2a3-c509c0461672 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48c146c0bba4583a92d157e2eed7f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c16b9aaa5ac4e6dac613614c1a570c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:02.282883 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-8ab352f8-c86e-4e36-a0ce-f155f4eba795 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db" status: 200 len: 1321 microversion: 2.1 time: 0.235610 Sep 27 17:25:02.283497 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 83/148] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:02 2022] GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db => generated 1321 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:25:02.287983 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-42eb6802-8112-4ce2-a2a3-c509c0461672 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] 10.222.0.55 "GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669" status: 200 len: 1314 microversion: 2.1 time: 0.213330 Sep 27 17:25:02.288439 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 66/149] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:02 2022] GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669 => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:25:02.298303 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-dc58ad12-c324-416a-a044-ab834bf745a4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:02.298303 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-dc58ad12-c324-416a-a044-ab834bf745a4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:02.298303 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-dc58ad12-c324-416a-a044-ab834bf745a4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:02.298303 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-dc58ad12-c324-416a-a044-ab834bf745a4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:02.298687 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-dc58ad12-c324-416a-a044-ab834bf745a4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:02.298687 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-dc58ad12-c324-416a-a044-ab834bf745a4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:02.298687 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-dc58ad12-c324-416a-a044-ab834bf745a4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:02.298687 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-dc58ad12-c324-416a-a044-ab834bf745a4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:02.431064 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-dc58ad12-c324-416a-a044-ab834bf745a4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:02.439346 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-dc58ad12-c324-416a-a044-ab834bf745a4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:02.440886 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-dc58ad12-c324-416a-a044-ab834bf745a4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:02.442100 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-dc58ad12-c324-416a-a044-ab834bf745a4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1406 microversion: 2.20 time: 0.157685 Sep 27 17:25:02.442753 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 84/150] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:25:02 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:25:02.692953 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [req-481374c3-bf95-49ce-95ab-b7654d95e8c0 req-f5b3cecf-28d5-469d-8dc9-9e32978b1e0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95a7693f-d1df-43fb-81e7-1c83b069e269", "name": "network-vif-plugged", "status": "completed", "tag": "c153b3a2-7878-4d7b-ac38-d30f63848b75"}]} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:25:02.702881 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-481374c3-bf95-49ce-95ab-b7654d95e8c0 req-f5b3cecf-28d5-469d-8dc9-9e32978b1e0a service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:02.703346 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-481374c3-bf95-49ce-95ab-b7654d95e8c0 req-f5b3cecf-28d5-469d-8dc9-9e32978b1e0a service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:02.703770 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-481374c3-bf95-49ce-95ab-b7654d95e8c0 req-f5b3cecf-28d5-469d-8dc9-9e32978b1e0a service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:02.715142 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.compute.server_external_events [req-481374c3-bf95-49ce-95ab-b7654d95e8c0 req-f5b3cecf-28d5-469d-8dc9-9e32978b1e0a service nova] Creating event network-vif-plugged:c153b3a2-7878-4d7b-ac38-d30f63848b75 for instance 95a7693f-d1df-43fb-81e7-1c83b069e269 on hv-cinder-84914 Sep 27 17:25:02.720075 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [req-481374c3-bf95-49ce-95ab-b7654d95e8c0 req-f5b3cecf-28d5-469d-8dc9-9e32978b1e0a service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088244 Sep 27 17:25:02.720651 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 67/151] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:25:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:25:03.307303 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-ec017e5b-9017-47e8-bb43-e699a607b8f1 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:03.307899 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-ec017e5b-9017-47e8-bb43-e699a607b8f1 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: d622d15d-b954-409c-a1f5-538da5de83db] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:03.317966 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-024a0642-56eb-4434-aefe-25eb5cb0bec3 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:03.317966 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-024a0642-56eb-4434-aefe-25eb5cb0bec3 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] [instance: 0e6c9900-b294-45b0-a692-18ed9f943669] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:03.318550 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ec017e5b-9017-47e8-bb43-e699a607b8f1 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:03.319590 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ec017e5b-9017-47e8-bb43-e699a607b8f1 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:03.320014 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ec017e5b-9017-47e8-bb43-e699a607b8f1 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:03.320755 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ec017e5b-9017-47e8-bb43-e699a607b8f1 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:03.322627 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ec017e5b-9017-47e8-bb43-e699a607b8f1 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:03.323697 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ec017e5b-9017-47e8-bb43-e699a607b8f1 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:03.325033 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-024a0642-56eb-4434-aefe-25eb5cb0bec3 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:03.325539 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-024a0642-56eb-4434-aefe-25eb5cb0bec3 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:03.325976 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-024a0642-56eb-4434-aefe-25eb5cb0bec3 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:03.326818 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-024a0642-56eb-4434-aefe-25eb5cb0bec3 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:03.327264 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-024a0642-56eb-4434-aefe-25eb5cb0bec3 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:03.328322 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-024a0642-56eb-4434-aefe-25eb5cb0bec3 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:03.556612 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-ec017e5b-9017-47e8-bb43-e699a607b8f1 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:03.561059 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-024a0642-56eb-4434-aefe-25eb5cb0bec3 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48c146c0bba4583a92d157e2eed7f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c16b9aaa5ac4e6dac613614c1a570c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:03.566196 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-ec017e5b-9017-47e8-bb43-e699a607b8f1 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db" status: 200 len: 1321 microversion: 2.1 time: 0.263307 Sep 27 17:25:03.570190 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 85/152] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:03 2022] GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db => generated 1321 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:25:03.570360 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-024a0642-56eb-4434-aefe-25eb5cb0bec3 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] 10.222.0.55 "GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669" status: 200 len: 1314 microversion: 2.1 time: 0.258636 Sep 27 17:25:03.570360 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 68/153] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:03 2022] GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669 => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:25:03.572112 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-75c1cd30-9888-48bf-a3f1-2afb47b4100c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:03.572834 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-75c1cd30-9888-48bf-a3f1-2afb47b4100c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:03.580787 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-75c1cd30-9888-48bf-a3f1-2afb47b4100c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:03.581594 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-75c1cd30-9888-48bf-a3f1-2afb47b4100c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:03.582205 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-75c1cd30-9888-48bf-a3f1-2afb47b4100c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:03.583066 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-75c1cd30-9888-48bf-a3f1-2afb47b4100c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:03.583684 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-75c1cd30-9888-48bf-a3f1-2afb47b4100c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:03.584215 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-75c1cd30-9888-48bf-a3f1-2afb47b4100c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:03.716520 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-75c1cd30-9888-48bf-a3f1-2afb47b4100c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:03.726217 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-75c1cd30-9888-48bf-a3f1-2afb47b4100c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:03.727711 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-75c1cd30-9888-48bf-a3f1-2afb47b4100c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:03.729076 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-75c1cd30-9888-48bf-a3f1-2afb47b4100c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1406 microversion: 2.20 time: 0.160914 Sep 27 17:25:03.731701 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 86/154] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:25:03 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:25:04.591777 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-75aaa09c-565e-4ae3-8fb4-8a7a3f61d23a tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:04.592476 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-75aaa09c-565e-4ae3-8fb4-8a7a3f61d23a tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: d622d15d-b954-409c-a1f5-538da5de83db] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:04.592996 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-35603dcf-6292-4bd5-8786-16ebd546bf18 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:04.593612 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-35603dcf-6292-4bd5-8786-16ebd546bf18 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] [instance: 0e6c9900-b294-45b0-a692-18ed9f943669] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:04.600026 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-75aaa09c-565e-4ae3-8fb4-8a7a3f61d23a tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:04.600230 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-35603dcf-6292-4bd5-8786-16ebd546bf18 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:04.600604 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-35603dcf-6292-4bd5-8786-16ebd546bf18 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:04.601214 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-35603dcf-6292-4bd5-8786-16ebd546bf18 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:04.601335 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-75aaa09c-565e-4ae3-8fb4-8a7a3f61d23a tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:04.601657 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-75aaa09c-565e-4ae3-8fb4-8a7a3f61d23a tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:04.602299 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-35603dcf-6292-4bd5-8786-16ebd546bf18 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:04.602542 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-75aaa09c-565e-4ae3-8fb4-8a7a3f61d23a tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:04.602759 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-35603dcf-6292-4bd5-8786-16ebd546bf18 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:04.603289 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-75aaa09c-565e-4ae3-8fb4-8a7a3f61d23a tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:04.603399 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-35603dcf-6292-4bd5-8786-16ebd546bf18 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:04.603724 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-75aaa09c-565e-4ae3-8fb4-8a7a3f61d23a tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:05.031177 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-75aaa09c-565e-4ae3-8fb4-8a7a3f61d23a tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:05.037390 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-35603dcf-6292-4bd5-8786-16ebd546bf18 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48c146c0bba4583a92d157e2eed7f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c16b9aaa5ac4e6dac613614c1a570c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:05.039449 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-75aaa09c-565e-4ae3-8fb4-8a7a3f61d23a tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db" status: 200 len: 1321 microversion: 2.1 time: 0.452303 Sep 27 17:25:05.040026 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 69/155] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:04 2022] GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db => generated 1321 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:25:05.044925 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-7c4f340b-b0a3-4034-99fb-d1d22980c451 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:05.045513 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-7c4f340b-b0a3-4034-99fb-d1d22980c451 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:05.051480 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7c4f340b-b0a3-4034-99fb-d1d22980c451 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:05.051959 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7c4f340b-b0a3-4034-99fb-d1d22980c451 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:05.052551 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7c4f340b-b0a3-4034-99fb-d1d22980c451 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:05.053382 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7c4f340b-b0a3-4034-99fb-d1d22980c451 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:05.053840 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7c4f340b-b0a3-4034-99fb-d1d22980c451 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:05.054340 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7c4f340b-b0a3-4034-99fb-d1d22980c451 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:05.058841 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-35603dcf-6292-4bd5-8786-16ebd546bf18 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] 10.222.0.55 "GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669" status: 200 len: 1314 microversion: 2.1 time: 0.471155 Sep 27 17:25:05.059424 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 87/156] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:04 2022] GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669 => generated 1314 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:25:05.210497 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-7c4f340b-b0a3-4034-99fb-d1d22980c451 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:05.218674 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-7c4f340b-b0a3-4034-99fb-d1d22980c451 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:05.221696 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-7c4f340b-b0a3-4034-99fb-d1d22980c451 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:05.223015 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-7c4f340b-b0a3-4034-99fb-d1d22980c451 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1406 microversion: 2.20 time: 0.181778 Sep 27 17:25:05.223781 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 70/157] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:25:05 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1406 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:25:06.063119 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-d9da055e-48bb-44bd-b5a6-2293d471d243 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:06.063725 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-d9da055e-48bb-44bd-b5a6-2293d471d243 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: d622d15d-b954-409c-a1f5-538da5de83db] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:06.069486 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d9da055e-48bb-44bd-b5a6-2293d471d243 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:06.069963 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d9da055e-48bb-44bd-b5a6-2293d471d243 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:06.070463 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d9da055e-48bb-44bd-b5a6-2293d471d243 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:06.071133 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d9da055e-48bb-44bd-b5a6-2293d471d243 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:06.071576 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d9da055e-48bb-44bd-b5a6-2293d471d243 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:06.071993 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d9da055e-48bb-44bd-b5a6-2293d471d243 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:06.083051 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-bb5749ed-b4da-4f86-b402-fdecc294fd9f tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:06.083665 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-bb5749ed-b4da-4f86-b402-fdecc294fd9f tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] [instance: 0e6c9900-b294-45b0-a692-18ed9f943669] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:06.090188 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-bb5749ed-b4da-4f86-b402-fdecc294fd9f tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:06.090690 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-bb5749ed-b4da-4f86-b402-fdecc294fd9f tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:06.091114 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-bb5749ed-b4da-4f86-b402-fdecc294fd9f tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:06.091811 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-bb5749ed-b4da-4f86-b402-fdecc294fd9f tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:06.092283 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-bb5749ed-b4da-4f86-b402-fdecc294fd9f tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:06.092689 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-bb5749ed-b4da-4f86-b402-fdecc294fd9f tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:06.285765 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-d9da055e-48bb-44bd-b5a6-2293d471d243 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:06.289616 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-bb5749ed-b4da-4f86-b402-fdecc294fd9f tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48c146c0bba4583a92d157e2eed7f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c16b9aaa5ac4e6dac613614c1a570c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:06.295714 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-d9da055e-48bb-44bd-b5a6-2293d471d243 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db" status: 200 len: 1321 microversion: 2.1 time: 0.236428 Sep 27 17:25:06.308672 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 88/158] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:06 2022] GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db => generated 1321 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:25:06.308672 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-3b4ec777-0e9f-44af-b420-d1eae3c50926 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:06.308672 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-3b4ec777-0e9f-44af-b420-d1eae3c50926 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:06.308672 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3b4ec777-0e9f-44af-b420-d1eae3c50926 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:06.309048 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3b4ec777-0e9f-44af-b420-d1eae3c50926 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:06.309217 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3b4ec777-0e9f-44af-b420-d1eae3c50926 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:06.310121 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3b4ec777-0e9f-44af-b420-d1eae3c50926 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:06.310720 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3b4ec777-0e9f-44af-b420-d1eae3c50926 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:06.311132 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3b4ec777-0e9f-44af-b420-d1eae3c50926 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:06.313928 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-bb5749ed-b4da-4f86-b402-fdecc294fd9f tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] 10.222.0.55 "GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669" status: 200 len: 1314 microversion: 2.1 time: 0.234828 Sep 27 17:25:06.314965 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 71/159] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:06 2022] GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669 => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:25:06.442914 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-3b4ec777-0e9f-44af-b420-d1eae3c50926 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:06.450809 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-3b4ec777-0e9f-44af-b420-d1eae3c50926 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:06.452241 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-3b4ec777-0e9f-44af-b420-d1eae3c50926 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:06.453324 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-3b4ec777-0e9f-44af-b420-d1eae3c50926 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1406 microversion: 2.20 time: 0.156142 Sep 27 17:25:06.453872 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 89/160] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:25:06 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:25:07.318895 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-cd493093-5926-44ce-890b-9251f1a315cd tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:07.319538 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-cd493093-5926-44ce-890b-9251f1a315cd tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: d622d15d-b954-409c-a1f5-538da5de83db] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:07.326097 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cd493093-5926-44ce-890b-9251f1a315cd tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:07.326572 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cd493093-5926-44ce-890b-9251f1a315cd tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:07.326995 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cd493093-5926-44ce-890b-9251f1a315cd tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:07.327670 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cd493093-5926-44ce-890b-9251f1a315cd tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:07.328136 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cd493093-5926-44ce-890b-9251f1a315cd tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:07.328549 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cd493093-5926-44ce-890b-9251f1a315cd tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:07.337068 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-8522e456-6950-4300-a630-26abd174ef4c tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:07.337683 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-8522e456-6950-4300-a630-26abd174ef4c tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] [instance: 0e6c9900-b294-45b0-a692-18ed9f943669] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:07.344283 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8522e456-6950-4300-a630-26abd174ef4c tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:07.344758 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8522e456-6950-4300-a630-26abd174ef4c tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:07.345186 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8522e456-6950-4300-a630-26abd174ef4c tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:07.345906 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8522e456-6950-4300-a630-26abd174ef4c tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:07.346379 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8522e456-6950-4300-a630-26abd174ef4c tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:07.346809 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8522e456-6950-4300-a630-26abd174ef4c tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:07.350938 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_cell1:SELECT=100 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:25:07.524475 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-cd493093-5926-44ce-890b-9251f1a315cd tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:07.528414 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-8522e456-6950-4300-a630-26abd174ef4c tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48c146c0bba4583a92d157e2eed7f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c16b9aaa5ac4e6dac613614c1a570c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:07.532789 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-cd493093-5926-44ce-890b-9251f1a315cd tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db" status: 200 len: 1321 microversion: 2.1 time: 0.217626 Sep 27 17:25:07.533425 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 72/161] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:07 2022] GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db => generated 1321 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:25:07.536696 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-8522e456-6950-4300-a630-26abd174ef4c tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] 10.222.0.55 "GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669" status: 200 len: 1314 microversion: 2.1 time: 0.203202 Sep 27 17:25:07.537106 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 90/162] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:07 2022] GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669 => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:25:07.548949 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-456c7c1d-790f-4384-a2f2-8b1996677e2b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:07.549712 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-456c7c1d-790f-4384-a2f2-8b1996677e2b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:07.555642 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-456c7c1d-790f-4384-a2f2-8b1996677e2b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:07.556074 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-456c7c1d-790f-4384-a2f2-8b1996677e2b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:07.556501 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-456c7c1d-790f-4384-a2f2-8b1996677e2b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:07.557186 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-456c7c1d-790f-4384-a2f2-8b1996677e2b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:07.557670 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-456c7c1d-790f-4384-a2f2-8b1996677e2b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:07.558106 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-456c7c1d-790f-4384-a2f2-8b1996677e2b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:07.681453 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-456c7c1d-790f-4384-a2f2-8b1996677e2b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:07.685515 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell1:SELECT=100 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:25:07.691189 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-456c7c1d-790f-4384-a2f2-8b1996677e2b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:07.692618 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-456c7c1d-790f-4384-a2f2-8b1996677e2b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:07.693725 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-456c7c1d-790f-4384-a2f2-8b1996677e2b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1406 microversion: 2.20 time: 0.159182 Sep 27 17:25:07.694304 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 73/163] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:25:07 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:25:08.556438 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-e3de3e8f-1bc0-459d-920f-9ad5b1c4f22a tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:08.557045 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-e3de3e8f-1bc0-459d-920f-9ad5b1c4f22a tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: d622d15d-b954-409c-a1f5-538da5de83db] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:08.560716 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-f10a81a2-edf7-4d23-807c-803e36c82c73 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:08.561988 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-f10a81a2-edf7-4d23-807c-803e36c82c73 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] [instance: 0e6c9900-b294-45b0-a692-18ed9f943669] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:08.563675 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e3de3e8f-1bc0-459d-920f-9ad5b1c4f22a tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:08.564353 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e3de3e8f-1bc0-459d-920f-9ad5b1c4f22a tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:08.566562 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e3de3e8f-1bc0-459d-920f-9ad5b1c4f22a tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:08.566562 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e3de3e8f-1bc0-459d-920f-9ad5b1c4f22a tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:08.566562 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e3de3e8f-1bc0-459d-920f-9ad5b1c4f22a tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:08.567000 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e3de3e8f-1bc0-459d-920f-9ad5b1c4f22a tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:08.578043 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f10a81a2-edf7-4d23-807c-803e36c82c73 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:08.578619 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f10a81a2-edf7-4d23-807c-803e36c82c73 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:08.582854 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f10a81a2-edf7-4d23-807c-803e36c82c73 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:08.583824 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f10a81a2-edf7-4d23-807c-803e36c82c73 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:08.584494 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f10a81a2-edf7-4d23-807c-803e36c82c73 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:08.585152 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f10a81a2-edf7-4d23-807c-803e36c82c73 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:08.993664 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-e3de3e8f-1bc0-459d-920f-9ad5b1c4f22a tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:08.997785 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-f10a81a2-edf7-4d23-807c-803e36c82c73 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48c146c0bba4583a92d157e2eed7f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c16b9aaa5ac4e6dac613614c1a570c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:09.001897 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-e3de3e8f-1bc0-459d-920f-9ad5b1c4f22a tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db" status: 200 len: 1321 microversion: 2.1 time: 0.449414 Sep 27 17:25:09.002507 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 91/164] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:08 2022] GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db => generated 1321 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:25:09.005622 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-f10a81a2-edf7-4d23-807c-803e36c82c73 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] 10.222.0.55 "GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669" status: 200 len: 1314 microversion: 2.1 time: 0.450077 Sep 27 17:25:09.006611 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 74/165] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:08 2022] GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669 => generated 1314 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:25:09.006955 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-94119d28-d2be-4586-8224-d7049a66f218 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:09.007559 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-94119d28-d2be-4586-8224-d7049a66f218 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:09.014054 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-94119d28-d2be-4586-8224-d7049a66f218 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:09.014786 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-94119d28-d2be-4586-8224-d7049a66f218 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:09.015374 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-94119d28-d2be-4586-8224-d7049a66f218 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:09.016232 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-94119d28-d2be-4586-8224-d7049a66f218 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:09.016838 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-94119d28-d2be-4586-8224-d7049a66f218 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:09.017415 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-94119d28-d2be-4586-8224-d7049a66f218 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:09.148217 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-94119d28-d2be-4586-8224-d7049a66f218 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:09.156732 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-94119d28-d2be-4586-8224-d7049a66f218 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:09.158218 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-94119d28-d2be-4586-8224-d7049a66f218 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:09.159330 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-94119d28-d2be-4586-8224-d7049a66f218 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1406 microversion: 2.20 time: 0.155903 Sep 27 17:25:09.160060 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 92/166] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:25:09 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:25:10.026487 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-acb7c281-36c8-4aab-86d6-bd5f2fb7e963 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:10.027107 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-acb7c281-36c8-4aab-86d6-bd5f2fb7e963 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: d622d15d-b954-409c-a1f5-538da5de83db] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:10.030697 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-036a11d0-e783-4866-991e-cb9bf4ce486f tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:10.031324 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-036a11d0-e783-4866-991e-cb9bf4ce486f tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] [instance: 0e6c9900-b294-45b0-a692-18ed9f943669] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:10.040442 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-036a11d0-e783-4866-991e-cb9bf4ce486f tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:10.041220 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-036a11d0-e783-4866-991e-cb9bf4ce486f tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:10.042344 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-acb7c281-36c8-4aab-86d6-bd5f2fb7e963 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:10.042462 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-036a11d0-e783-4866-991e-cb9bf4ce486f tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:10.042842 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-acb7c281-36c8-4aab-86d6-bd5f2fb7e963 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:10.043282 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-acb7c281-36c8-4aab-86d6-bd5f2fb7e963 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:10.044338 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-036a11d0-e783-4866-991e-cb9bf4ce486f tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:10.045039 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-036a11d0-e783-4866-991e-cb9bf4ce486f tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:10.045470 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-036a11d0-e783-4866-991e-cb9bf4ce486f tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:10.048306 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-acb7c281-36c8-4aab-86d6-bd5f2fb7e963 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:10.048910 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-acb7c281-36c8-4aab-86d6-bd5f2fb7e963 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:10.049360 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-acb7c281-36c8-4aab-86d6-bd5f2fb7e963 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:10.401618 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-036a11d0-e783-4866-991e-cb9bf4ce486f tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48c146c0bba4583a92d157e2eed7f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c16b9aaa5ac4e6dac613614c1a570c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:10.414632 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-036a11d0-e783-4866-991e-cb9bf4ce486f tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] 10.222.0.55 "GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669" status: 200 len: 1314 microversion: 2.1 time: 0.388450 Sep 27 17:25:10.426932 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-acb7c281-36c8-4aab-86d6-bd5f2fb7e963 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:10.428159 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 93/167] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:10 2022] GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669 => generated 1314 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:25:10.428558 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-acb7c281-36c8-4aab-86d6-bd5f2fb7e963 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db" status: 200 len: 1321 microversion: 2.1 time: 0.407107 Sep 27 17:25:10.429168 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 75/168] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:10 2022] GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db => generated 1321 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:25:10.442444 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-5cdb3ee6-919b-4636-87b1-dc9ea2fca64a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:10.442444 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-5cdb3ee6-919b-4636-87b1-dc9ea2fca64a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:10.446706 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5cdb3ee6-919b-4636-87b1-dc9ea2fca64a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:10.447212 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5cdb3ee6-919b-4636-87b1-dc9ea2fca64a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:10.448003 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5cdb3ee6-919b-4636-87b1-dc9ea2fca64a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:10.448996 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5cdb3ee6-919b-4636-87b1-dc9ea2fca64a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:10.449506 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5cdb3ee6-919b-4636-87b1-dc9ea2fca64a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:10.450565 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5cdb3ee6-919b-4636-87b1-dc9ea2fca64a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:10.612863 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-5cdb3ee6-919b-4636-87b1-dc9ea2fca64a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:10.621444 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-5cdb3ee6-919b-4636-87b1-dc9ea2fca64a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:10.622969 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-5cdb3ee6-919b-4636-87b1-dc9ea2fca64a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:10.624095 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-5cdb3ee6-919b-4636-87b1-dc9ea2fca64a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1406 microversion: 2.20 time: 0.194278 Sep 27 17:25:10.624655 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 94/169] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:25:10 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1406 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:25:11.024633 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [req-53aa840f-77fe-4c8f-a441-70489c69f9ce req-3b66c0f6-c85e-421c-b752-36d20560b3da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d622d15d-b954-409c-a1f5-538da5de83db", "name": "network-vif-plugged", "status": "completed", "tag": "636a119c-4ac6-4298-8d42-f47c495d9a5b"}]} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:25:11.042185 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-53aa840f-77fe-4c8f-a441-70489c69f9ce req-3b66c0f6-c85e-421c-b752-36d20560b3da service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:11.042843 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-53aa840f-77fe-4c8f-a441-70489c69f9ce req-3b66c0f6-c85e-421c-b752-36d20560b3da service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:11.043071 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-53aa840f-77fe-4c8f-a441-70489c69f9ce req-3b66c0f6-c85e-421c-b752-36d20560b3da service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:11.071207 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.compute.server_external_events [req-53aa840f-77fe-4c8f-a441-70489c69f9ce req-3b66c0f6-c85e-421c-b752-36d20560b3da service nova] Creating event network-vif-plugged:636a119c-4ac6-4298-8d42-f47c495d9a5b for instance d622d15d-b954-409c-a1f5-538da5de83db on hv-cinder-84914 Sep 27 17:25:11.084595 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [req-53aa840f-77fe-4c8f-a441-70489c69f9ce req-3b66c0f6-c85e-421c-b752-36d20560b3da service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064736 Sep 27 17:25:11.085358 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 76/170] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:25:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:25:11.441340 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-fd4ff9df-5192-44cc-86a5-422639e38415 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:11.442019 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-fd4ff9df-5192-44cc-86a5-422639e38415 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] [instance: 0e6c9900-b294-45b0-a692-18ed9f943669] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:11.450461 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-fd4ff9df-5192-44cc-86a5-422639e38415 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:11.451116 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-fd4ff9df-5192-44cc-86a5-422639e38415 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:11.451715 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-fd4ff9df-5192-44cc-86a5-422639e38415 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:11.452588 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-fd4ff9df-5192-44cc-86a5-422639e38415 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:11.453188 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-fd4ff9df-5192-44cc-86a5-422639e38415 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:11.453753 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-fd4ff9df-5192-44cc-86a5-422639e38415 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:11.456551 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-518fcfa9-17cb-45ed-91bc-59622d1c28ab tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:11.457420 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-518fcfa9-17cb-45ed-91bc-59622d1c28ab tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: d622d15d-b954-409c-a1f5-538da5de83db] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:11.466825 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-518fcfa9-17cb-45ed-91bc-59622d1c28ab tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:11.467307 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-518fcfa9-17cb-45ed-91bc-59622d1c28ab tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:11.467736 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-518fcfa9-17cb-45ed-91bc-59622d1c28ab tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:11.468426 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-518fcfa9-17cb-45ed-91bc-59622d1c28ab tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:11.468870 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-518fcfa9-17cb-45ed-91bc-59622d1c28ab tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:11.469284 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-518fcfa9-17cb-45ed-91bc-59622d1c28ab tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:11.752378 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-518fcfa9-17cb-45ed-91bc-59622d1c28ab tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:11.761201 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-518fcfa9-17cb-45ed-91bc-59622d1c28ab tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db" status: 200 len: 1321 microversion: 2.1 time: 0.310004 Sep 27 17:25:11.762487 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 77/171] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:11 2022] GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db => generated 1321 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:25:11.765380 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-fd4ff9df-5192-44cc-86a5-422639e38415 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48c146c0bba4583a92d157e2eed7f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c16b9aaa5ac4e6dac613614c1a570c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:11.768042 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-c096df60-b255-434a-b8d7-23281dcaac0e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:11.768804 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-c096df60-b255-434a-b8d7-23281dcaac0e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:11.775244 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c096df60-b255-434a-b8d7-23281dcaac0e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:11.776651 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c096df60-b255-434a-b8d7-23281dcaac0e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:11.777291 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c096df60-b255-434a-b8d7-23281dcaac0e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:11.778554 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c096df60-b255-434a-b8d7-23281dcaac0e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:11.779629 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c096df60-b255-434a-b8d7-23281dcaac0e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:11.780647 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c096df60-b255-434a-b8d7-23281dcaac0e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:11.799317 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-fd4ff9df-5192-44cc-86a5-422639e38415 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] 10.222.0.55 "GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669" status: 200 len: 1314 microversion: 2.1 time: 0.361591 Sep 27 17:25:11.810144 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 95/172] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:11 2022] GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669 => generated 1314 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:25:11.958395 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-c096df60-b255-434a-b8d7-23281dcaac0e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:11.968155 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-c096df60-b255-434a-b8d7-23281dcaac0e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:11.969792 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-c096df60-b255-434a-b8d7-23281dcaac0e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:11.971658 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-c096df60-b255-434a-b8d7-23281dcaac0e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1406 microversion: 2.20 time: 0.208024 Sep 27 17:25:11.972384 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 78/173] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:25:11 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1406 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:25:12.786349 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-964eaa98-bb78-4603-bdbb-04cdc80cd7ba tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:12.787847 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-964eaa98-bb78-4603-bdbb-04cdc80cd7ba tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: d622d15d-b954-409c-a1f5-538da5de83db] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:12.789947 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_api:SELECT=74 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:25:12.797058 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-964eaa98-bb78-4603-bdbb-04cdc80cd7ba tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:12.802814 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-964eaa98-bb78-4603-bdbb-04cdc80cd7ba tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:12.803334 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-964eaa98-bb78-4603-bdbb-04cdc80cd7ba tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:12.804073 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-964eaa98-bb78-4603-bdbb-04cdc80cd7ba tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:12.804543 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-964eaa98-bb78-4603-bdbb-04cdc80cd7ba tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:12.805096 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-964eaa98-bb78-4603-bdbb-04cdc80cd7ba tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:12.826484 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-fc8e0b80-3254-4b20-978d-163be13b07e8 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:12.827952 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-fc8e0b80-3254-4b20-978d-163be13b07e8 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] [instance: 0e6c9900-b294-45b0-a692-18ed9f943669] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:12.837893 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fc8e0b80-3254-4b20-978d-163be13b07e8 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:12.838971 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fc8e0b80-3254-4b20-978d-163be13b07e8 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:12.839766 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fc8e0b80-3254-4b20-978d-163be13b07e8 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:12.841029 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fc8e0b80-3254-4b20-978d-163be13b07e8 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:12.841838 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fc8e0b80-3254-4b20-978d-163be13b07e8 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:12.843361 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fc8e0b80-3254-4b20-978d-163be13b07e8 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:13.084071 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-964eaa98-bb78-4603-bdbb-04cdc80cd7ba tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:13.097630 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-964eaa98-bb78-4603-bdbb-04cdc80cd7ba tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db" status: 200 len: 1321 microversion: 2.1 time: 0.314576 Sep 27 17:25:13.101448 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 96/174] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:12 2022] GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db => generated 1321 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:25:13.114897 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-fc8e0b80-3254-4b20-978d-163be13b07e8 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48c146c0bba4583a92d157e2eed7f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c16b9aaa5ac4e6dac613614c1a570c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:13.122299 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-5c9ca2ed-2af9-4b79-b261-a8566857df22 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:13.138321 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-5c9ca2ed-2af9-4b79-b261-a8566857df22 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:13.144324 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-fc8e0b80-3254-4b20-978d-163be13b07e8 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] 10.222.0.55 "GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669" status: 200 len: 1314 microversion: 2.1 time: 0.312488 Sep 27 17:25:13.145372 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 79/175] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:12 2022] GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669 => generated 1314 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:25:13.170264 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5c9ca2ed-2af9-4b79-b261-a8566857df22 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:13.181163 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5c9ca2ed-2af9-4b79-b261-a8566857df22 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:13.186203 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5c9ca2ed-2af9-4b79-b261-a8566857df22 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:13.187330 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5c9ca2ed-2af9-4b79-b261-a8566857df22 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:13.193422 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5c9ca2ed-2af9-4b79-b261-a8566857df22 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:13.194959 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5c9ca2ed-2af9-4b79-b261-a8566857df22 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:13.452294 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-5c9ca2ed-2af9-4b79-b261-a8566857df22 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:13.461300 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-5c9ca2ed-2af9-4b79-b261-a8566857df22 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:13.467876 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-5c9ca2ed-2af9-4b79-b261-a8566857df22 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:13.469414 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-5c9ca2ed-2af9-4b79-b261-a8566857df22 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1406 microversion: 2.20 time: 0.366755 Sep 27 17:25:13.469974 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 97/176] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:25:13 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1406 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:25:14.127704 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-d51a0c9b-f2cb-4603-b468-15a05e3d110a tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:14.128326 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-d51a0c9b-f2cb-4603-b468-15a05e3d110a tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: d622d15d-b954-409c-a1f5-538da5de83db] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:14.133710 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_api:SELECT=72 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:25:14.135456 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d51a0c9b-f2cb-4603-b468-15a05e3d110a tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:14.135941 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d51a0c9b-f2cb-4603-b468-15a05e3d110a tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:14.136753 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d51a0c9b-f2cb-4603-b468-15a05e3d110a tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:14.137450 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d51a0c9b-f2cb-4603-b468-15a05e3d110a tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:14.137987 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d51a0c9b-f2cb-4603-b468-15a05e3d110a tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:14.138609 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d51a0c9b-f2cb-4603-b468-15a05e3d110a tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:14.169921 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-0a1e1cd4-487e-4851-9b4a-89b81317c007 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:14.171151 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-0a1e1cd4-487e-4851-9b4a-89b81317c007 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] [instance: 0e6c9900-b294-45b0-a692-18ed9f943669] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:14.183079 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-0a1e1cd4-487e-4851-9b4a-89b81317c007 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:14.183793 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-0a1e1cd4-487e-4851-9b4a-89b81317c007 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:14.185006 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-0a1e1cd4-487e-4851-9b4a-89b81317c007 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:14.188647 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-0a1e1cd4-487e-4851-9b4a-89b81317c007 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:14.189526 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-0a1e1cd4-487e-4851-9b4a-89b81317c007 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:14.190576 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-0a1e1cd4-487e-4851-9b4a-89b81317c007 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:14.886487 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-0a1e1cd4-487e-4851-9b4a-89b81317c007 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48c146c0bba4583a92d157e2eed7f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c16b9aaa5ac4e6dac613614c1a570c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:14.895142 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-0a1e1cd4-487e-4851-9b4a-89b81317c007 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] 10.222.0.55 "GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669" status: 200 len: 1314 microversion: 2.1 time: 0.730042 Sep 27 17:25:14.906853 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 98/177] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:14 2022] GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669 => generated 1314 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:25:14.928947 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-8ca3e51f-dd51-4275-b6c0-46b3639bd15e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:14.930027 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-8ca3e51f-dd51-4275-b6c0-46b3639bd15e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:14.957669 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8ca3e51f-dd51-4275-b6c0-46b3639bd15e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:14.958754 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8ca3e51f-dd51-4275-b6c0-46b3639bd15e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:14.959639 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8ca3e51f-dd51-4275-b6c0-46b3639bd15e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:14.960967 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8ca3e51f-dd51-4275-b6c0-46b3639bd15e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:14.961864 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8ca3e51f-dd51-4275-b6c0-46b3639bd15e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:14.962470 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8ca3e51f-dd51-4275-b6c0-46b3639bd15e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:15.220801 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-d51a0c9b-f2cb-4603-b468-15a05e3d110a tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:15.230156 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-d51a0c9b-f2cb-4603-b468-15a05e3d110a tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db" status: 200 len: 1321 microversion: 2.1 time: 1.106286 Sep 27 17:25:15.238156 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 80/178] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:14 2022] GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db => generated 1321 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:25:15.259910 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [req-5ccf6ce0-6fad-4174-ace3-edc74e34eca0 req-50af369e-bc7f-499c-9c2b-e8d210a45559 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e6c9900-b294-45b0-a692-18ed9f943669", "name": "network-vif-plugged", "status": "completed", "tag": "8da35e49-fd42-450d-b5d6-f220c2448d60"}]} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:25:15.276663 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-5ccf6ce0-6fad-4174-ace3-edc74e34eca0 req-50af369e-bc7f-499c-9c2b-e8d210a45559 service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:15.277566 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-5ccf6ce0-6fad-4174-ace3-edc74e34eca0 req-50af369e-bc7f-499c-9c2b-e8d210a45559 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:15.278121 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-5ccf6ce0-6fad-4174-ace3-edc74e34eca0 req-50af369e-bc7f-499c-9c2b-e8d210a45559 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:15.308220 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.compute.server_external_events [req-5ccf6ce0-6fad-4174-ace3-edc74e34eca0 req-50af369e-bc7f-499c-9c2b-e8d210a45559 service nova] Creating event network-vif-plugged:8da35e49-fd42-450d-b5d6-f220c2448d60 for instance 0e6c9900-b294-45b0-a692-18ed9f943669 on hv-cinder-84914 Sep 27 17:25:15.313911 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [req-5ccf6ce0-6fad-4174-ace3-edc74e34eca0 req-50af369e-bc7f-499c-9c2b-e8d210a45559 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074056 Sep 27 17:25:15.314532 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 81/179] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:25:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:25:15.496043 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-8ca3e51f-dd51-4275-b6c0-46b3639bd15e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:15.520909 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-8ca3e51f-dd51-4275-b6c0-46b3639bd15e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:15.523675 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-8ca3e51f-dd51-4275-b6c0-46b3639bd15e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:15.525978 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-8ca3e51f-dd51-4275-b6c0-46b3639bd15e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1406 microversion: 2.20 time: 0.602077 Sep 27 17:25:15.526857 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 99/180] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:25:14 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1406 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:25:15.935967 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-0812d49d-2e67-4712-a0bd-5f92492e5dde tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:15.936613 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-0812d49d-2e67-4712-a0bd-5f92492e5dde tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] [instance: 0e6c9900-b294-45b0-a692-18ed9f943669] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:15.945496 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0812d49d-2e67-4712-a0bd-5f92492e5dde tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:15.946648 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0812d49d-2e67-4712-a0bd-5f92492e5dde tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:15.950648 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0812d49d-2e67-4712-a0bd-5f92492e5dde tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:15.951586 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0812d49d-2e67-4712-a0bd-5f92492e5dde tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:15.952122 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0812d49d-2e67-4712-a0bd-5f92492e5dde tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:15.952615 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0812d49d-2e67-4712-a0bd-5f92492e5dde tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:16.124860 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-0812d49d-2e67-4712-a0bd-5f92492e5dde tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48c146c0bba4583a92d157e2eed7f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c16b9aaa5ac4e6dac613614c1a570c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:16.134426 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-0812d49d-2e67-4712-a0bd-5f92492e5dde tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] 10.222.0.55 "GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669" status: 200 len: 1314 microversion: 2.1 time: 0.202970 Sep 27 17:25:16.135012 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 82/181] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:15 2022] GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669 => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:25:16.256957 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-31a1ab67-f384-4446-9252-59c0000b8fdc tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:16.257647 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-31a1ab67-f384-4446-9252-59c0000b8fdc tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: d622d15d-b954-409c-a1f5-538da5de83db] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:16.265224 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-31a1ab67-f384-4446-9252-59c0000b8fdc tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:16.265703 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-31a1ab67-f384-4446-9252-59c0000b8fdc tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:16.266138 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-31a1ab67-f384-4446-9252-59c0000b8fdc tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:16.266992 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-31a1ab67-f384-4446-9252-59c0000b8fdc tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:16.267327 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-31a1ab67-f384-4446-9252-59c0000b8fdc tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:16.267788 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-31a1ab67-f384-4446-9252-59c0000b8fdc tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:16.452953 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-31a1ab67-f384-4446-9252-59c0000b8fdc tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:16.463552 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-31a1ab67-f384-4446-9252-59c0000b8fdc tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db" status: 200 len: 1321 microversion: 2.1 time: 0.211569 Sep 27 17:25:16.471133 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 100/182] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:16 2022] GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db => generated 1321 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:25:16.558610 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-97569237-7e79-4929-a3db-6277788db2c6 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:16.558610 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-97569237-7e79-4929-a3db-6277788db2c6 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:16.565682 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-97569237-7e79-4929-a3db-6277788db2c6 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:16.565682 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-97569237-7e79-4929-a3db-6277788db2c6 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:16.569058 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-97569237-7e79-4929-a3db-6277788db2c6 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:16.569792 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-97569237-7e79-4929-a3db-6277788db2c6 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:16.570287 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-97569237-7e79-4929-a3db-6277788db2c6 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:16.570738 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-97569237-7e79-4929-a3db-6277788db2c6 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:16.753299 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-97569237-7e79-4929-a3db-6277788db2c6 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:16.764619 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-97569237-7e79-4929-a3db-6277788db2c6 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:16.766873 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-97569237-7e79-4929-a3db-6277788db2c6 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:16.768195 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-97569237-7e79-4929-a3db-6277788db2c6 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1406 microversion: 2.20 time: 0.217170 Sep 27 17:25:16.768758 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 83/183] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:25:16 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1406 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 17:25:17.157747 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-4f6e4ad6-d1cf-4911-9c85-b2ee0d84036a tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:17.158561 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-4f6e4ad6-d1cf-4911-9c85-b2ee0d84036a tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] [instance: 0e6c9900-b294-45b0-a692-18ed9f943669] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:17.174827 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4f6e4ad6-d1cf-4911-9c85-b2ee0d84036a tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:17.175387 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4f6e4ad6-d1cf-4911-9c85-b2ee0d84036a tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:17.175824 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4f6e4ad6-d1cf-4911-9c85-b2ee0d84036a tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:17.177227 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4f6e4ad6-d1cf-4911-9c85-b2ee0d84036a tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:17.178369 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4f6e4ad6-d1cf-4911-9c85-b2ee0d84036a tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:17.179546 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4f6e4ad6-d1cf-4911-9c85-b2ee0d84036a tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:17.417813 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-4f6e4ad6-d1cf-4911-9c85-b2ee0d84036a tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48c146c0bba4583a92d157e2eed7f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c16b9aaa5ac4e6dac613614c1a570c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:17.427710 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-4f6e4ad6-d1cf-4911-9c85-b2ee0d84036a tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] 10.222.0.55 "GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669" status: 200 len: 1314 microversion: 2.1 time: 0.273790 Sep 27 17:25:17.428465 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 101/184] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:17 2022] GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669 => generated 1314 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:25:17.488951 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-a575c8ae-0cc4-489f-89ff-244ca237c0a3 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:17.489679 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-a575c8ae-0cc4-489f-89ff-244ca237c0a3 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: d622d15d-b954-409c-a1f5-538da5de83db] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:17.495920 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a575c8ae-0cc4-489f-89ff-244ca237c0a3 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:17.496655 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a575c8ae-0cc4-489f-89ff-244ca237c0a3 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:17.497345 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a575c8ae-0cc4-489f-89ff-244ca237c0a3 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:17.498636 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a575c8ae-0cc4-489f-89ff-244ca237c0a3 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:17.499303 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a575c8ae-0cc4-489f-89ff-244ca237c0a3 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:17.500059 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a575c8ae-0cc4-489f-89ff-244ca237c0a3 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:17.708063 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-a575c8ae-0cc4-489f-89ff-244ca237c0a3 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:17.716521 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-a575c8ae-0cc4-489f-89ff-244ca237c0a3 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db" status: 200 len: 1321 microversion: 2.1 time: 0.231908 Sep 27 17:25:17.717072 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 84/185] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:17 2022] GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db => generated 1321 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:25:17.793491 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-797413f3-1393-4e79-9349-44f50f8e4a16 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:17.794635 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-797413f3-1393-4e79-9349-44f50f8e4a16 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:17.801446 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-797413f3-1393-4e79-9349-44f50f8e4a16 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:17.802256 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-797413f3-1393-4e79-9349-44f50f8e4a16 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:17.802889 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-797413f3-1393-4e79-9349-44f50f8e4a16 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:17.803941 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-797413f3-1393-4e79-9349-44f50f8e4a16 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:17.804468 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-797413f3-1393-4e79-9349-44f50f8e4a16 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:17.805306 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-797413f3-1393-4e79-9349-44f50f8e4a16 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:17.977907 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-797413f3-1393-4e79-9349-44f50f8e4a16 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:17.993078 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-797413f3-1393-4e79-9349-44f50f8e4a16 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:17.994555 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-797413f3-1393-4e79-9349-44f50f8e4a16 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:17.995668 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-797413f3-1393-4e79-9349-44f50f8e4a16 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1406 microversion: 2.20 time: 0.206095 Sep 27 17:25:17.996222 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 102/186] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:25:17 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1406 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:25:18.457174 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-30fec1f0-6b24-450b-a952-9f9b2861a94b tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:18.467732 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-30fec1f0-6b24-450b-a952-9f9b2861a94b tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] [instance: 0e6c9900-b294-45b0-a692-18ed9f943669] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:18.474357 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-30fec1f0-6b24-450b-a952-9f9b2861a94b tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:18.474978 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-30fec1f0-6b24-450b-a952-9f9b2861a94b tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:18.475428 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-30fec1f0-6b24-450b-a952-9f9b2861a94b tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:18.476235 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-30fec1f0-6b24-450b-a952-9f9b2861a94b tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:18.476970 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-30fec1f0-6b24-450b-a952-9f9b2861a94b tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:18.479256 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-30fec1f0-6b24-450b-a952-9f9b2861a94b tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:18.644982 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-30fec1f0-6b24-450b-a952-9f9b2861a94b tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48c146c0bba4583a92d157e2eed7f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c16b9aaa5ac4e6dac613614c1a570c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:18.655579 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-30fec1f0-6b24-450b-a952-9f9b2861a94b tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] 10.222.0.55 "GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669" status: 200 len: 1314 microversion: 2.1 time: 0.202270 Sep 27 17:25:18.665563 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 85/187] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:18 2022] GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669 => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:25:18.740326 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-bbe148ba-9b26-47b9-a84b-d7f5bdf151e9 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:18.740941 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-bbe148ba-9b26-47b9-a84b-d7f5bdf151e9 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: d622d15d-b954-409c-a1f5-538da5de83db] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:18.752951 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-bbe148ba-9b26-47b9-a84b-d7f5bdf151e9 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:18.753960 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-bbe148ba-9b26-47b9-a84b-d7f5bdf151e9 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:18.758421 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-bbe148ba-9b26-47b9-a84b-d7f5bdf151e9 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:18.775862 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-bbe148ba-9b26-47b9-a84b-d7f5bdf151e9 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:18.775862 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-bbe148ba-9b26-47b9-a84b-d7f5bdf151e9 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:18.775862 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-bbe148ba-9b26-47b9-a84b-d7f5bdf151e9 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:19.022679 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-ee84d2b0-8305-4d0f-9cc1-8ec99c1536a0 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:19.023799 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-ee84d2b0-8305-4d0f-9cc1-8ec99c1536a0 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:19.041525 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ee84d2b0-8305-4d0f-9cc1-8ec99c1536a0 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:19.046490 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ee84d2b0-8305-4d0f-9cc1-8ec99c1536a0 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:19.046859 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ee84d2b0-8305-4d0f-9cc1-8ec99c1536a0 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:19.047612 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ee84d2b0-8305-4d0f-9cc1-8ec99c1536a0 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:19.051165 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ee84d2b0-8305-4d0f-9cc1-8ec99c1536a0 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:19.053107 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ee84d2b0-8305-4d0f-9cc1-8ec99c1536a0 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:19.191756 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-bbe148ba-9b26-47b9-a84b-d7f5bdf151e9 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:19.207755 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-bbe148ba-9b26-47b9-a84b-d7f5bdf151e9 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db" status: 200 len: 1514 microversion: 2.1 time: 0.470893 Sep 27 17:25:19.208933 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 103/188] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:18 2022] GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db => generated 1514 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:25:19.235575 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-cf7e5904-0072-4af5-bd8a-f331ee3548e3 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:25:19.254803 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-cf7e5904-0072-4af5-bd8a-f331ee3548e3 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: d622d15d-b954-409c-a1f5-538da5de83db] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:19.264352 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-cf7e5904-0072-4af5-bd8a-f331ee3548e3 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:19.265180 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-cf7e5904-0072-4af5-bd8a-f331ee3548e3 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:19.265752 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-cf7e5904-0072-4af5-bd8a-f331ee3548e3 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:19.266985 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-cf7e5904-0072-4af5-bd8a-f331ee3548e3 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:19.267714 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-cf7e5904-0072-4af5-bd8a-f331ee3548e3 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:19.268368 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-cf7e5904-0072-4af5-bd8a-f331ee3548e3 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:19.396530 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.objects.instance [None req-cf7e5904-0072-4af5-bd8a-f331ee3548e3 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lazy-loading 'flavor' on Instance uuid d622d15d-b954-409c-a1f5-538da5de83db {{(pid=120416) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 17:25:19.573928 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-ee84d2b0-8305-4d0f-9cc1-8ec99c1536a0 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:19.576370 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:25:19.596042 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-ee84d2b0-8305-4d0f-9cc1-8ec99c1536a0 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:19.596730 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-cf7e5904-0072-4af5-bd8a-f331ee3548e3 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "POST /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db/action" status: 200 len: 32 microversion: 2.1 time: 0.363746 Sep 27 17:25:19.597386 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 104/189] 10.222.0.55 () {60 vars in 1278 bytes} [Tue Sep 27 17:25:19 2022] POST /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db/action => generated 32 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 17:25:19.600066 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-ee84d2b0-8305-4d0f-9cc1-8ec99c1536a0 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:19.603169 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-ee84d2b0-8305-4d0f-9cc1-8ec99c1536a0 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1406 microversion: 2.20 time: 0.584483 Sep 27 17:25:19.605487 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 86/190] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:25:19 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1406 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 17:25:19.609946 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-6f9bf69a-95bc-4ce1-8878-c21b6c1bb705 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:19.610783 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-6f9bf69a-95bc-4ce1-8878-c21b6c1bb705 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: d622d15d-b954-409c-a1f5-538da5de83db] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:19.618336 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6f9bf69a-95bc-4ce1-8878-c21b6c1bb705 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:19.618952 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6f9bf69a-95bc-4ce1-8878-c21b6c1bb705 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:19.619493 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6f9bf69a-95bc-4ce1-8878-c21b6c1bb705 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:19.620396 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6f9bf69a-95bc-4ce1-8878-c21b6c1bb705 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:19.620954 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6f9bf69a-95bc-4ce1-8878-c21b6c1bb705 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:19.621511 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6f9bf69a-95bc-4ce1-8878-c21b6c1bb705 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:19.684288 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-9ad96c52-20c7-4de4-86db-29dc4d277193 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:19.685164 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-9ad96c52-20c7-4de4-86db-29dc4d277193 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] [instance: 0e6c9900-b294-45b0-a692-18ed9f943669] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:19.691448 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9ad96c52-20c7-4de4-86db-29dc4d277193 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:19.692411 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9ad96c52-20c7-4de4-86db-29dc4d277193 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:19.693057 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9ad96c52-20c7-4de4-86db-29dc4d277193 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:19.694225 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9ad96c52-20c7-4de4-86db-29dc4d277193 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:19.694887 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9ad96c52-20c7-4de4-86db-29dc4d277193 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:19.695518 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9ad96c52-20c7-4de4-86db-29dc4d277193 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:19.833761 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-6f9bf69a-95bc-4ce1-8878-c21b6c1bb705 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:19.848144 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-6f9bf69a-95bc-4ce1-8878-c21b6c1bb705 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db" status: 200 len: 1520 microversion: 2.1 time: 0.244474 Sep 27 17:25:19.857114 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 105/191] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:19 2022] GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db => generated 1520 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:25:19.870992 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-9ad96c52-20c7-4de4-86db-29dc4d277193 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48c146c0bba4583a92d157e2eed7f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c16b9aaa5ac4e6dac613614c1a570c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:19.880229 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-9ad96c52-20c7-4de4-86db-29dc4d277193 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] 10.222.0.55 "GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669" status: 200 len: 1314 microversion: 2.1 time: 0.199829 Sep 27 17:25:19.881124 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 87/192] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:19 2022] GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669 => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:25:20.630035 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-4231869a-9a13-41c8-9c84-181c0794c52a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:20.631084 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-4231869a-9a13-41c8-9c84-181c0794c52a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:20.646849 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4231869a-9a13-41c8-9c84-181c0794c52a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:20.647944 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4231869a-9a13-41c8-9c84-181c0794c52a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:20.648420 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4231869a-9a13-41c8-9c84-181c0794c52a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:20.649277 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4231869a-9a13-41c8-9c84-181c0794c52a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:20.649881 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4231869a-9a13-41c8-9c84-181c0794c52a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:20.650522 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4231869a-9a13-41c8-9c84-181c0794c52a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:20.877647 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-3b32c827-cc83-4f51-a8e4-3aa313f3e2e2 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:20.878438 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-3b32c827-cc83-4f51-a8e4-3aa313f3e2e2 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: d622d15d-b954-409c-a1f5-538da5de83db] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:20.885298 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3b32c827-cc83-4f51-a8e4-3aa313f3e2e2 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:20.886065 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3b32c827-cc83-4f51-a8e4-3aa313f3e2e2 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:20.886694 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3b32c827-cc83-4f51-a8e4-3aa313f3e2e2 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:20.887516 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3b32c827-cc83-4f51-a8e4-3aa313f3e2e2 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:20.888076 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3b32c827-cc83-4f51-a8e4-3aa313f3e2e2 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:20.888625 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3b32c827-cc83-4f51-a8e4-3aa313f3e2e2 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:21.065590 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-4231869a-9a13-41c8-9c84-181c0794c52a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:21.079543 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-4231869a-9a13-41c8-9c84-181c0794c52a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:21.081680 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-4231869a-9a13-41c8-9c84-181c0794c52a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:21.083667 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-4231869a-9a13-41c8-9c84-181c0794c52a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1406 microversion: 2.20 time: 0.458773 Sep 27 17:25:21.084462 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 106/193] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:25:20 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1406 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:25:21.093624 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-4a2d3ce5-2594-4b1d-945d-356867728be4 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:21.095905 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-4a2d3ce5-2594-4b1d-945d-356867728be4 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] [instance: 0e6c9900-b294-45b0-a692-18ed9f943669] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:21.104616 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4a2d3ce5-2594-4b1d-945d-356867728be4 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:21.107345 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4a2d3ce5-2594-4b1d-945d-356867728be4 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:21.108364 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4a2d3ce5-2594-4b1d-945d-356867728be4 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:21.109281 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4a2d3ce5-2594-4b1d-945d-356867728be4 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:21.110083 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4a2d3ce5-2594-4b1d-945d-356867728be4 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:21.110702 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4a2d3ce5-2594-4b1d-945d-356867728be4 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:21.304320 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-3b32c827-cc83-4f51-a8e4-3aa313f3e2e2 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:21.324832 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-3b32c827-cc83-4f51-a8e4-3aa313f3e2e2 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db" status: 200 len: 1520 microversion: 2.1 time: 0.455129 Sep 27 17:25:21.328906 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 88/194] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:20 2022] GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db => generated 1520 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:25:21.383541 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-4a2d3ce5-2594-4b1d-945d-356867728be4 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48c146c0bba4583a92d157e2eed7f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c16b9aaa5ac4e6dac613614c1a570c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:21.400634 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-4a2d3ce5-2594-4b1d-945d-356867728be4 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] 10.222.0.55 "GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669" status: 200 len: 1314 microversion: 2.1 time: 0.313416 Sep 27 17:25:21.402806 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 107/195] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:21 2022] GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669 => generated 1314 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:25:21.642444 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [req-06f01731-dafa-433f-b483-e3791714d393 req-e831a966-5ad1-44b1-8b70-0dd9c4b02f0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d209f2ce-43c8-422a-a703-cdc9a9fb5cee", "name": "network-vif-plugged", "status": "completed", "tag": "5a5276d6-632d-4adb-a46b-8471fb0bf332"}]} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:25:21.653417 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-06f01731-dafa-433f-b483-e3791714d393 req-e831a966-5ad1-44b1-8b70-0dd9c4b02f0d service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:21.654154 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-06f01731-dafa-433f-b483-e3791714d393 req-e831a966-5ad1-44b1-8b70-0dd9c4b02f0d service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:21.654760 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-06f01731-dafa-433f-b483-e3791714d393 req-e831a966-5ad1-44b1-8b70-0dd9c4b02f0d service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:21.666830 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.compute.server_external_events [req-06f01731-dafa-433f-b483-e3791714d393 req-e831a966-5ad1-44b1-8b70-0dd9c4b02f0d service nova] Creating event network-vif-plugged:5a5276d6-632d-4adb-a46b-8471fb0bf332 for instance d209f2ce-43c8-422a-a703-cdc9a9fb5cee on hv-cinder-84914 Sep 27 17:25:21.673127 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [req-06f01731-dafa-433f-b483-e3791714d393 req-e831a966-5ad1-44b1-8b70-0dd9c4b02f0d service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034269 Sep 27 17:25:21.674789 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 89/196] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:25:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:25:22.112262 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-ff95ffb5-97ff-4114-86e5-878044078d39 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:22.112806 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-ff95ffb5-97ff-4114-86e5-878044078d39 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:22.125832 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ff95ffb5-97ff-4114-86e5-878044078d39 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:22.126508 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ff95ffb5-97ff-4114-86e5-878044078d39 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:22.127093 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ff95ffb5-97ff-4114-86e5-878044078d39 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:22.128284 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ff95ffb5-97ff-4114-86e5-878044078d39 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:22.128779 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ff95ffb5-97ff-4114-86e5-878044078d39 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:22.129182 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ff95ffb5-97ff-4114-86e5-878044078d39 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:22.347993 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-ff594db5-5c1f-4435-9f5a-4f8f157df276 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:22.348604 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-ff594db5-5c1f-4435-9f5a-4f8f157df276 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: d622d15d-b954-409c-a1f5-538da5de83db] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:22.357747 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ff594db5-5c1f-4435-9f5a-4f8f157df276 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:22.358542 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ff594db5-5c1f-4435-9f5a-4f8f157df276 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:22.360534 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ff594db5-5c1f-4435-9f5a-4f8f157df276 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:22.362445 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ff594db5-5c1f-4435-9f5a-4f8f157df276 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:22.363144 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ff594db5-5c1f-4435-9f5a-4f8f157df276 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:22.363967 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ff594db5-5c1f-4435-9f5a-4f8f157df276 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:22.773560 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-ff95ffb5-97ff-4114-86e5-878044078d39 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:22.791015 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-ff95ffb5-97ff-4114-86e5-878044078d39 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:22.792873 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-ff594db5-5c1f-4435-9f5a-4f8f157df276 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:22.795846 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-ff95ffb5-97ff-4114-86e5-878044078d39 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:22.802980 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-ff594db5-5c1f-4435-9f5a-4f8f157df276 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db" status: 200 len: 1520 microversion: 2.1 time: 0.458700 Sep 27 17:25:22.804394 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-ff95ffb5-97ff-4114-86e5-878044078d39 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1406 microversion: 2.20 time: 0.696809 Sep 27 17:25:22.806169 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 90/197] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:22 2022] GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db => generated 1520 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:25:22.807375 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 108/198] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:25:22 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1406 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:25:22.814900 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-8e97f7de-5da8-479b-994d-5a022ea1d06b tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:22.816069 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-8e97f7de-5da8-479b-994d-5a022ea1d06b tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] [instance: 0e6c9900-b294-45b0-a692-18ed9f943669] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:22.823215 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8e97f7de-5da8-479b-994d-5a022ea1d06b tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:22.823975 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8e97f7de-5da8-479b-994d-5a022ea1d06b tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:22.824797 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8e97f7de-5da8-479b-994d-5a022ea1d06b tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:22.825969 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8e97f7de-5da8-479b-994d-5a022ea1d06b tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:22.826893 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8e97f7de-5da8-479b-994d-5a022ea1d06b tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:22.827324 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8e97f7de-5da8-479b-994d-5a022ea1d06b tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:22.994386 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-8e97f7de-5da8-479b-994d-5a022ea1d06b tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48c146c0bba4583a92d157e2eed7f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c16b9aaa5ac4e6dac613614c1a570c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:23.002584 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-8e97f7de-5da8-479b-994d-5a022ea1d06b tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] 10.222.0.55 "GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669" status: 200 len: 1500 microversion: 2.1 time: 0.192618 Sep 27 17:25:23.003592 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 91/199] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:22 2022] GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669 => generated 1500 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:25:23.845638 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-20e1fe8e-471e-4d45-82aa-ca2c9264f119 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:23.847520 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-20e1fe8e-471e-4d45-82aa-ca2c9264f119 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: d622d15d-b954-409c-a1f5-538da5de83db] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:23.855193 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-91b49481-0b3b-42d7-ac8a-9abcfefc8766 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:23.856733 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-91b49481-0b3b-42d7-ac8a-9abcfefc8766 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:23.869125 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-20e1fe8e-471e-4d45-82aa-ca2c9264f119 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:23.875409 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-91b49481-0b3b-42d7-ac8a-9abcfefc8766 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:23.875932 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-91b49481-0b3b-42d7-ac8a-9abcfefc8766 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:23.876568 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-20e1fe8e-471e-4d45-82aa-ca2c9264f119 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:23.877120 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-91b49481-0b3b-42d7-ac8a-9abcfefc8766 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:23.878965 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-91b49481-0b3b-42d7-ac8a-9abcfefc8766 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:23.879469 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-91b49481-0b3b-42d7-ac8a-9abcfefc8766 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:23.879898 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-91b49481-0b3b-42d7-ac8a-9abcfefc8766 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:23.880478 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-20e1fe8e-471e-4d45-82aa-ca2c9264f119 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:23.881259 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-20e1fe8e-471e-4d45-82aa-ca2c9264f119 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:23.881681 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-20e1fe8e-471e-4d45-82aa-ca2c9264f119 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:23.882103 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-20e1fe8e-471e-4d45-82aa-ca2c9264f119 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:23.922275 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell1:SELECT=100 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:25:24.198039 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-91b49481-0b3b-42d7-ac8a-9abcfefc8766 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:24.212191 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-91b49481-0b3b-42d7-ac8a-9abcfefc8766 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:24.215800 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-91b49481-0b3b-42d7-ac8a-9abcfefc8766 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:24.217247 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-91b49481-0b3b-42d7-ac8a-9abcfefc8766 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1406 microversion: 2.20 time: 0.366857 Sep 27 17:25:24.217882 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 92/200] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:25:23 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1406 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:25:24.307071 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-20e1fe8e-471e-4d45-82aa-ca2c9264f119 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:24.329330 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-20e1fe8e-471e-4d45-82aa-ca2c9264f119 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db" status: 200 len: 1520 microversion: 2.1 time: 0.487884 Sep 27 17:25:24.334202 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 109/201] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:23 2022] GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db => generated 1520 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:25:25.223967 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-1545f747-6607-4b32-a83d-8ea890d21190 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ce0607a6-90ca-4ceb-a656-c8f456570048"}} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:25:25.226469 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-1545f747-6607-4b32-a83d-8ea890d21190 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] [instance: 0e6c9900-b294-45b0-a692-18ed9f943669] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:25.234223 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1545f747-6607-4b32-a83d-8ea890d21190 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:25.234795 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1545f747-6607-4b32-a83d-8ea890d21190 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:25.235227 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1545f747-6607-4b32-a83d-8ea890d21190 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:25.235943 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1545f747-6607-4b32-a83d-8ea890d21190 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:25.236393 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1545f747-6607-4b32-a83d-8ea890d21190 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:25.236810 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1545f747-6607-4b32-a83d-8ea890d21190 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:25.251081 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-9658c34e-9d3a-44a8-b740-5c5fa813a66e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:25.251683 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-9658c34e-9d3a-44a8-b740-5c5fa813a66e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:25.258498 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9658c34e-9d3a-44a8-b740-5c5fa813a66e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:25.258972 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9658c34e-9d3a-44a8-b740-5c5fa813a66e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:25.259452 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9658c34e-9d3a-44a8-b740-5c5fa813a66e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:25.260139 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9658c34e-9d3a-44a8-b740-5c5fa813a66e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:25.260588 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9658c34e-9d3a-44a8-b740-5c5fa813a66e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:25.261001 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9658c34e-9d3a-44a8-b740-5c5fa813a66e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:25.404731 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-9658c34e-9d3a-44a8-b740-5c5fa813a66e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:25.413420 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-9658c34e-9d3a-44a8-b740-5c5fa813a66e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:25.414940 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-9658c34e-9d3a-44a8-b740-5c5fa813a66e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:25.416131 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-9658c34e-9d3a-44a8-b740-5c5fa813a66e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1598 microversion: 2.20 time: 0.168879 Sep 27 17:25:25.416691 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 110/202] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:25:25 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1598 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 17:25:25.421919 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-6bc2213d-1f92-4b45-96ca-208cba614165 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:25.422544 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-6bc2213d-1f92-4b45-96ca-208cba614165 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: d622d15d-b954-409c-a1f5-538da5de83db] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:25.428158 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6bc2213d-1f92-4b45-96ca-208cba614165 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:25.428635 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6bc2213d-1f92-4b45-96ca-208cba614165 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:25.429066 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6bc2213d-1f92-4b45-96ca-208cba614165 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:25.429748 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6bc2213d-1f92-4b45-96ca-208cba614165 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:25.430222 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6bc2213d-1f92-4b45-96ca-208cba614165 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:25.430644 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6bc2213d-1f92-4b45-96ca-208cba614165 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:25.573004 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-6bc2213d-1f92-4b45-96ca-208cba614165 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:25.581144 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-6bc2213d-1f92-4b45-96ca-208cba614165 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db" status: 200 len: 1520 microversion: 2.1 time: 0.163353 Sep 27 17:25:25.581965 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 111/203] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:25 2022] GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:25:25.587107 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-4adb32ce-525e-48e0-b5c3-0d5be96e398a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:25.587870 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-4adb32ce-525e-48e0-b5c3-0d5be96e398a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:25.594483 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4adb32ce-525e-48e0-b5c3-0d5be96e398a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:25.595152 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4adb32ce-525e-48e0-b5c3-0d5be96e398a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:25.595575 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4adb32ce-525e-48e0-b5c3-0d5be96e398a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:25.596402 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4adb32ce-525e-48e0-b5c3-0d5be96e398a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:25.596971 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4adb32ce-525e-48e0-b5c3-0d5be96e398a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:25.597458 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4adb32ce-525e-48e0-b5c3-0d5be96e398a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:25.637451 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-1545f747-6607-4b32-a83d-8ea890d21190 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] 10.222.0.55 "POST /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.416702 Sep 27 17:25:25.640149 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 93/204] 10.222.0.55 () {60 vars in 1323 bytes} [Tue Sep 27 17:25:25 2022] POST /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669/os-volume_attachments => generated 194 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:25:25.684706 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-4adb32ce-525e-48e0-b5c3-0d5be96e398a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.101308 Sep 27 17:25:25.685237 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 112/205] 10.222.0.55 () {60 vars in 1316 bytes} [Tue Sep 27 17:25:25 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 17:25:26.414207 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-9eb1f7b9-5788-4f7a-afd1-2efc7c217093 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1513016319", "imageRef": "9355bd92-0a49-42cd-b079-ff9f0d54b91b", "flavorRef": "452", "networks": [{"uuid": "ce8ed3f9-3eb7-4f41-b23c-147313bc83ed"}]}} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:25:26.475270 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.network.neutron [None req-9eb1f7b9-5788-4f7a-afd1-2efc7c217093 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] validate_networks() for [('ce8ed3f9-3eb7-4f41-b23c-147313bc83ed', None, None, None, None, None)] {{(pid=120415) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 17:25:26.615609 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-c909bd9d-3f4e-4357-806e-f65286964e09 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:26.617040 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-c909bd9d-3f4e-4357-806e-f65286964e09 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: d622d15d-b954-409c-a1f5-538da5de83db] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:26.624278 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c909bd9d-3f4e-4357-806e-f65286964e09 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:26.625031 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c909bd9d-3f4e-4357-806e-f65286964e09 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:26.626538 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c909bd9d-3f4e-4357-806e-f65286964e09 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:26.627291 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c909bd9d-3f4e-4357-806e-f65286964e09 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:26.628025 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c909bd9d-3f4e-4357-806e-f65286964e09 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:26.628875 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c909bd9d-3f4e-4357-806e-f65286964e09 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:27.172328 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-c909bd9d-3f4e-4357-806e-f65286964e09 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:27.182982 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-c909bd9d-3f4e-4357-806e-f65286964e09 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db" status: 200 len: 1520 microversion: 2.1 time: 0.580948 Sep 27 17:25:27.195867 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 113/206] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:26 2022] GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db => generated 1520 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:25:27.389643 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-9eb1f7b9-5788-4f7a-afd1-2efc7c217093 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Flavor limits 0:0:0 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 17:25:27.390189 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-9eb1f7b9-5788-4f7a-afd1-2efc7c217093 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Image limits 0:0:0 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 17:25:27.392577 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-9eb1f7b9-5788-4f7a-afd1-2efc7c217093 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Flavor pref 0:0:0 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 17:25:27.393473 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-9eb1f7b9-5788-4f7a-afd1-2efc7c217093 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Image pref 0:0:0 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 17:25:27.394590 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-9eb1f7b9-5788-4f7a-afd1-2efc7c217093 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 17:25:27.409920 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9eb1f7b9-5788-4f7a-afd1-2efc7c217093 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:27.410589 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9eb1f7b9-5788-4f7a-afd1-2efc7c217093 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:27.411234 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9eb1f7b9-5788-4f7a-afd1-2efc7c217093 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:27.416266 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9eb1f7b9-5788-4f7a-afd1-2efc7c217093 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:27.418268 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9eb1f7b9-5788-4f7a-afd1-2efc7c217093 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:27.419011 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9eb1f7b9-5788-4f7a-afd1-2efc7c217093 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:27.448135 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.quota [None req-9eb1f7b9-5788-4f7a-afd1-2efc7c217093 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Getting quotas for project 36351a4bc84a45cb866e72f52e6e725a. Resources: {'cores', 'ram', 'instances'} {{(pid=120415) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 17:25:27.453825 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.quota [None req-9eb1f7b9-5788-4f7a-afd1-2efc7c217093 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Getting quotas for user 1dba953d778c418abea22efac408e2db and project 36351a4bc84a45cb866e72f52e6e725a. Resources: {'cores', 'ram', 'instances'} {{(pid=120415) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 17:25:27.468024 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-9eb1f7b9-5788-4f7a-afd1-2efc7c217093 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Going to run 1 instances... {{(pid=120415) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 17:25:27.471545 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-9eb1f7b9-5788-4f7a-afd1-2efc7c217093 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] [instance: 2e206773-221a-4857-b437-2b1a852b8277] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9355bd92-0a49-42cd-b079-ff9f0d54b91b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120415) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 17:25:27.512554 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [req-c860d4d0-de96-43ef-9f16-13712aab3c17 req-f299aba9-0a85-4358-a0d4-c90fe5002cc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d209f2ce-43c8-422a-a703-cdc9a9fb5cee", "tag": "5a5276d6-632d-4adb-a46b-8471fb0bf332"}]} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:25:27.538927 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-c860d4d0-de96-43ef-9f16-13712aab3c17 req-f299aba9-0a85-4358-a0d4-c90fe5002cc6 service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:27.540259 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-c860d4d0-de96-43ef-9f16-13712aab3c17 req-f299aba9-0a85-4358-a0d4-c90fe5002cc6 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:27.541060 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-c860d4d0-de96-43ef-9f16-13712aab3c17 req-f299aba9-0a85-4358-a0d4-c90fe5002cc6 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:27.551020 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-9eb1f7b9-5788-4f7a-afd1-2efc7c217093 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.141567 Sep 27 17:25:27.552232 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 94/207] 10.222.0.55 () {60 vars in 1147 bytes} [Tue Sep 27 17:25:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1143 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 17:25:27.564421 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-8b3be8b7-abc0-43ea-9246-c4e356636769 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:27.565035 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-8b3be8b7-abc0-43ea-9246-c4e356636769 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] [instance: 2e206773-221a-4857-b437-2b1a852b8277] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:27.572564 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.compute.server_external_events [req-c860d4d0-de96-43ef-9f16-13712aab3c17 req-f299aba9-0a85-4358-a0d4-c90fe5002cc6 service nova] Creating event network-changed:5a5276d6-632d-4adb-a46b-8471fb0bf332 for instance d209f2ce-43c8-422a-a703-cdc9a9fb5cee on hv-cinder-84914 Sep 27 17:25:27.581641 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [req-c860d4d0-de96-43ef-9f16-13712aab3c17 req-f299aba9-0a85-4358-a0d4-c90fe5002cc6 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073185 Sep 27 17:25:27.583207 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 114/208] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:25:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 17:25:27.681758 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-8b3be8b7-abc0-43ea-9246-c4e356636769 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dba953d778c418abea22efac408e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36351a4bc84a45cb866e72f52e6e725a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:27.696396 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-8b3be8b7-abc0-43ea-9246-c4e356636769 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] 10.222.0.55 "GET /compute/v2.1/servers/2e206773-221a-4857-b437-2b1a852b8277" status: 200 len: 1219 microversion: 2.1 time: 0.136699 Sep 27 17:25:27.697634 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 95/209] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:27 2022] GET /compute/v2.1/servers/2e206773-221a-4857-b437-2b1a852b8277 => generated 1219 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:25:28.208334 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-f37d41c9-22c3-41b5-822a-8349012fc1e3 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:28.209214 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-f37d41c9-22c3-41b5-822a-8349012fc1e3 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: d622d15d-b954-409c-a1f5-538da5de83db] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:28.216359 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f37d41c9-22c3-41b5-822a-8349012fc1e3 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:28.217093 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f37d41c9-22c3-41b5-822a-8349012fc1e3 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:28.217602 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f37d41c9-22c3-41b5-822a-8349012fc1e3 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:28.218871 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f37d41c9-22c3-41b5-822a-8349012fc1e3 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:28.219408 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f37d41c9-22c3-41b5-822a-8349012fc1e3 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:28.219903 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f37d41c9-22c3-41b5-822a-8349012fc1e3 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:28.381961 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-f37d41c9-22c3-41b5-822a-8349012fc1e3 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:28.390616 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-f37d41c9-22c3-41b5-822a-8349012fc1e3 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db" status: 200 len: 1520 microversion: 2.1 time: 0.186961 Sep 27 17:25:28.392521 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 115/210] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:28 2022] GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db => generated 1520 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:25:28.720206 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-2d7cb2a8-dff2-4009-bf32-963a18fa1169 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:28.720935 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-2d7cb2a8-dff2-4009-bf32-963a18fa1169 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] [instance: 2e206773-221a-4857-b437-2b1a852b8277] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:28.730214 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2d7cb2a8-dff2-4009-bf32-963a18fa1169 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:28.731806 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2d7cb2a8-dff2-4009-bf32-963a18fa1169 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:28.732325 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2d7cb2a8-dff2-4009-bf32-963a18fa1169 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:28.733571 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2d7cb2a8-dff2-4009-bf32-963a18fa1169 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:28.734046 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2d7cb2a8-dff2-4009-bf32-963a18fa1169 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:28.734607 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2d7cb2a8-dff2-4009-bf32-963a18fa1169 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:28.809519 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-2d7cb2a8-dff2-4009-bf32-963a18fa1169 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dba953d778c418abea22efac408e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36351a4bc84a45cb866e72f52e6e725a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:28.821851 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-2d7cb2a8-dff2-4009-bf32-963a18fa1169 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] 10.222.0.55 "GET /compute/v2.1/servers/2e206773-221a-4857-b437-2b1a852b8277" status: 200 len: 1223 microversion: 2.1 time: 0.105329 Sep 27 17:25:28.834847 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 96/211] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:28 2022] GET /compute/v2.1/servers/2e206773-221a-4857-b437-2b1a852b8277 => generated 1223 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:25:29.415432 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-a64c120f-5b96-433e-a7d2-d5949837a049 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:29.416054 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-a64c120f-5b96-433e-a7d2-d5949837a049 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: d622d15d-b954-409c-a1f5-538da5de83db] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:29.423092 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a64c120f-5b96-433e-a7d2-d5949837a049 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:29.424015 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a64c120f-5b96-433e-a7d2-d5949837a049 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:29.425791 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a64c120f-5b96-433e-a7d2-d5949837a049 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:29.427767 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a64c120f-5b96-433e-a7d2-d5949837a049 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:29.428913 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a64c120f-5b96-433e-a7d2-d5949837a049 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:29.429510 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a64c120f-5b96-433e-a7d2-d5949837a049 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:29.584925 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-a64c120f-5b96-433e-a7d2-d5949837a049 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:29.593585 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-a64c120f-5b96-433e-a7d2-d5949837a049 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db" status: 200 len: 1520 microversion: 2.1 time: 0.182361 Sep 27 17:25:29.594198 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 116/212] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:29 2022] GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db => generated 1520 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:25:29.848500 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-5d06d110-5841-4ae8-89a1-24f98008b026 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:29.849102 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-5d06d110-5841-4ae8-89a1-24f98008b026 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] [instance: 2e206773-221a-4857-b437-2b1a852b8277] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:29.856089 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5d06d110-5841-4ae8-89a1-24f98008b026 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:29.856568 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5d06d110-5841-4ae8-89a1-24f98008b026 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:29.856998 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5d06d110-5841-4ae8-89a1-24f98008b026 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:29.857685 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5d06d110-5841-4ae8-89a1-24f98008b026 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:29.858159 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5d06d110-5841-4ae8-89a1-24f98008b026 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:29.858761 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5d06d110-5841-4ae8-89a1-24f98008b026 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:29.923777 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-5d06d110-5841-4ae8-89a1-24f98008b026 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dba953d778c418abea22efac408e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36351a4bc84a45cb866e72f52e6e725a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:29.931367 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-5d06d110-5841-4ae8-89a1-24f98008b026 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] 10.222.0.55 "GET /compute/v2.1/servers/2e206773-221a-4857-b437-2b1a852b8277" status: 200 len: 1223 microversion: 2.1 time: 0.086914 Sep 27 17:25:29.931934 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 97/213] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:29 2022] GET /compute/v2.1/servers/2e206773-221a-4857-b437-2b1a852b8277 => generated 1223 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:25:30.618148 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-472a142a-b8bb-49b5-9098-5a7f046be3c7 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:30.618756 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-472a142a-b8bb-49b5-9098-5a7f046be3c7 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: d622d15d-b954-409c-a1f5-538da5de83db] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:30.625629 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-472a142a-b8bb-49b5-9098-5a7f046be3c7 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:30.626144 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-472a142a-b8bb-49b5-9098-5a7f046be3c7 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:30.626610 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-472a142a-b8bb-49b5-9098-5a7f046be3c7 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:30.627299 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-472a142a-b8bb-49b5-9098-5a7f046be3c7 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:30.627754 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-472a142a-b8bb-49b5-9098-5a7f046be3c7 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:30.628170 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-472a142a-b8bb-49b5-9098-5a7f046be3c7 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:30.755823 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-472a142a-b8bb-49b5-9098-5a7f046be3c7 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:30.763654 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-472a142a-b8bb-49b5-9098-5a7f046be3c7 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db" status: 200 len: 1520 microversion: 2.1 time: 0.149605 Sep 27 17:25:30.764257 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 117/214] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:30 2022] GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:25:30.954000 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-06f8544b-42ec-463d-815e-41d5c9030642 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:30.954659 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-06f8544b-42ec-463d-815e-41d5c9030642 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] [instance: 2e206773-221a-4857-b437-2b1a852b8277] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:30.961004 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-06f8544b-42ec-463d-815e-41d5c9030642 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:30.961494 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-06f8544b-42ec-463d-815e-41d5c9030642 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:30.961926 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-06f8544b-42ec-463d-815e-41d5c9030642 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:30.962650 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-06f8544b-42ec-463d-815e-41d5c9030642 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:30.963101 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-06f8544b-42ec-463d-815e-41d5c9030642 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:30.963524 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-06f8544b-42ec-463d-815e-41d5c9030642 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:31.028767 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-06f8544b-42ec-463d-815e-41d5c9030642 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dba953d778c418abea22efac408e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36351a4bc84a45cb866e72f52e6e725a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:31.036514 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-06f8544b-42ec-463d-815e-41d5c9030642 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] 10.222.0.55 "GET /compute/v2.1/servers/2e206773-221a-4857-b437-2b1a852b8277" status: 200 len: 1223 microversion: 2.1 time: 0.086271 Sep 27 17:25:31.037086 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 98/215] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:30 2022] GET /compute/v2.1/servers/2e206773-221a-4857-b437-2b1a852b8277 => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:25:31.787684 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-f47aed9e-296b-408b-b745-e452a968d478 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:31.788187 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-f47aed9e-296b-408b-b745-e452a968d478 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: d622d15d-b954-409c-a1f5-538da5de83db] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:31.794048 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f47aed9e-296b-408b-b745-e452a968d478 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:31.794557 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f47aed9e-296b-408b-b745-e452a968d478 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:31.795010 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f47aed9e-296b-408b-b745-e452a968d478 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:31.795691 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f47aed9e-296b-408b-b745-e452a968d478 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:31.796143 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f47aed9e-296b-408b-b745-e452a968d478 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:31.796560 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f47aed9e-296b-408b-b745-e452a968d478 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:31.987017 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-f47aed9e-296b-408b-b745-e452a968d478 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:31.997681 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-f47aed9e-296b-408b-b745-e452a968d478 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db" status: 200 len: 1520 microversion: 2.1 time: 0.213660 Sep 27 17:25:31.998309 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 118/216] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:31 2022] GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db => generated 1520 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:25:32.059187 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-4e2bcab5-bfb5-4000-b738-6bb13bcaaa41 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:32.059789 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-4e2bcab5-bfb5-4000-b738-6bb13bcaaa41 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] [instance: 2e206773-221a-4857-b437-2b1a852b8277] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:32.066181 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4e2bcab5-bfb5-4000-b738-6bb13bcaaa41 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:32.066639 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4e2bcab5-bfb5-4000-b738-6bb13bcaaa41 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:32.067082 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4e2bcab5-bfb5-4000-b738-6bb13bcaaa41 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:32.067780 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4e2bcab5-bfb5-4000-b738-6bb13bcaaa41 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:32.068233 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4e2bcab5-bfb5-4000-b738-6bb13bcaaa41 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:32.068871 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4e2bcab5-bfb5-4000-b738-6bb13bcaaa41 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:32.141856 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-4e2bcab5-bfb5-4000-b738-6bb13bcaaa41 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dba953d778c418abea22efac408e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36351a4bc84a45cb866e72f52e6e725a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:32.149822 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-4e2bcab5-bfb5-4000-b738-6bb13bcaaa41 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] 10.222.0.55 "GET /compute/v2.1/servers/2e206773-221a-4857-b437-2b1a852b8277" status: 200 len: 1279 microversion: 2.1 time: 0.094811 Sep 27 17:25:32.150429 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 99/217] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:32 2022] GET /compute/v2.1/servers/2e206773-221a-4857-b437-2b1a852b8277 => generated 1279 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:25:33.022336 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-7c57fe8f-f691-409d-b0a5-15bb3a0334aa tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:33.023134 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-7c57fe8f-f691-409d-b0a5-15bb3a0334aa tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: d622d15d-b954-409c-a1f5-538da5de83db] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:33.030848 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7c57fe8f-f691-409d-b0a5-15bb3a0334aa tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:33.031335 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7c57fe8f-f691-409d-b0a5-15bb3a0334aa tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:33.031770 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7c57fe8f-f691-409d-b0a5-15bb3a0334aa tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:33.032469 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7c57fe8f-f691-409d-b0a5-15bb3a0334aa tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:33.032923 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7c57fe8f-f691-409d-b0a5-15bb3a0334aa tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:33.033344 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7c57fe8f-f691-409d-b0a5-15bb3a0334aa tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:33.163054 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-7c57fe8f-f691-409d-b0a5-15bb3a0334aa tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:33.173101 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-7c57fe8f-f691-409d-b0a5-15bb3a0334aa tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db" status: 200 len: 1520 microversion: 2.1 time: 0.154880 Sep 27 17:25:33.173870 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 119/218] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:33 2022] GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:25:33.174170 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-15500f07-2bcc-4804-bbcb-7ac7bd3eb24e tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:33.174852 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-15500f07-2bcc-4804-bbcb-7ac7bd3eb24e tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] [instance: 2e206773-221a-4857-b437-2b1a852b8277] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:33.181603 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-15500f07-2bcc-4804-bbcb-7ac7bd3eb24e tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:33.182174 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-15500f07-2bcc-4804-bbcb-7ac7bd3eb24e tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:33.182600 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-15500f07-2bcc-4804-bbcb-7ac7bd3eb24e tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:33.183916 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-15500f07-2bcc-4804-bbcb-7ac7bd3eb24e tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:33.184440 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-15500f07-2bcc-4804-bbcb-7ac7bd3eb24e tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:33.184946 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-15500f07-2bcc-4804-bbcb-7ac7bd3eb24e tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:33.246594 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-15500f07-2bcc-4804-bbcb-7ac7bd3eb24e tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dba953d778c418abea22efac408e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36351a4bc84a45cb866e72f52e6e725a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:33.254304 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-15500f07-2bcc-4804-bbcb-7ac7bd3eb24e tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] 10.222.0.55 "GET /compute/v2.1/servers/2e206773-221a-4857-b437-2b1a852b8277" status: 200 len: 1279 microversion: 2.1 time: 0.084807 Sep 27 17:25:33.254875 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 100/219] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:33 2022] GET /compute/v2.1/servers/2e206773-221a-4857-b437-2b1a852b8277 => generated 1279 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:25:34.196675 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-49e436c6-044f-4e0c-8af5-45fe0420c0dc tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:34.197287 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-49e436c6-044f-4e0c-8af5-45fe0420c0dc tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: d622d15d-b954-409c-a1f5-538da5de83db] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:34.203663 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-49e436c6-044f-4e0c-8af5-45fe0420c0dc tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:34.204136 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-49e436c6-044f-4e0c-8af5-45fe0420c0dc tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:34.204563 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-49e436c6-044f-4e0c-8af5-45fe0420c0dc tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:34.205235 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-49e436c6-044f-4e0c-8af5-45fe0420c0dc tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:34.205679 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-49e436c6-044f-4e0c-8af5-45fe0420c0dc tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:34.206116 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-49e436c6-044f-4e0c-8af5-45fe0420c0dc tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:34.276654 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-dd3e207f-e943-41da-99fa-a406cefabf0a tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:34.277256 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-dd3e207f-e943-41da-99fa-a406cefabf0a tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] [instance: 2e206773-221a-4857-b437-2b1a852b8277] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:34.284229 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-dd3e207f-e943-41da-99fa-a406cefabf0a tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:34.284706 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-dd3e207f-e943-41da-99fa-a406cefabf0a tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:34.285137 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-dd3e207f-e943-41da-99fa-a406cefabf0a tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:34.285850 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-dd3e207f-e943-41da-99fa-a406cefabf0a tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:34.286551 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-dd3e207f-e943-41da-99fa-a406cefabf0a tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:34.286971 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-dd3e207f-e943-41da-99fa-a406cefabf0a tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:34.358166 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-dd3e207f-e943-41da-99fa-a406cefabf0a tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dba953d778c418abea22efac408e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36351a4bc84a45cb866e72f52e6e725a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:34.361490 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-49e436c6-044f-4e0c-8af5-45fe0420c0dc tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:34.365744 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-dd3e207f-e943-41da-99fa-a406cefabf0a tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] 10.222.0.55 "GET /compute/v2.1/servers/2e206773-221a-4857-b437-2b1a852b8277" status: 200 len: 1279 microversion: 2.1 time: 0.092891 Sep 27 17:25:34.366333 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 101/220] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:34 2022] GET /compute/v2.1/servers/2e206773-221a-4857-b437-2b1a852b8277 => generated 1279 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:25:34.369183 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-49e436c6-044f-4e0c-8af5-45fe0420c0dc tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db" status: 200 len: 1520 microversion: 2.1 time: 0.176363 Sep 27 17:25:34.369807 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 120/221] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:34 2022] GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:25:35.390586 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-64551b64-9647-42bf-90c1-f9e621b48691 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:35.391252 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-64551b64-9647-42bf-90c1-f9e621b48691 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] [instance: 2e206773-221a-4857-b437-2b1a852b8277] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:35.392514 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-b9d196d1-523f-467c-961f-f35428c65525 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:35.393132 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-b9d196d1-523f-467c-961f-f35428c65525 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: d622d15d-b954-409c-a1f5-538da5de83db] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:35.397777 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-64551b64-9647-42bf-90c1-f9e621b48691 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:35.398267 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-64551b64-9647-42bf-90c1-f9e621b48691 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:35.398742 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-64551b64-9647-42bf-90c1-f9e621b48691 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:35.399535 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-64551b64-9647-42bf-90c1-f9e621b48691 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:35.400075 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-64551b64-9647-42bf-90c1-f9e621b48691 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:35.400449 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b9d196d1-523f-467c-961f-f35428c65525 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:35.400600 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-64551b64-9647-42bf-90c1-f9e621b48691 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:35.400940 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b9d196d1-523f-467c-961f-f35428c65525 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:35.401549 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b9d196d1-523f-467c-961f-f35428c65525 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:35.402219 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b9d196d1-523f-467c-961f-f35428c65525 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:35.402712 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b9d196d1-523f-467c-961f-f35428c65525 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:35.403214 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b9d196d1-523f-467c-961f-f35428c65525 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:35.470044 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-64551b64-9647-42bf-90c1-f9e621b48691 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dba953d778c418abea22efac408e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36351a4bc84a45cb866e72f52e6e725a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:35.477948 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-64551b64-9647-42bf-90c1-f9e621b48691 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] 10.222.0.55 "GET /compute/v2.1/servers/2e206773-221a-4857-b437-2b1a852b8277" status: 200 len: 1279 microversion: 2.1 time: 0.093202 Sep 27 17:25:35.483308 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 102/222] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:35 2022] GET /compute/v2.1/servers/2e206773-221a-4857-b437-2b1a852b8277 => generated 1279 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:25:35.645563 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-b9d196d1-523f-467c-961f-f35428c65525 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:35.654537 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-b9d196d1-523f-467c-961f-f35428c65525 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db" status: 200 len: 1520 microversion: 2.1 time: 0.265830 Sep 27 17:25:35.658134 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 121/223] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:35 2022] GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db => generated 1520 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:25:36.503593 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-a9ff6112-a511-47e2-9242-5ae97e3e979e tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:36.504346 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-a9ff6112-a511-47e2-9242-5ae97e3e979e tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] [instance: 2e206773-221a-4857-b437-2b1a852b8277] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:36.513946 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a9ff6112-a511-47e2-9242-5ae97e3e979e tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:36.514737 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a9ff6112-a511-47e2-9242-5ae97e3e979e tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:36.515168 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a9ff6112-a511-47e2-9242-5ae97e3e979e tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:36.516081 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a9ff6112-a511-47e2-9242-5ae97e3e979e tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:36.516527 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a9ff6112-a511-47e2-9242-5ae97e3e979e tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:36.517106 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a9ff6112-a511-47e2-9242-5ae97e3e979e tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:36.689887 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-60173aee-cecf-43ac-8ae6-c81ccecc73a2 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:36.690528 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-60173aee-cecf-43ac-8ae6-c81ccecc73a2 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: d622d15d-b954-409c-a1f5-538da5de83db] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:36.696603 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-60173aee-cecf-43ac-8ae6-c81ccecc73a2 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:36.697276 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-60173aee-cecf-43ac-8ae6-c81ccecc73a2 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:36.697906 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-60173aee-cecf-43ac-8ae6-c81ccecc73a2 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:36.699150 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-60173aee-cecf-43ac-8ae6-c81ccecc73a2 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:36.699956 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-60173aee-cecf-43ac-8ae6-c81ccecc73a2 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:36.700782 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-60173aee-cecf-43ac-8ae6-c81ccecc73a2 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:36.724979 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_cell1:SELECT=100 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:25:36.828116 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-a9ff6112-a511-47e2-9242-5ae97e3e979e tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dba953d778c418abea22efac408e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36351a4bc84a45cb866e72f52e6e725a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:36.838194 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-a9ff6112-a511-47e2-9242-5ae97e3e979e tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] 10.222.0.55 "GET /compute/v2.1/servers/2e206773-221a-4857-b437-2b1a852b8277" status: 200 len: 1319 microversion: 2.1 time: 0.338217 Sep 27 17:25:36.839616 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 103/224] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:36 2022] GET /compute/v2.1/servers/2e206773-221a-4857-b437-2b1a852b8277 => generated 1319 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:25:37.008082 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-60173aee-cecf-43ac-8ae6-c81ccecc73a2 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:37.016325 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-60173aee-cecf-43ac-8ae6-c81ccecc73a2 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db" status: 200 len: 1520 microversion: 2.1 time: 0.330348 Sep 27 17:25:37.017088 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 122/225] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:36 2022] GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db => generated 1520 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:25:37.197514 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [req-98bf2eaf-a4a1-46ae-9c25-83db2e640bbe req-1335692b-6dfc-4fe8-8499-ecba7844620a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e206773-221a-4857-b437-2b1a852b8277", "tag": "e9e0231f-54fe-478f-87fb-2d95162294ff"}]} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:25:37.209364 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-98bf2eaf-a4a1-46ae-9c25-83db2e640bbe req-1335692b-6dfc-4fe8-8499-ecba7844620a service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:37.209850 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-98bf2eaf-a4a1-46ae-9c25-83db2e640bbe req-1335692b-6dfc-4fe8-8499-ecba7844620a service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:37.210588 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-98bf2eaf-a4a1-46ae-9c25-83db2e640bbe req-1335692b-6dfc-4fe8-8499-ecba7844620a service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:37.222548 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.compute.server_external_events [req-98bf2eaf-a4a1-46ae-9c25-83db2e640bbe req-1335692b-6dfc-4fe8-8499-ecba7844620a service nova] Creating event network-changed:e9e0231f-54fe-478f-87fb-2d95162294ff for instance 2e206773-221a-4857-b437-2b1a852b8277 on hv-cinder-84914 Sep 27 17:25:37.227839 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [req-98bf2eaf-a4a1-46ae-9c25-83db2e640bbe req-1335692b-6dfc-4fe8-8499-ecba7844620a service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035066 Sep 27 17:25:37.228441 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 104/226] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:25:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:25:37.865823 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-0b959228-12b9-4588-a899-ac3f01085ac7 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:37.866474 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-0b959228-12b9-4588-a899-ac3f01085ac7 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] [instance: 2e206773-221a-4857-b437-2b1a852b8277] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:37.872667 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-0b959228-12b9-4588-a899-ac3f01085ac7 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:37.873320 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-0b959228-12b9-4588-a899-ac3f01085ac7 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:37.873942 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-0b959228-12b9-4588-a899-ac3f01085ac7 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:37.874668 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-0b959228-12b9-4588-a899-ac3f01085ac7 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:37.875265 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-0b959228-12b9-4588-a899-ac3f01085ac7 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:37.875857 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-0b959228-12b9-4588-a899-ac3f01085ac7 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:38.018303 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-0b959228-12b9-4588-a899-ac3f01085ac7 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dba953d778c418abea22efac408e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36351a4bc84a45cb866e72f52e6e725a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:38.030236 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-0b959228-12b9-4588-a899-ac3f01085ac7 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] 10.222.0.55 "GET /compute/v2.1/servers/2e206773-221a-4857-b437-2b1a852b8277" status: 200 len: 1319 microversion: 2.1 time: 0.167332 Sep 27 17:25:38.031292 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 123/227] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:37 2022] GET /compute/v2.1/servers/2e206773-221a-4857-b437-2b1a852b8277 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:25:38.039671 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell0:SELECT=2 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:25:38.041455 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell0:SELECT=8 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:25:38.053705 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-331a761c-8724-437c-bd13-2a344e01d726 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:38.057001 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-331a761c-8724-437c-bd13-2a344e01d726 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: d622d15d-b954-409c-a1f5-538da5de83db] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:38.064067 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-331a761c-8724-437c-bd13-2a344e01d726 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:38.064774 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-331a761c-8724-437c-bd13-2a344e01d726 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:38.065543 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-331a761c-8724-437c-bd13-2a344e01d726 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:38.067083 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-331a761c-8724-437c-bd13-2a344e01d726 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:38.068058 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-331a761c-8724-437c-bd13-2a344e01d726 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:38.068597 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-331a761c-8724-437c-bd13-2a344e01d726 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:38.296944 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-331a761c-8724-437c-bd13-2a344e01d726 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:38.306916 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-331a761c-8724-437c-bd13-2a344e01d726 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db" status: 200 len: 1520 microversion: 2.1 time: 0.269053 Sep 27 17:25:38.322671 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 105/228] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:38 2022] GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db => generated 1520 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:25:39.057076 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-7beb3766-187a-41f1-9212-b786115b0d74 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:39.057954 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-7beb3766-187a-41f1-9212-b786115b0d74 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] [instance: 2e206773-221a-4857-b437-2b1a852b8277] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:39.064682 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7beb3766-187a-41f1-9212-b786115b0d74 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:39.065473 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7beb3766-187a-41f1-9212-b786115b0d74 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:39.066018 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7beb3766-187a-41f1-9212-b786115b0d74 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:39.066812 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7beb3766-187a-41f1-9212-b786115b0d74 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:39.067344 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7beb3766-187a-41f1-9212-b786115b0d74 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:39.067859 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7beb3766-187a-41f1-9212-b786115b0d74 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:39.216847 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-7beb3766-187a-41f1-9212-b786115b0d74 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dba953d778c418abea22efac408e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36351a4bc84a45cb866e72f52e6e725a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:39.226022 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-7beb3766-187a-41f1-9212-b786115b0d74 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] 10.222.0.55 "GET /compute/v2.1/servers/2e206773-221a-4857-b437-2b1a852b8277" status: 200 len: 1319 microversion: 2.1 time: 0.174512 Sep 27 17:25:39.238154 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 124/229] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:39 2022] GET /compute/v2.1/servers/2e206773-221a-4857-b437-2b1a852b8277 => generated 1319 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:25:39.333222 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-606acd84-1bc1-4865-92f7-06cc4c53a4c1 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:39.335289 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-606acd84-1bc1-4865-92f7-06cc4c53a4c1 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: d622d15d-b954-409c-a1f5-538da5de83db] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:39.345071 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-606acd84-1bc1-4865-92f7-06cc4c53a4c1 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:39.346451 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-606acd84-1bc1-4865-92f7-06cc4c53a4c1 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:39.347110 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-606acd84-1bc1-4865-92f7-06cc4c53a4c1 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:39.348301 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-606acd84-1bc1-4865-92f7-06cc4c53a4c1 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:39.349074 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-606acd84-1bc1-4865-92f7-06cc4c53a4c1 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:39.349736 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-606acd84-1bc1-4865-92f7-06cc4c53a4c1 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:39.553302 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-606acd84-1bc1-4865-92f7-06cc4c53a4c1 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:39.564005 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-606acd84-1bc1-4865-92f7-06cc4c53a4c1 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db" status: 200 len: 1520 microversion: 2.1 time: 0.237048 Sep 27 17:25:39.564605 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 106/230] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:39 2022] GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db => generated 1520 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:25:40.249923 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-60c762a4-d017-48b3-8b7a-42669ad91ff2 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:40.250771 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-60c762a4-d017-48b3-8b7a-42669ad91ff2 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] [instance: 2e206773-221a-4857-b437-2b1a852b8277] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:40.256884 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-60c762a4-d017-48b3-8b7a-42669ad91ff2 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:40.257430 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-60c762a4-d017-48b3-8b7a-42669ad91ff2 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:40.257866 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-60c762a4-d017-48b3-8b7a-42669ad91ff2 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:40.258586 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-60c762a4-d017-48b3-8b7a-42669ad91ff2 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:40.259094 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-60c762a4-d017-48b3-8b7a-42669ad91ff2 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:40.259577 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-60c762a4-d017-48b3-8b7a-42669ad91ff2 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:40.476444 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-60c762a4-d017-48b3-8b7a-42669ad91ff2 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dba953d778c418abea22efac408e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36351a4bc84a45cb866e72f52e6e725a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:40.484686 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-60c762a4-d017-48b3-8b7a-42669ad91ff2 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] 10.222.0.55 "GET /compute/v2.1/servers/2e206773-221a-4857-b437-2b1a852b8277" status: 200 len: 1319 microversion: 2.1 time: 0.238847 Sep 27 17:25:40.492524 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 125/231] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:40 2022] GET /compute/v2.1/servers/2e206773-221a-4857-b437-2b1a852b8277 => generated 1319 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:25:40.587725 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-be30976b-322a-41f4-a625-46bb22018075 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:40.588401 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-be30976b-322a-41f4-a625-46bb22018075 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: d622d15d-b954-409c-a1f5-538da5de83db] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:40.600713 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-be30976b-322a-41f4-a625-46bb22018075 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:40.601471 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-be30976b-322a-41f4-a625-46bb22018075 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:40.601956 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-be30976b-322a-41f4-a625-46bb22018075 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:40.602718 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-be30976b-322a-41f4-a625-46bb22018075 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:40.609086 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-be30976b-322a-41f4-a625-46bb22018075 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:40.609978 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-be30976b-322a-41f4-a625-46bb22018075 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:40.847463 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-be30976b-322a-41f4-a625-46bb22018075 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:40.860617 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-be30976b-322a-41f4-a625-46bb22018075 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db" status: 200 len: 1520 microversion: 2.1 time: 0.277022 Sep 27 17:25:40.861301 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 107/232] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:40 2022] GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db => generated 1520 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:25:41.509199 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-e29403cd-be35-4c22-ba8a-285079d1415f tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:41.510028 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-e29403cd-be35-4c22-ba8a-285079d1415f tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] [instance: 2e206773-221a-4857-b437-2b1a852b8277] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:41.522173 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e29403cd-be35-4c22-ba8a-285079d1415f tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:41.522975 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e29403cd-be35-4c22-ba8a-285079d1415f tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:41.523562 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e29403cd-be35-4c22-ba8a-285079d1415f tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:41.530917 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e29403cd-be35-4c22-ba8a-285079d1415f tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:41.530917 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e29403cd-be35-4c22-ba8a-285079d1415f tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:41.530917 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e29403cd-be35-4c22-ba8a-285079d1415f tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:41.738195 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-e29403cd-be35-4c22-ba8a-285079d1415f tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dba953d778c418abea22efac408e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36351a4bc84a45cb866e72f52e6e725a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:41.746473 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-e29403cd-be35-4c22-ba8a-285079d1415f tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] 10.222.0.55 "GET /compute/v2.1/servers/2e206773-221a-4857-b437-2b1a852b8277" status: 200 len: 1319 microversion: 2.1 time: 0.241629 Sep 27 17:25:41.747207 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 126/233] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:41 2022] GET /compute/v2.1/servers/2e206773-221a-4857-b437-2b1a852b8277 => generated 1319 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:25:41.884685 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-faccfc74-4ed8-46c3-bf51-a5fb16ba0b2b tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:41.885385 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-faccfc74-4ed8-46c3-bf51-a5fb16ba0b2b tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: d622d15d-b954-409c-a1f5-538da5de83db] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:41.892011 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-faccfc74-4ed8-46c3-bf51-a5fb16ba0b2b tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:41.892491 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-faccfc74-4ed8-46c3-bf51-a5fb16ba0b2b tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:41.892926 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-faccfc74-4ed8-46c3-bf51-a5fb16ba0b2b tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:41.893605 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-faccfc74-4ed8-46c3-bf51-a5fb16ba0b2b tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:41.894050 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-faccfc74-4ed8-46c3-bf51-a5fb16ba0b2b tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:41.894489 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-faccfc74-4ed8-46c3-bf51-a5fb16ba0b2b tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:42.047499 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-faccfc74-4ed8-46c3-bf51-a5fb16ba0b2b tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:42.056976 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-faccfc74-4ed8-46c3-bf51-a5fb16ba0b2b tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db" status: 200 len: 1520 microversion: 2.1 time: 0.176454 Sep 27 17:25:42.057607 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 108/234] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:41 2022] GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:25:42.776071 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-65ad3579-0551-4ab0-aec5-b99ecbda7537 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:42.776933 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-65ad3579-0551-4ab0-aec5-b99ecbda7537 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] [instance: 2e206773-221a-4857-b437-2b1a852b8277] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:42.786447 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-65ad3579-0551-4ab0-aec5-b99ecbda7537 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:42.787898 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-65ad3579-0551-4ab0-aec5-b99ecbda7537 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:42.788664 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-65ad3579-0551-4ab0-aec5-b99ecbda7537 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:42.789969 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-65ad3579-0551-4ab0-aec5-b99ecbda7537 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:42.794811 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-65ad3579-0551-4ab0-aec5-b99ecbda7537 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:42.795336 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-65ad3579-0551-4ab0-aec5-b99ecbda7537 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:42.943489 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-65ad3579-0551-4ab0-aec5-b99ecbda7537 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dba953d778c418abea22efac408e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36351a4bc84a45cb866e72f52e6e725a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:42.953864 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-65ad3579-0551-4ab0-aec5-b99ecbda7537 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] 10.222.0.55 "GET /compute/v2.1/servers/2e206773-221a-4857-b437-2b1a852b8277" status: 200 len: 1319 microversion: 2.1 time: 0.182953 Sep 27 17:25:42.954879 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 127/235] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:42 2022] GET /compute/v2.1/servers/2e206773-221a-4857-b437-2b1a852b8277 => generated 1319 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:25:43.085117 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-6b652687-a91b-4796-b795-c3b79f45f1eb tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:43.085839 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-6b652687-a91b-4796-b795-c3b79f45f1eb tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: d622d15d-b954-409c-a1f5-538da5de83db] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:43.093204 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6b652687-a91b-4796-b795-c3b79f45f1eb tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:43.093687 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6b652687-a91b-4796-b795-c3b79f45f1eb tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:43.094177 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6b652687-a91b-4796-b795-c3b79f45f1eb tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:43.094876 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6b652687-a91b-4796-b795-c3b79f45f1eb tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:43.095364 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6b652687-a91b-4796-b795-c3b79f45f1eb tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:43.095786 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6b652687-a91b-4796-b795-c3b79f45f1eb tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:43.239919 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-6b652687-a91b-4796-b795-c3b79f45f1eb tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:43.247686 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-6b652687-a91b-4796-b795-c3b79f45f1eb tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db" status: 200 len: 1520 microversion: 2.1 time: 0.166802 Sep 27 17:25:43.248468 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 109/236] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:43 2022] GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:25:43.977574 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-e319d70c-1556-4213-bb0b-988644052d2b tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:43.978381 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-e319d70c-1556-4213-bb0b-988644052d2b tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] [instance: 2e206773-221a-4857-b437-2b1a852b8277] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:43.982292 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_api:SELECT=64 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:25:43.986324 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e319d70c-1556-4213-bb0b-988644052d2b tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:43.987013 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e319d70c-1556-4213-bb0b-988644052d2b tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:43.987441 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e319d70c-1556-4213-bb0b-988644052d2b tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:43.988131 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e319d70c-1556-4213-bb0b-988644052d2b tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:43.988574 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e319d70c-1556-4213-bb0b-988644052d2b tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:43.988990 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e319d70c-1556-4213-bb0b-988644052d2b tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:44.131280 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-e319d70c-1556-4213-bb0b-988644052d2b tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dba953d778c418abea22efac408e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36351a4bc84a45cb866e72f52e6e725a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:44.139082 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-e319d70c-1556-4213-bb0b-988644052d2b tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] 10.222.0.55 "GET /compute/v2.1/servers/2e206773-221a-4857-b437-2b1a852b8277" status: 200 len: 1319 microversion: 2.1 time: 0.166193 Sep 27 17:25:44.139647 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 128/237] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:43 2022] GET /compute/v2.1/servers/2e206773-221a-4857-b437-2b1a852b8277 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:25:44.271771 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-27ea9a9a-5a29-4f87-8b4d-90abbc88d716 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:44.273133 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-27ea9a9a-5a29-4f87-8b4d-90abbc88d716 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: d622d15d-b954-409c-a1f5-538da5de83db] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:44.280249 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:25:44.282163 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-27ea9a9a-5a29-4f87-8b4d-90abbc88d716 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:44.282948 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-27ea9a9a-5a29-4f87-8b4d-90abbc88d716 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:44.283530 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-27ea9a9a-5a29-4f87-8b4d-90abbc88d716 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:44.284298 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-27ea9a9a-5a29-4f87-8b4d-90abbc88d716 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:44.284822 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-27ea9a9a-5a29-4f87-8b4d-90abbc88d716 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:44.285314 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-27ea9a9a-5a29-4f87-8b4d-90abbc88d716 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:44.290447 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:25:44.461410 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-27ea9a9a-5a29-4f87-8b4d-90abbc88d716 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:44.470021 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-27ea9a9a-5a29-4f87-8b4d-90abbc88d716 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db" status: 200 len: 1520 microversion: 2.1 time: 0.202192 Sep 27 17:25:44.470697 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 110/238] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:44 2022] GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db => generated 1520 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:25:45.164913 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-ffd2440e-c4ee-4f62-bc83-4d089bceb7d9 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:45.165526 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-ffd2440e-c4ee-4f62-bc83-4d089bceb7d9 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] [instance: 2e206773-221a-4857-b437-2b1a852b8277] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:45.172164 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ffd2440e-c4ee-4f62-bc83-4d089bceb7d9 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:45.172758 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ffd2440e-c4ee-4f62-bc83-4d089bceb7d9 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:45.173183 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ffd2440e-c4ee-4f62-bc83-4d089bceb7d9 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:45.173866 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ffd2440e-c4ee-4f62-bc83-4d089bceb7d9 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:45.174337 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ffd2440e-c4ee-4f62-bc83-4d089bceb7d9 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:45.174753 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ffd2440e-c4ee-4f62-bc83-4d089bceb7d9 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:45.300499 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-ffd2440e-c4ee-4f62-bc83-4d089bceb7d9 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dba953d778c418abea22efac408e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36351a4bc84a45cb866e72f52e6e725a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:45.308565 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-ffd2440e-c4ee-4f62-bc83-4d089bceb7d9 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] 10.222.0.55 "GET /compute/v2.1/servers/2e206773-221a-4857-b437-2b1a852b8277" status: 200 len: 1319 microversion: 2.1 time: 0.148845 Sep 27 17:25:45.309130 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 129/239] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:45 2022] GET /compute/v2.1/servers/2e206773-221a-4857-b437-2b1a852b8277 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:25:45.493898 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-6bccd3b3-7c72-46d8-a313-e3cc55ef6136 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:45.494541 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-6bccd3b3-7c72-46d8-a313-e3cc55ef6136 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: d622d15d-b954-409c-a1f5-538da5de83db] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:45.500912 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6bccd3b3-7c72-46d8-a313-e3cc55ef6136 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:45.501420 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6bccd3b3-7c72-46d8-a313-e3cc55ef6136 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:45.501916 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6bccd3b3-7c72-46d8-a313-e3cc55ef6136 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:45.502640 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6bccd3b3-7c72-46d8-a313-e3cc55ef6136 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:45.503097 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6bccd3b3-7c72-46d8-a313-e3cc55ef6136 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:45.503524 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6bccd3b3-7c72-46d8-a313-e3cc55ef6136 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:45.655783 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-6bccd3b3-7c72-46d8-a313-e3cc55ef6136 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:45.663576 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-6bccd3b3-7c72-46d8-a313-e3cc55ef6136 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db" status: 200 len: 1520 microversion: 2.1 time: 0.173470 Sep 27 17:25:45.664146 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 111/240] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:45 2022] GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:25:46.330917 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-3b889575-2d74-497c-91fb-3ca881effe6a tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:46.331619 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-3b889575-2d74-497c-91fb-3ca881effe6a tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] [instance: 2e206773-221a-4857-b437-2b1a852b8277] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:46.337593 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3b889575-2d74-497c-91fb-3ca881effe6a tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:46.338187 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3b889575-2d74-497c-91fb-3ca881effe6a tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:46.338626 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3b889575-2d74-497c-91fb-3ca881effe6a tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:46.339315 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3b889575-2d74-497c-91fb-3ca881effe6a tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:46.339769 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3b889575-2d74-497c-91fb-3ca881effe6a tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:46.340213 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3b889575-2d74-497c-91fb-3ca881effe6a tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:46.466593 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-3b889575-2d74-497c-91fb-3ca881effe6a tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dba953d778c418abea22efac408e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36351a4bc84a45cb866e72f52e6e725a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:46.474184 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-3b889575-2d74-497c-91fb-3ca881effe6a tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] 10.222.0.55 "GET /compute/v2.1/servers/2e206773-221a-4857-b437-2b1a852b8277" status: 200 len: 1319 microversion: 2.1 time: 0.147118 Sep 27 17:25:46.474748 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 130/241] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:46 2022] GET /compute/v2.1/servers/2e206773-221a-4857-b437-2b1a852b8277 => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:25:46.687043 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-b09a1412-e395-4a18-8a37-4bfe32675221 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:46.687714 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-b09a1412-e395-4a18-8a37-4bfe32675221 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: d622d15d-b954-409c-a1f5-538da5de83db] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:46.694557 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b09a1412-e395-4a18-8a37-4bfe32675221 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:46.695062 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b09a1412-e395-4a18-8a37-4bfe32675221 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:46.695537 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b09a1412-e395-4a18-8a37-4bfe32675221 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:46.696298 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b09a1412-e395-4a18-8a37-4bfe32675221 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:46.696767 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b09a1412-e395-4a18-8a37-4bfe32675221 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:46.697187 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b09a1412-e395-4a18-8a37-4bfe32675221 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:46.827002 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-b09a1412-e395-4a18-8a37-4bfe32675221 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:46.834573 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-b09a1412-e395-4a18-8a37-4bfe32675221 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db" status: 200 len: 1520 microversion: 2.1 time: 0.151814 Sep 27 17:25:46.835147 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 112/242] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:46 2022] GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:25:47.499300 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-f7213d7e-5640-4218-ac10-fd6b5e8d19e1 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:47.500120 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-f7213d7e-5640-4218-ac10-fd6b5e8d19e1 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] [instance: 2e206773-221a-4857-b437-2b1a852b8277] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:47.505985 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f7213d7e-5640-4218-ac10-fd6b5e8d19e1 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:47.506562 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f7213d7e-5640-4218-ac10-fd6b5e8d19e1 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:47.507023 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f7213d7e-5640-4218-ac10-fd6b5e8d19e1 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:47.507724 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f7213d7e-5640-4218-ac10-fd6b5e8d19e1 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:47.508173 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f7213d7e-5640-4218-ac10-fd6b5e8d19e1 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:47.508593 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f7213d7e-5640-4218-ac10-fd6b5e8d19e1 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:47.663848 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-f7213d7e-5640-4218-ac10-fd6b5e8d19e1 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dba953d778c418abea22efac408e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36351a4bc84a45cb866e72f52e6e725a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:47.682341 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-f7213d7e-5640-4218-ac10-fd6b5e8d19e1 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] 10.222.0.55 "GET /compute/v2.1/servers/2e206773-221a-4857-b437-2b1a852b8277" status: 200 len: 1319 microversion: 2.1 time: 0.180120 Sep 27 17:25:47.682341 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 131/243] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:47 2022] GET /compute/v2.1/servers/2e206773-221a-4857-b437-2b1a852b8277 => generated 1319 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:25:47.861588 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-ababa561-e9d9-4212-b93b-6c023782073d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:47.862503 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-ababa561-e9d9-4212-b93b-6c023782073d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: d622d15d-b954-409c-a1f5-538da5de83db] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:47.871155 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ababa561-e9d9-4212-b93b-6c023782073d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:47.872392 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ababa561-e9d9-4212-b93b-6c023782073d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:47.872905 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ababa561-e9d9-4212-b93b-6c023782073d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:47.873830 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ababa561-e9d9-4212-b93b-6c023782073d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:47.874501 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ababa561-e9d9-4212-b93b-6c023782073d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:47.875147 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ababa561-e9d9-4212-b93b-6c023782073d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:48.052987 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-ababa561-e9d9-4212-b93b-6c023782073d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:48.061474 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-ababa561-e9d9-4212-b93b-6c023782073d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db" status: 200 len: 1520 microversion: 2.1 time: 0.203841 Sep 27 17:25:48.062907 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 113/244] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:47 2022] GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db => generated 1520 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:25:48.112319 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [req-6b16ed46-bd86-492d-9be1-f2ec57878e28 req-30bb2b2c-c02d-4b04-a729-7f5f76c0f9a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e206773-221a-4857-b437-2b1a852b8277", "name": "network-vif-plugged", "status": "completed", "tag": "e9e0231f-54fe-478f-87fb-2d95162294ff"}]} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:25:48.124034 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-6b16ed46-bd86-492d-9be1-f2ec57878e28 req-30bb2b2c-c02d-4b04-a729-7f5f76c0f9a5 service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:48.124725 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-6b16ed46-bd86-492d-9be1-f2ec57878e28 req-30bb2b2c-c02d-4b04-a729-7f5f76c0f9a5 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:48.125473 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-6b16ed46-bd86-492d-9be1-f2ec57878e28 req-30bb2b2c-c02d-4b04-a729-7f5f76c0f9a5 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:48.137868 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.compute.server_external_events [req-6b16ed46-bd86-492d-9be1-f2ec57878e28 req-30bb2b2c-c02d-4b04-a729-7f5f76c0f9a5 service nova] Creating event network-vif-plugged:e9e0231f-54fe-478f-87fb-2d95162294ff for instance 2e206773-221a-4857-b437-2b1a852b8277 on hv-cinder-84914 Sep 27 17:25:48.143202 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [req-6b16ed46-bd86-492d-9be1-f2ec57878e28 req-30bb2b2c-c02d-4b04-a729-7f5f76c0f9a5 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036561 Sep 27 17:25:48.143787 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 132/245] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:25:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:25:48.557813 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-f55a3cb3-a910-43c9-af70-a0abde7af044 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:48.558338 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-f55a3cb3-a910-43c9-af70-a0abde7af044 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] [instance: 0e6c9900-b294-45b0-a692-18ed9f943669] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:48.566022 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f55a3cb3-a910-43c9-af70-a0abde7af044 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:48.566531 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f55a3cb3-a910-43c9-af70-a0abde7af044 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:48.566984 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f55a3cb3-a910-43c9-af70-a0abde7af044 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:48.567651 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f55a3cb3-a910-43c9-af70-a0abde7af044 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:48.568099 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f55a3cb3-a910-43c9-af70-a0abde7af044 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:48.568520 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f55a3cb3-a910-43c9-af70-a0abde7af044 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:48.594401 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-f55a3cb3-a910-43c9-af70-a0abde7af044 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] [instance: 0e6c9900-b294-45b0-a692-18ed9f943669] Going to try to terminate instance {{(pid=120415) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 17:25:48.686560 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-f55a3cb3-a910-43c9-af70-a0abde7af044 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] 10.222.0.55 "DELETE /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669" status: 204 len: 0 microversion: 2.1 time: 0.132210 Sep 27 17:25:48.687220 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 114/246] 10.222.0.55 () {58 vars in 1239 bytes} [Tue Sep 27 17:25:48 2022] DELETE /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 17:25:48.697805 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-c99e4701-ae8e-4abd-93d8-4a54dd8d0614 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:48.698543 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-c99e4701-ae8e-4abd-93d8-4a54dd8d0614 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] [instance: 0e6c9900-b294-45b0-a692-18ed9f943669] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:48.700165 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-d7db3e72-ab0a-4f5d-9d76-2b03106a1982 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:48.700765 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-d7db3e72-ab0a-4f5d-9d76-2b03106a1982 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] [instance: 2e206773-221a-4857-b437-2b1a852b8277] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:48.704741 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c99e4701-ae8e-4abd-93d8-4a54dd8d0614 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:48.705215 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c99e4701-ae8e-4abd-93d8-4a54dd8d0614 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:48.705646 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c99e4701-ae8e-4abd-93d8-4a54dd8d0614 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:48.706541 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c99e4701-ae8e-4abd-93d8-4a54dd8d0614 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:48.706902 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c99e4701-ae8e-4abd-93d8-4a54dd8d0614 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:48.707324 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c99e4701-ae8e-4abd-93d8-4a54dd8d0614 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:48.707876 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d7db3e72-ab0a-4f5d-9d76-2b03106a1982 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:48.708495 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d7db3e72-ab0a-4f5d-9d76-2b03106a1982 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:48.708994 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d7db3e72-ab0a-4f5d-9d76-2b03106a1982 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:48.718383 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d7db3e72-ab0a-4f5d-9d76-2b03106a1982 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:48.718383 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d7db3e72-ab0a-4f5d-9d76-2b03106a1982 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:48.718383 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d7db3e72-ab0a-4f5d-9d76-2b03106a1982 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:48.923560 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-c99e4701-ae8e-4abd-93d8-4a54dd8d0614 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48c146c0bba4583a92d157e2eed7f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c16b9aaa5ac4e6dac613614c1a570c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:48.926758 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-d7db3e72-ab0a-4f5d-9d76-2b03106a1982 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dba953d778c418abea22efac408e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36351a4bc84a45cb866e72f52e6e725a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:48.935672 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-d7db3e72-ab0a-4f5d-9d76-2b03106a1982 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] 10.222.0.55 "GET /compute/v2.1/servers/2e206773-221a-4857-b437-2b1a852b8277" status: 200 len: 1319 microversion: 2.1 time: 0.240009 Sep 27 17:25:48.936251 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 115/247] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:48 2022] GET /compute/v2.1/servers/2e206773-221a-4857-b437-2b1a852b8277 => generated 1319 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:25:48.939566 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-c99e4701-ae8e-4abd-93d8-4a54dd8d0614 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] 10.222.0.55 "GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669" status: 200 len: 1552 microversion: 2.1 time: 0.247671 Sep 27 17:25:48.940467 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 133/248] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:48 2022] GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669 => generated 1552 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:25:49.085303 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-e26ef0f4-472e-480e-a1c4-fca0b29e6eb6 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:49.086300 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-e26ef0f4-472e-480e-a1c4-fca0b29e6eb6 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: d622d15d-b954-409c-a1f5-538da5de83db] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:49.093174 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e26ef0f4-472e-480e-a1c4-fca0b29e6eb6 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:49.093653 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e26ef0f4-472e-480e-a1c4-fca0b29e6eb6 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:49.094102 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e26ef0f4-472e-480e-a1c4-fca0b29e6eb6 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:49.094798 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e26ef0f4-472e-480e-a1c4-fca0b29e6eb6 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:49.095247 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e26ef0f4-472e-480e-a1c4-fca0b29e6eb6 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:49.095669 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e26ef0f4-472e-480e-a1c4-fca0b29e6eb6 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:49.227605 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-e26ef0f4-472e-480e-a1c4-fca0b29e6eb6 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:49.237269 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-e26ef0f4-472e-480e-a1c4-fca0b29e6eb6 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db" status: 200 len: 1520 microversion: 2.1 time: 0.155823 Sep 27 17:25:49.237831 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 116/249] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:49 2022] GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:25:49.959716 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-b37165b0-6886-407d-8fa6-a893c43463b2 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:49.960315 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-b37165b0-6886-407d-8fa6-a893c43463b2 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] [instance: 2e206773-221a-4857-b437-2b1a852b8277] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:49.964569 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-1b3c9a28-a17c-4a22-bdb7-17341de901ce tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:49.965174 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-1b3c9a28-a17c-4a22-bdb7-17341de901ce tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] [instance: 0e6c9900-b294-45b0-a692-18ed9f943669] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:49.966311 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b37165b0-6886-407d-8fa6-a893c43463b2 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:49.966791 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b37165b0-6886-407d-8fa6-a893c43463b2 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:49.967235 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b37165b0-6886-407d-8fa6-a893c43463b2 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:49.967966 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b37165b0-6886-407d-8fa6-a893c43463b2 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:49.968388 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b37165b0-6886-407d-8fa6-a893c43463b2 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:49.968790 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b37165b0-6886-407d-8fa6-a893c43463b2 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:49.971476 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1b3c9a28-a17c-4a22-bdb7-17341de901ce tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:49.971952 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1b3c9a28-a17c-4a22-bdb7-17341de901ce tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:49.973718 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1b3c9a28-a17c-4a22-bdb7-17341de901ce tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:49.973718 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1b3c9a28-a17c-4a22-bdb7-17341de901ce tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:49.973939 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1b3c9a28-a17c-4a22-bdb7-17341de901ce tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:49.974341 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1b3c9a28-a17c-4a22-bdb7-17341de901ce tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:50.183200 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-1b3c9a28-a17c-4a22-bdb7-17341de901ce tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48c146c0bba4583a92d157e2eed7f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c16b9aaa5ac4e6dac613614c1a570c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:50.189115 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-b37165b0-6886-407d-8fa6-a893c43463b2 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dba953d778c418abea22efac408e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36351a4bc84a45cb866e72f52e6e725a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:50.192117 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-1b3c9a28-a17c-4a22-bdb7-17341de901ce tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] 10.222.0.55 "GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669" status: 200 len: 1552 microversion: 2.1 time: 0.231361 Sep 27 17:25:50.192709 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 117/250] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:49 2022] GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669 => generated 1552 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:25:50.197164 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-b37165b0-6886-407d-8fa6-a893c43463b2 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] 10.222.0.55 "GET /compute/v2.1/servers/2e206773-221a-4857-b437-2b1a852b8277" status: 200 len: 1319 microversion: 2.1 time: 0.241339 Sep 27 17:25:50.197713 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 134/251] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:49 2022] GET /compute/v2.1/servers/2e206773-221a-4857-b437-2b1a852b8277 => generated 1319 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:25:50.260349 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-ebed71cc-784a-4f3d-bc0d-f2cbc12a1cf3 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:50.260877 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-ebed71cc-784a-4f3d-bc0d-f2cbc12a1cf3 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: d622d15d-b954-409c-a1f5-538da5de83db] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:50.266754 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ebed71cc-784a-4f3d-bc0d-f2cbc12a1cf3 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:50.267235 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ebed71cc-784a-4f3d-bc0d-f2cbc12a1cf3 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:50.267670 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ebed71cc-784a-4f3d-bc0d-f2cbc12a1cf3 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:50.268353 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ebed71cc-784a-4f3d-bc0d-f2cbc12a1cf3 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:50.268800 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ebed71cc-784a-4f3d-bc0d-f2cbc12a1cf3 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:50.269218 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ebed71cc-784a-4f3d-bc0d-f2cbc12a1cf3 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:50.401429 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-ebed71cc-784a-4f3d-bc0d-f2cbc12a1cf3 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:50.409728 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-ebed71cc-784a-4f3d-bc0d-f2cbc12a1cf3 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db" status: 200 len: 1520 microversion: 2.1 time: 0.153367 Sep 27 17:25:50.410336 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 118/252] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:50 2022] GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:25:51.215888 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-190095dd-4ee6-40da-ba5d-6f6101a16517 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:51.216798 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-190095dd-4ee6-40da-ba5d-6f6101a16517 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] [instance: 0e6c9900-b294-45b0-a692-18ed9f943669] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:51.221249 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-d722b5bc-36b7-4dbe-b6a5-265c830301aa tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:51.221967 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-d722b5bc-36b7-4dbe-b6a5-265c830301aa tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] [instance: 2e206773-221a-4857-b437-2b1a852b8277] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:51.223237 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-190095dd-4ee6-40da-ba5d-6f6101a16517 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:51.223827 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-190095dd-4ee6-40da-ba5d-6f6101a16517 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:51.224331 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-190095dd-4ee6-40da-ba5d-6f6101a16517 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:51.225117 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-190095dd-4ee6-40da-ba5d-6f6101a16517 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:51.225643 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-190095dd-4ee6-40da-ba5d-6f6101a16517 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:51.226166 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-190095dd-4ee6-40da-ba5d-6f6101a16517 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:51.229407 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d722b5bc-36b7-4dbe-b6a5-265c830301aa tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:51.229899 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d722b5bc-36b7-4dbe-b6a5-265c830301aa tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:51.230635 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d722b5bc-36b7-4dbe-b6a5-265c830301aa tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:51.231893 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d722b5bc-36b7-4dbe-b6a5-265c830301aa tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:51.232492 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d722b5bc-36b7-4dbe-b6a5-265c830301aa tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:51.232905 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d722b5bc-36b7-4dbe-b6a5-265c830301aa tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:51.431286 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-190095dd-4ee6-40da-ba5d-6f6101a16517 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48c146c0bba4583a92d157e2eed7f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c16b9aaa5ac4e6dac613614c1a570c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:51.440159 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-190095dd-4ee6-40da-ba5d-6f6101a16517 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] 10.222.0.55 "GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669" status: 200 len: 1552 microversion: 2.1 time: 0.228350 Sep 27 17:25:51.440736 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 135/253] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:51 2022] GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669 => generated 1552 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:25:51.440862 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-d722b5bc-36b7-4dbe-b6a5-265c830301aa tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dba953d778c418abea22efac408e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36351a4bc84a45cb866e72f52e6e725a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:51.445160 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-7674b180-2c8d-48df-a048-27c48cb078c3 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:51.445765 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-7674b180-2c8d-48df-a048-27c48cb078c3 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: d622d15d-b954-409c-a1f5-538da5de83db] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:51.448819 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-d722b5bc-36b7-4dbe-b6a5-265c830301aa tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] 10.222.0.55 "GET /compute/v2.1/servers/2e206773-221a-4857-b437-2b1a852b8277" status: 200 len: 1319 microversion: 2.1 time: 0.232776 Sep 27 17:25:51.449380 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 119/254] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:51 2022] GET /compute/v2.1/servers/2e206773-221a-4857-b437-2b1a852b8277 => generated 1319 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:25:51.451586 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7674b180-2c8d-48df-a048-27c48cb078c3 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:51.452075 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7674b180-2c8d-48df-a048-27c48cb078c3 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:51.452509 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7674b180-2c8d-48df-a048-27c48cb078c3 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:51.453204 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7674b180-2c8d-48df-a048-27c48cb078c3 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:51.453658 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7674b180-2c8d-48df-a048-27c48cb078c3 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:51.454100 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7674b180-2c8d-48df-a048-27c48cb078c3 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:51.586407 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-7674b180-2c8d-48df-a048-27c48cb078c3 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:51.592976 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-7674b180-2c8d-48df-a048-27c48cb078c3 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db" status: 200 len: 1520 microversion: 2.1 time: 0.150541 Sep 27 17:25:51.593302 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 136/255] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:51 2022] GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:25:52.464711 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-22bf93fd-eebf-4d24-ab30-e922e03da7ea tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:52.466001 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-22bf93fd-eebf-4d24-ab30-e922e03da7ea tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] [instance: 0e6c9900-b294-45b0-a692-18ed9f943669] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:52.471868 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-ceea1bd6-cc55-4819-bfb5-4cca01a4a1da tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:52.472453 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-22bf93fd-eebf-4d24-ab30-e922e03da7ea tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:52.472652 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-ceea1bd6-cc55-4819-bfb5-4cca01a4a1da tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] [instance: 2e206773-221a-4857-b437-2b1a852b8277] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:52.473041 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-22bf93fd-eebf-4d24-ab30-e922e03da7ea tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:52.473372 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-22bf93fd-eebf-4d24-ab30-e922e03da7ea tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:52.474054 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-22bf93fd-eebf-4d24-ab30-e922e03da7ea tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:52.474529 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-22bf93fd-eebf-4d24-ab30-e922e03da7ea tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:52.474947 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-22bf93fd-eebf-4d24-ab30-e922e03da7ea tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:52.478479 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ceea1bd6-cc55-4819-bfb5-4cca01a4a1da tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:52.478961 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ceea1bd6-cc55-4819-bfb5-4cca01a4a1da tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:52.479388 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ceea1bd6-cc55-4819-bfb5-4cca01a4a1da tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:52.480110 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ceea1bd6-cc55-4819-bfb5-4cca01a4a1da tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:52.480825 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ceea1bd6-cc55-4819-bfb5-4cca01a4a1da tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:52.481840 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ceea1bd6-cc55-4819-bfb5-4cca01a4a1da tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:52.664702 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-ceea1bd6-cc55-4819-bfb5-4cca01a4a1da tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dba953d778c418abea22efac408e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36351a4bc84a45cb866e72f52e6e725a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:52.668827 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-22bf93fd-eebf-4d24-ab30-e922e03da7ea tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48c146c0bba4583a92d157e2eed7f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c16b9aaa5ac4e6dac613614c1a570c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:52.672453 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-ceea1bd6-cc55-4819-bfb5-4cca01a4a1da tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] 10.222.0.55 "GET /compute/v2.1/servers/2e206773-221a-4857-b437-2b1a852b8277" status: 200 len: 1319 microversion: 2.1 time: 0.204345 Sep 27 17:25:52.673008 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 137/256] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:52 2022] GET /compute/v2.1/servers/2e206773-221a-4857-b437-2b1a852b8277 => generated 1319 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:25:52.677204 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-22bf93fd-eebf-4d24-ab30-e922e03da7ea tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] 10.222.0.55 "GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669" status: 200 len: 1552 microversion: 2.1 time: 0.216473 Sep 27 17:25:52.677911 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 120/257] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:52 2022] GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669 => generated 1552 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:25:52.678041 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-9c9fdbc3-973f-4f44-8fba-fbad305b5eb7 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:52.678568 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-9c9fdbc3-973f-4f44-8fba-fbad305b5eb7 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: d622d15d-b954-409c-a1f5-538da5de83db] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:52.685212 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9c9fdbc3-973f-4f44-8fba-fbad305b5eb7 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:52.685693 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9c9fdbc3-973f-4f44-8fba-fbad305b5eb7 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:52.686149 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9c9fdbc3-973f-4f44-8fba-fbad305b5eb7 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:52.686839 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9c9fdbc3-973f-4f44-8fba-fbad305b5eb7 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:52.687318 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9c9fdbc3-973f-4f44-8fba-fbad305b5eb7 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:52.687742 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9c9fdbc3-973f-4f44-8fba-fbad305b5eb7 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:52.816334 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-9c9fdbc3-973f-4f44-8fba-fbad305b5eb7 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:52.823855 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-9c9fdbc3-973f-4f44-8fba-fbad305b5eb7 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db" status: 200 len: 1520 microversion: 2.1 time: 0.149765 Sep 27 17:25:52.824420 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 138/258] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:52 2022] GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:25:53.697291 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-7e01f495-2225-44ec-acbe-2e93e90941cc tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:53.698051 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-7e01f495-2225-44ec-acbe-2e93e90941cc tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] [instance: 2e206773-221a-4857-b437-2b1a852b8277] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:53.701420 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-4bd5ed29-2c71-45f9-9bd5-ef910446bcfe tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:53.702879 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-4bd5ed29-2c71-45f9-9bd5-ef910446bcfe tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] [instance: 0e6c9900-b294-45b0-a692-18ed9f943669] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:53.707294 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7e01f495-2225-44ec-acbe-2e93e90941cc tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:53.707855 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7e01f495-2225-44ec-acbe-2e93e90941cc tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:53.708251 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4bd5ed29-2c71-45f9-9bd5-ef910446bcfe tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:53.708608 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7e01f495-2225-44ec-acbe-2e93e90941cc tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:53.708932 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4bd5ed29-2c71-45f9-9bd5-ef910446bcfe tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:53.709477 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4bd5ed29-2c71-45f9-9bd5-ef910446bcfe tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:53.710420 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4bd5ed29-2c71-45f9-9bd5-ef910446bcfe tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:53.711123 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4bd5ed29-2c71-45f9-9bd5-ef910446bcfe tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:53.711301 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7e01f495-2225-44ec-acbe-2e93e90941cc tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:53.711695 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4bd5ed29-2c71-45f9-9bd5-ef910446bcfe tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:53.712009 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7e01f495-2225-44ec-acbe-2e93e90941cc tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:53.712684 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7e01f495-2225-44ec-acbe-2e93e90941cc tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:53.913046 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-4bd5ed29-2c71-45f9-9bd5-ef910446bcfe tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48c146c0bba4583a92d157e2eed7f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c16b9aaa5ac4e6dac613614c1a570c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:53.916847 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-7e01f495-2225-44ec-acbe-2e93e90941cc tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dba953d778c418abea22efac408e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36351a4bc84a45cb866e72f52e6e725a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:53.917061 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_cell1:SELECT=100 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:25:53.923680 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-4bd5ed29-2c71-45f9-9bd5-ef910446bcfe tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] 10.222.0.55 "GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669" status: 200 len: 1552 microversion: 2.1 time: 0.226639 Sep 27 17:25:53.924263 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 139/259] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:53 2022] GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669 => generated 1552 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:25:53.925242 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-7e01f495-2225-44ec-acbe-2e93e90941cc tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] 10.222.0.55 "GET /compute/v2.1/servers/2e206773-221a-4857-b437-2b1a852b8277" status: 200 len: 1319 microversion: 2.1 time: 0.232781 Sep 27 17:25:53.925973 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 121/260] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:53 2022] GET /compute/v2.1/servers/2e206773-221a-4857-b437-2b1a852b8277 => generated 1319 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:25:53.929030 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-b1ddf5f5-acfc-4272-96ee-4be43df55152 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:53.929632 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-b1ddf5f5-acfc-4272-96ee-4be43df55152 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: d622d15d-b954-409c-a1f5-538da5de83db] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:53.936073 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b1ddf5f5-acfc-4272-96ee-4be43df55152 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:53.936553 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b1ddf5f5-acfc-4272-96ee-4be43df55152 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:53.936987 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b1ddf5f5-acfc-4272-96ee-4be43df55152 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:53.937667 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b1ddf5f5-acfc-4272-96ee-4be43df55152 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:53.938161 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b1ddf5f5-acfc-4272-96ee-4be43df55152 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:53.938560 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b1ddf5f5-acfc-4272-96ee-4be43df55152 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:54.066990 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-b1ddf5f5-acfc-4272-96ee-4be43df55152 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:54.075567 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-b1ddf5f5-acfc-4272-96ee-4be43df55152 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db" status: 200 len: 1520 microversion: 2.1 time: 0.149494 Sep 27 17:25:54.076148 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 140/261] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:53 2022] GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:25:54.948264 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-f1d567ff-78ed-4239-aada-000cacd0903f tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:54.948900 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-f1d567ff-78ed-4239-aada-000cacd0903f tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] [instance: 2e206773-221a-4857-b437-2b1a852b8277] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:54.948988 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-f84c5d69-7389-4ded-9e79-828defde48cb tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:54.950521 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-f84c5d69-7389-4ded-9e79-828defde48cb tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] [instance: 0e6c9900-b294-45b0-a692-18ed9f943669] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:54.955376 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f1d567ff-78ed-4239-aada-000cacd0903f tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:54.955857 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f1d567ff-78ed-4239-aada-000cacd0903f tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:54.956286 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f1d567ff-78ed-4239-aada-000cacd0903f tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:54.956973 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f1d567ff-78ed-4239-aada-000cacd0903f tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:54.957425 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f1d567ff-78ed-4239-aada-000cacd0903f tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:54.957842 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f1d567ff-78ed-4239-aada-000cacd0903f tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:54.957935 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f84c5d69-7389-4ded-9e79-828defde48cb tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:54.958399 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f84c5d69-7389-4ded-9e79-828defde48cb tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:54.958979 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f84c5d69-7389-4ded-9e79-828defde48cb tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:54.959548 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f84c5d69-7389-4ded-9e79-828defde48cb tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:54.959997 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f84c5d69-7389-4ded-9e79-828defde48cb tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:54.960634 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f84c5d69-7389-4ded-9e79-828defde48cb tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:55.165920 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-f1d567ff-78ed-4239-aada-000cacd0903f tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dba953d778c418abea22efac408e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36351a4bc84a45cb866e72f52e6e725a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:55.174636 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-f1d567ff-78ed-4239-aada-000cacd0903f tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] 10.222.0.55 "GET /compute/v2.1/servers/2e206773-221a-4857-b437-2b1a852b8277" status: 200 len: 1319 microversion: 2.1 time: 0.230077 Sep 27 17:25:55.174875 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-f84c5d69-7389-4ded-9e79-828defde48cb tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48c146c0bba4583a92d157e2eed7f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c16b9aaa5ac4e6dac613614c1a570c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:55.175212 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 141/262] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:54 2022] GET /compute/v2.1/servers/2e206773-221a-4857-b437-2b1a852b8277 => generated 1319 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:25:55.181519 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-ef46adcb-6f18-479d-ae5c-9bbe9616b19f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:55.183269 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-ef46adcb-6f18-479d-ae5c-9bbe9616b19f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: d622d15d-b954-409c-a1f5-538da5de83db] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:55.185493 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-f84c5d69-7389-4ded-9e79-828defde48cb tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] 10.222.0.55 "GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669" status: 200 len: 1552 microversion: 2.1 time: 0.241319 Sep 27 17:25:55.186292 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 122/263] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:54 2022] GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669 => generated 1552 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:25:55.193532 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ef46adcb-6f18-479d-ae5c-9bbe9616b19f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:55.193532 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ef46adcb-6f18-479d-ae5c-9bbe9616b19f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:55.193532 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ef46adcb-6f18-479d-ae5c-9bbe9616b19f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:55.193532 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ef46adcb-6f18-479d-ae5c-9bbe9616b19f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:55.193938 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ef46adcb-6f18-479d-ae5c-9bbe9616b19f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:55.194198 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ef46adcb-6f18-479d-ae5c-9bbe9616b19f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:55.334293 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-ef46adcb-6f18-479d-ae5c-9bbe9616b19f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:55.342324 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-ef46adcb-6f18-479d-ae5c-9bbe9616b19f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db" status: 200 len: 1520 microversion: 2.1 time: 0.165243 Sep 27 17:25:55.342895 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 142/264] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:55 2022] GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:25:56.198311 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-bcba2bdc-10a4-46c6-badc-bacbcfd5e97e tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:56.198911 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-bcba2bdc-10a4-46c6-badc-bacbcfd5e97e tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] [instance: 2e206773-221a-4857-b437-2b1a852b8277] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:56.204817 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-bcba2bdc-10a4-46c6-badc-bacbcfd5e97e tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:56.205295 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-bcba2bdc-10a4-46c6-badc-bacbcfd5e97e tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:56.205728 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-bcba2bdc-10a4-46c6-badc-bacbcfd5e97e tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:56.206429 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-bcba2bdc-10a4-46c6-badc-bacbcfd5e97e tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:56.206875 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-bcba2bdc-10a4-46c6-badc-bacbcfd5e97e tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:56.207290 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-bcba2bdc-10a4-46c6-badc-bacbcfd5e97e tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:56.210799 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-13b2ac56-ffd2-4319-ac86-8c67bae77175 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:56.211416 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-13b2ac56-ffd2-4319-ac86-8c67bae77175 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] [instance: 0e6c9900-b294-45b0-a692-18ed9f943669] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:56.218430 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-13b2ac56-ffd2-4319-ac86-8c67bae77175 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:56.219278 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-13b2ac56-ffd2-4319-ac86-8c67bae77175 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:56.220057 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-13b2ac56-ffd2-4319-ac86-8c67bae77175 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:56.221260 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-13b2ac56-ffd2-4319-ac86-8c67bae77175 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:56.222121 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-13b2ac56-ffd2-4319-ac86-8c67bae77175 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:56.222800 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-13b2ac56-ffd2-4319-ac86-8c67bae77175 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:56.411560 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-bcba2bdc-10a4-46c6-badc-bacbcfd5e97e tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dba953d778c418abea22efac408e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36351a4bc84a45cb866e72f52e6e725a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:56.416104 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-13b2ac56-ffd2-4319-ac86-8c67bae77175 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48c146c0bba4583a92d157e2eed7f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c16b9aaa5ac4e6dac613614c1a570c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:56.420170 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-bcba2bdc-10a4-46c6-badc-bacbcfd5e97e tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] 10.222.0.55 "GET /compute/v2.1/servers/2e206773-221a-4857-b437-2b1a852b8277" status: 200 len: 1319 microversion: 2.1 time: 0.225989 Sep 27 17:25:56.420747 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 123/265] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:56 2022] GET /compute/v2.1/servers/2e206773-221a-4857-b437-2b1a852b8277 => generated 1319 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:25:56.425410 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-e966ad3a-d146-4e21-9867-89a3ede22fa9 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:56.426007 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-e966ad3a-d146-4e21-9867-89a3ede22fa9 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: d622d15d-b954-409c-a1f5-538da5de83db] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:56.437184 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e966ad3a-d146-4e21-9867-89a3ede22fa9 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:56.437860 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e966ad3a-d146-4e21-9867-89a3ede22fa9 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:56.438552 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-13b2ac56-ffd2-4319-ac86-8c67bae77175 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] 10.222.0.55 "GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669" status: 200 len: 1552 microversion: 2.1 time: 0.232279 Sep 27 17:25:56.438675 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e966ad3a-d146-4e21-9867-89a3ede22fa9 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:56.439143 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 143/266] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:56 2022] GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669 => generated 1552 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:25:56.446236 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e966ad3a-d146-4e21-9867-89a3ede22fa9 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:56.446986 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e966ad3a-d146-4e21-9867-89a3ede22fa9 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:56.447423 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e966ad3a-d146-4e21-9867-89a3ede22fa9 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:56.581974 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-e966ad3a-d146-4e21-9867-89a3ede22fa9 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:56.590202 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-e966ad3a-d146-4e21-9867-89a3ede22fa9 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db" status: 200 len: 1520 microversion: 2.1 time: 0.168153 Sep 27 17:25:56.591317 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 124/267] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:56 2022] GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:25:57.441804 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-3dd5bc16-3400-43ec-bfc3-6a66b7c7b6c1 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:57.442527 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-3dd5bc16-3400-43ec-bfc3-6a66b7c7b6c1 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] [instance: 2e206773-221a-4857-b437-2b1a852b8277] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:57.454005 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3dd5bc16-3400-43ec-bfc3-6a66b7c7b6c1 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:57.454939 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3dd5bc16-3400-43ec-bfc3-6a66b7c7b6c1 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:57.455465 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3dd5bc16-3400-43ec-bfc3-6a66b7c7b6c1 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:57.456061 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3dd5bc16-3400-43ec-bfc3-6a66b7c7b6c1 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:57.456515 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3dd5bc16-3400-43ec-bfc3-6a66b7c7b6c1 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:57.457198 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3dd5bc16-3400-43ec-bfc3-6a66b7c7b6c1 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:57.464160 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-30cc0924-7218-4524-977c-b4b8c10d1ccf tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:57.465401 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-30cc0924-7218-4524-977c-b4b8c10d1ccf tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] [instance: 0e6c9900-b294-45b0-a692-18ed9f943669] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:57.476845 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-30cc0924-7218-4524-977c-b4b8c10d1ccf tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:57.477557 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-30cc0924-7218-4524-977c-b4b8c10d1ccf tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:57.478471 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-30cc0924-7218-4524-977c-b4b8c10d1ccf tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:57.489008 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-30cc0924-7218-4524-977c-b4b8c10d1ccf tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:57.489008 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-30cc0924-7218-4524-977c-b4b8c10d1ccf tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:57.489008 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-30cc0924-7218-4524-977c-b4b8c10d1ccf tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:57.490981 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:25:57.752267 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-30cc0924-7218-4524-977c-b4b8c10d1ccf tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48c146c0bba4583a92d157e2eed7f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c16b9aaa5ac4e6dac613614c1a570c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:57.757178 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-3dd5bc16-3400-43ec-bfc3-6a66b7c7b6c1 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dba953d778c418abea22efac408e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36351a4bc84a45cb866e72f52e6e725a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:57.766615 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-3dd5bc16-3400-43ec-bfc3-6a66b7c7b6c1 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] 10.222.0.55 "GET /compute/v2.1/servers/2e206773-221a-4857-b437-2b1a852b8277" status: 200 len: 1509 microversion: 2.1 time: 0.328715 Sep 27 17:25:57.767489 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 144/268] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:57 2022] GET /compute/v2.1/servers/2e206773-221a-4857-b437-2b1a852b8277 => generated 1509 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:25:57.768150 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-30cc0924-7218-4524-977c-b4b8c10d1ccf tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] 10.222.0.55 "GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669" status: 200 len: 1552 microversion: 2.1 time: 0.309581 Sep 27 17:25:57.772648 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-553efed9-4fda-43a7-9bc2-bed936c1ae4b tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:57.773503 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-553efed9-4fda-43a7-9bc2-bed936c1ae4b tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: d622d15d-b954-409c-a1f5-538da5de83db] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:57.780545 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-553efed9-4fda-43a7-9bc2-bed936c1ae4b tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:57.781284 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-553efed9-4fda-43a7-9bc2-bed936c1ae4b tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:57.781947 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-553efed9-4fda-43a7-9bc2-bed936c1ae4b tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:57.782911 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-553efed9-4fda-43a7-9bc2-bed936c1ae4b tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:57.783577 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-553efed9-4fda-43a7-9bc2-bed936c1ae4b tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:57.784424 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-553efed9-4fda-43a7-9bc2-bed936c1ae4b tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:57.787823 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 125/269] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:57 2022] GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669 => generated 1552 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:25:58.014753 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-553efed9-4fda-43a7-9bc2-bed936c1ae4b tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:58.029647 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-553efed9-4fda-43a7-9bc2-bed936c1ae4b tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db" status: 200 len: 1520 microversion: 2.1 time: 0.260101 Sep 27 17:25:58.031420 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 145/270] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:57 2022] GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db => generated 1520 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:25:58.782339 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [req-3383f85d-1e07-4c79-b81b-75456365688a req-7933b40e-82ef-4895-b9d1-49924b78ca50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e6c9900-b294-45b0-a692-18ed9f943669", "name": "network-vif-deleted", "tag": "8da35e49-fd42-450d-b5d6-f220c2448d60"}]} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:25:58.793683 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-023d2bf9-ac62-46cd-9923-60385da85729 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:58.794509 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-023d2bf9-ac62-46cd-9923-60385da85729 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] [instance: 0e6c9900-b294-45b0-a692-18ed9f943669] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:58.796979 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-3383f85d-1e07-4c79-b81b-75456365688a req-7933b40e-82ef-4895-b9d1-49924b78ca50 service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:58.797742 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-3383f85d-1e07-4c79-b81b-75456365688a req-7933b40e-82ef-4895-b9d1-49924b78ca50 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:58.798431 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-3383f85d-1e07-4c79-b81b-75456365688a req-7933b40e-82ef-4895-b9d1-49924b78ca50 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:58.803766 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-023d2bf9-ac62-46cd-9923-60385da85729 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:58.803766 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-023d2bf9-ac62-46cd-9923-60385da85729 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:58.803766 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-023d2bf9-ac62-46cd-9923-60385da85729 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:58.803766 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-023d2bf9-ac62-46cd-9923-60385da85729 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:58.804057 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-023d2bf9-ac62-46cd-9923-60385da85729 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:58.804491 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-023d2bf9-ac62-46cd-9923-60385da85729 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:58.817703 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.compute.server_external_events [req-3383f85d-1e07-4c79-b81b-75456365688a req-7933b40e-82ef-4895-b9d1-49924b78ca50 service nova] Creating event network-vif-deleted:8da35e49-fd42-450d-b5d6-f220c2448d60 for instance 0e6c9900-b294-45b0-a692-18ed9f943669 on hv-cinder-84914 Sep 27 17:25:58.825908 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [req-3383f85d-1e07-4c79-b81b-75456365688a req-7933b40e-82ef-4895-b9d1-49924b78ca50 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048326 Sep 27 17:25:58.827176 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 126/271] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:25:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:25:58.890301 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-023d2bf9-ac62-46cd-9923-60385da85729 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48c146c0bba4583a92d157e2eed7f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c16b9aaa5ac4e6dac613614c1a570c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:58.899941 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-023d2bf9-ac62-46cd-9923-60385da85729 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] 10.222.0.55 "GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669" status: 200 len: 1510 microversion: 2.1 time: 0.110539 Sep 27 17:25:58.900518 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 146/272] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:58 2022] GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669 => generated 1510 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:25:59.062398 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-a1761792-2a22-47b9-9ca7-4bbfe93804c5 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:59.062398 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-a1761792-2a22-47b9-9ca7-4bbfe93804c5 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: d622d15d-b954-409c-a1f5-538da5de83db] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:59.063384 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a1761792-2a22-47b9-9ca7-4bbfe93804c5 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:59.063384 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a1761792-2a22-47b9-9ca7-4bbfe93804c5 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:59.063384 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a1761792-2a22-47b9-9ca7-4bbfe93804c5 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:59.064075 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a1761792-2a22-47b9-9ca7-4bbfe93804c5 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:59.064527 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a1761792-2a22-47b9-9ca7-4bbfe93804c5 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:59.064949 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a1761792-2a22-47b9-9ca7-4bbfe93804c5 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:59.275992 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-a1761792-2a22-47b9-9ca7-4bbfe93804c5 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:25:59.290017 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-a1761792-2a22-47b9-9ca7-4bbfe93804c5 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db" status: 200 len: 1520 microversion: 2.1 time: 0.238338 Sep 27 17:25:59.290982 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 127/273] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:59 2022] GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db => generated 1520 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:25:59.923952 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-ab7c02df-408d-4b8c-affc-d0f1eb3c5eae tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:25:59.924637 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-ab7c02df-408d-4b8c-affc-d0f1eb3c5eae tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] [instance: 0e6c9900-b294-45b0-a692-18ed9f943669] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:25:59.930905 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ab7c02df-408d-4b8c-affc-d0f1eb3c5eae tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:59.931376 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ab7c02df-408d-4b8c-affc-d0f1eb3c5eae tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:59.931803 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ab7c02df-408d-4b8c-affc-d0f1eb3c5eae tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:59.932480 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ab7c02df-408d-4b8c-affc-d0f1eb3c5eae tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:25:59.932927 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ab7c02df-408d-4b8c-affc-d0f1eb3c5eae tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:25:59.933361 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ab7c02df-408d-4b8c-affc-d0f1eb3c5eae tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:25:59.999051 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-ab7c02df-408d-4b8c-affc-d0f1eb3c5eae tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48c146c0bba4583a92d157e2eed7f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c16b9aaa5ac4e6dac613614c1a570c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:26:00.008472 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-ab7c02df-408d-4b8c-affc-d0f1eb3c5eae tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] 10.222.0.55 "GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669" status: 200 len: 1510 microversion: 2.1 time: 0.088326 Sep 27 17:26:00.021452 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 147/274] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:25:59 2022] GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669 => generated 1510 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:26:00.313773 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-bce5b58f-4f80-47fd-94b3-019b9ca63bc2 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:26:00.314424 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-bce5b58f-4f80-47fd-94b3-019b9ca63bc2 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: d622d15d-b954-409c-a1f5-538da5de83db] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:26:00.320971 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-bce5b58f-4f80-47fd-94b3-019b9ca63bc2 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:00.321456 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-bce5b58f-4f80-47fd-94b3-019b9ca63bc2 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:00.321890 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-bce5b58f-4f80-47fd-94b3-019b9ca63bc2 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:00.322605 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-bce5b58f-4f80-47fd-94b3-019b9ca63bc2 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:00.323060 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-bce5b58f-4f80-47fd-94b3-019b9ca63bc2 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:00.323482 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-bce5b58f-4f80-47fd-94b3-019b9ca63bc2 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:00.450663 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-bce5b58f-4f80-47fd-94b3-019b9ca63bc2 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:26:00.458732 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-bce5b58f-4f80-47fd-94b3-019b9ca63bc2 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db" status: 200 len: 1520 microversion: 2.1 time: 0.148897 Sep 27 17:26:00.459308 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 128/275] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:26:00 2022] GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:26:01.034028 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-8877bc9b-4b1f-40be-a687-22137db1d9c3 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:26:01.034580 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-8877bc9b-4b1f-40be-a687-22137db1d9c3 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] [instance: 0e6c9900-b294-45b0-a692-18ed9f943669] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:26:01.040466 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8877bc9b-4b1f-40be-a687-22137db1d9c3 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:01.040951 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8877bc9b-4b1f-40be-a687-22137db1d9c3 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:01.041406 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8877bc9b-4b1f-40be-a687-22137db1d9c3 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:01.042135 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8877bc9b-4b1f-40be-a687-22137db1d9c3 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:01.042586 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8877bc9b-4b1f-40be-a687-22137db1d9c3 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:01.043006 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8877bc9b-4b1f-40be-a687-22137db1d9c3 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:01.106739 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-8877bc9b-4b1f-40be-a687-22137db1d9c3 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48c146c0bba4583a92d157e2eed7f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c16b9aaa5ac4e6dac613614c1a570c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:26:01.114908 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-8877bc9b-4b1f-40be-a687-22137db1d9c3 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] 10.222.0.55 "GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669" status: 200 len: 1510 microversion: 2.1 time: 0.084872 Sep 27 17:26:01.115466 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 148/276] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:26:01 2022] GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669 => generated 1510 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:26:01.482422 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-eadc706b-a58a-422a-a103-5045efaffbae tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:26:01.483022 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-eadc706b-a58a-422a-a103-5045efaffbae tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: d622d15d-b954-409c-a1f5-538da5de83db] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:26:01.489318 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-eadc706b-a58a-422a-a103-5045efaffbae tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:01.489798 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-eadc706b-a58a-422a-a103-5045efaffbae tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:01.490263 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-eadc706b-a58a-422a-a103-5045efaffbae tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:01.490945 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-eadc706b-a58a-422a-a103-5045efaffbae tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:01.491393 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-eadc706b-a58a-422a-a103-5045efaffbae tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:01.491808 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-eadc706b-a58a-422a-a103-5045efaffbae tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:01.619419 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-eadc706b-a58a-422a-a103-5045efaffbae tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:26:01.627045 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-eadc706b-a58a-422a-a103-5045efaffbae tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db" status: 200 len: 1520 microversion: 2.1 time: 0.149434 Sep 27 17:26:01.627609 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 129/277] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:26:01 2022] GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:26:02.139619 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-d9b19d33-c6b1-4090-9beb-02f031509ba9 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:26:02.140240 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-d9b19d33-c6b1-4090-9beb-02f031509ba9 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] [instance: 0e6c9900-b294-45b0-a692-18ed9f943669] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:26:02.146635 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d9b19d33-c6b1-4090-9beb-02f031509ba9 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:02.147121 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d9b19d33-c6b1-4090-9beb-02f031509ba9 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:02.147646 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d9b19d33-c6b1-4090-9beb-02f031509ba9 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:02.148394 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d9b19d33-c6b1-4090-9beb-02f031509ba9 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:02.148886 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d9b19d33-c6b1-4090-9beb-02f031509ba9 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:02.149309 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d9b19d33-c6b1-4090-9beb-02f031509ba9 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:02.209980 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-d9b19d33-c6b1-4090-9beb-02f031509ba9 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48c146c0bba4583a92d157e2eed7f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c16b9aaa5ac4e6dac613614c1a570c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:26:02.219070 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-d9b19d33-c6b1-4090-9beb-02f031509ba9 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] 10.222.0.55 "GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669" status: 200 len: 1510 microversion: 2.1 time: 0.084296 Sep 27 17:26:02.219625 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 149/278] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:26:02 2022] GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669 => generated 1510 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:26:02.649914 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-1812f129-3966-4749-965a-b77436f5072f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:26:02.650530 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-1812f129-3966-4749-965a-b77436f5072f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: d622d15d-b954-409c-a1f5-538da5de83db] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:26:02.657591 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1812f129-3966-4749-965a-b77436f5072f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:02.658092 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1812f129-3966-4749-965a-b77436f5072f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:02.658538 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1812f129-3966-4749-965a-b77436f5072f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:02.659233 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1812f129-3966-4749-965a-b77436f5072f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:02.659691 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1812f129-3966-4749-965a-b77436f5072f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:02.660114 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1812f129-3966-4749-965a-b77436f5072f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:02.788561 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-1812f129-3966-4749-965a-b77436f5072f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:26:02.796733 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-1812f129-3966-4749-965a-b77436f5072f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db" status: 200 len: 1520 microversion: 2.1 time: 0.150920 Sep 27 17:26:02.797292 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 130/279] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:26:02 2022] GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:26:03.242620 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-3eb67d23-fb65-4b4e-8841-10e356de0abd tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:26:03.243234 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-3eb67d23-fb65-4b4e-8841-10e356de0abd tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] [instance: 0e6c9900-b294-45b0-a692-18ed9f943669] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:26:03.251244 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3eb67d23-fb65-4b4e-8841-10e356de0abd tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:03.251718 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3eb67d23-fb65-4b4e-8841-10e356de0abd tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:03.252148 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3eb67d23-fb65-4b4e-8841-10e356de0abd tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:03.252826 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3eb67d23-fb65-4b4e-8841-10e356de0abd tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:03.253269 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3eb67d23-fb65-4b4e-8841-10e356de0abd tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:03.253708 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3eb67d23-fb65-4b4e-8841-10e356de0abd tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:03.313524 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-3eb67d23-fb65-4b4e-8841-10e356de0abd tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48c146c0bba4583a92d157e2eed7f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c16b9aaa5ac4e6dac613614c1a570c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:26:03.322115 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-3eb67d23-fb65-4b4e-8841-10e356de0abd tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] 10.222.0.55 "GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669" status: 200 len: 1510 microversion: 2.1 time: 0.083415 Sep 27 17:26:03.322668 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 150/280] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:26:03 2022] GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669 => generated 1510 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:26:03.820238 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-2a8bcf16-8b4b-487f-85ab-db7be4ac5c2e tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:26:03.820772 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-2a8bcf16-8b4b-487f-85ab-db7be4ac5c2e tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: d622d15d-b954-409c-a1f5-538da5de83db] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:26:03.828407 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2a8bcf16-8b4b-487f-85ab-db7be4ac5c2e tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:03.828883 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2a8bcf16-8b4b-487f-85ab-db7be4ac5c2e tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:03.829309 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2a8bcf16-8b4b-487f-85ab-db7be4ac5c2e tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:03.829988 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2a8bcf16-8b4b-487f-85ab-db7be4ac5c2e tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:03.830462 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2a8bcf16-8b4b-487f-85ab-db7be4ac5c2e tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:03.830956 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2a8bcf16-8b4b-487f-85ab-db7be4ac5c2e tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:03.957284 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-2a8bcf16-8b4b-487f-85ab-db7be4ac5c2e tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:26:03.965026 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-2a8bcf16-8b4b-487f-85ab-db7be4ac5c2e tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db" status: 200 len: 1520 microversion: 2.1 time: 0.148511 Sep 27 17:26:03.965590 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 131/281] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:26:03 2022] GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:26:04.345729 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-efc38198-e3a3-4f66-a181-bce1f4c5e754 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:26:04.346387 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-efc38198-e3a3-4f66-a181-bce1f4c5e754 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] [instance: 0e6c9900-b294-45b0-a692-18ed9f943669] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:26:04.352552 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-efc38198-e3a3-4f66-a181-bce1f4c5e754 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:04.353025 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-efc38198-e3a3-4f66-a181-bce1f4c5e754 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:04.353455 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-efc38198-e3a3-4f66-a181-bce1f4c5e754 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:04.354164 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-efc38198-e3a3-4f66-a181-bce1f4c5e754 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:04.354617 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-efc38198-e3a3-4f66-a181-bce1f4c5e754 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:04.355042 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-efc38198-e3a3-4f66-a181-bce1f4c5e754 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:04.418095 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-efc38198-e3a3-4f66-a181-bce1f4c5e754 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48c146c0bba4583a92d157e2eed7f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c16b9aaa5ac4e6dac613614c1a570c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:26:04.426088 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-efc38198-e3a3-4f66-a181-bce1f4c5e754 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] 10.222.0.55 "GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669" status: 200 len: 1510 microversion: 2.1 time: 0.084224 Sep 27 17:26:04.426660 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 151/282] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:26:04 2022] GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669 => generated 1510 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:26:04.988868 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-1fcf89c8-cef4-44bc-a47e-a9b6333f0f6e tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:26:04.989403 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-1fcf89c8-cef4-44bc-a47e-a9b6333f0f6e tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: d622d15d-b954-409c-a1f5-538da5de83db] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:26:04.996941 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1fcf89c8-cef4-44bc-a47e-a9b6333f0f6e tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:04.997526 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1fcf89c8-cef4-44bc-a47e-a9b6333f0f6e tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:04.998049 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1fcf89c8-cef4-44bc-a47e-a9b6333f0f6e tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:04.998831 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1fcf89c8-cef4-44bc-a47e-a9b6333f0f6e tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:04.999341 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1fcf89c8-cef4-44bc-a47e-a9b6333f0f6e tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:04.999852 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1fcf89c8-cef4-44bc-a47e-a9b6333f0f6e tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:05.127531 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-1fcf89c8-cef4-44bc-a47e-a9b6333f0f6e tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:26:05.135447 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-1fcf89c8-cef4-44bc-a47e-a9b6333f0f6e tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db" status: 200 len: 1520 microversion: 2.1 time: 0.150345 Sep 27 17:26:05.136236 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 132/283] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:26:04 2022] GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:26:05.448698 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-b1756eb8-3962-4539-a140-5bb6acf46fe3 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:26:05.449861 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-b1756eb8-3962-4539-a140-5bb6acf46fe3 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] [instance: 0e6c9900-b294-45b0-a692-18ed9f943669] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:26:05.455804 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b1756eb8-3962-4539-a140-5bb6acf46fe3 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:05.456283 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b1756eb8-3962-4539-a140-5bb6acf46fe3 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:05.456717 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b1756eb8-3962-4539-a140-5bb6acf46fe3 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:05.457400 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b1756eb8-3962-4539-a140-5bb6acf46fe3 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:05.457853 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b1756eb8-3962-4539-a140-5bb6acf46fe3 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:05.458312 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b1756eb8-3962-4539-a140-5bb6acf46fe3 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:05.520213 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-b1756eb8-3962-4539-a140-5bb6acf46fe3 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48c146c0bba4583a92d157e2eed7f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c16b9aaa5ac4e6dac613614c1a570c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:26:05.531215 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-b1756eb8-3962-4539-a140-5bb6acf46fe3 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] 10.222.0.55 "GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669" status: 200 len: 1510 microversion: 2.1 time: 0.084167 Sep 27 17:26:05.531719 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 152/284] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:26:05 2022] GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669 => generated 1510 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:26:06.158908 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-9a466dd2-159f-4ff4-8be8-611ee4ebf721 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:26:06.159556 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-9a466dd2-159f-4ff4-8be8-611ee4ebf721 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: d622d15d-b954-409c-a1f5-538da5de83db] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:26:06.166313 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9a466dd2-159f-4ff4-8be8-611ee4ebf721 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:06.166816 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9a466dd2-159f-4ff4-8be8-611ee4ebf721 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:06.167274 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9a466dd2-159f-4ff4-8be8-611ee4ebf721 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:06.168610 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9a466dd2-159f-4ff4-8be8-611ee4ebf721 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:06.169098 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9a466dd2-159f-4ff4-8be8-611ee4ebf721 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:06.169560 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9a466dd2-159f-4ff4-8be8-611ee4ebf721 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:06.299004 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-9a466dd2-159f-4ff4-8be8-611ee4ebf721 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:26:06.306853 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-9a466dd2-159f-4ff4-8be8-611ee4ebf721 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db" status: 200 len: 1520 microversion: 2.1 time: 0.152020 Sep 27 17:26:06.307467 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 133/285] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:26:06 2022] GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:26:06.552966 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-d63fc37c-1443-40cf-911b-d55f710d46a7 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:26:06.553511 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-d63fc37c-1443-40cf-911b-d55f710d46a7 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] [instance: 0e6c9900-b294-45b0-a692-18ed9f943669] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:26:06.559444 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d63fc37c-1443-40cf-911b-d55f710d46a7 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:06.559935 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d63fc37c-1443-40cf-911b-d55f710d46a7 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:06.560356 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d63fc37c-1443-40cf-911b-d55f710d46a7 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:06.561036 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d63fc37c-1443-40cf-911b-d55f710d46a7 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:06.561489 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d63fc37c-1443-40cf-911b-d55f710d46a7 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:06.561911 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d63fc37c-1443-40cf-911b-d55f710d46a7 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:06.622604 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-d63fc37c-1443-40cf-911b-d55f710d46a7 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48c146c0bba4583a92d157e2eed7f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c16b9aaa5ac4e6dac613614c1a570c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:26:06.631052 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-d63fc37c-1443-40cf-911b-d55f710d46a7 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] 10.222.0.55 "GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669" status: 200 len: 1510 microversion: 2.1 time: 0.082007 Sep 27 17:26:06.631616 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 153/286] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:26:06 2022] GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669 => generated 1510 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:26:07.328741 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-381f1c76-86ff-4211-a239-c8f795b123ad tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:26:07.329351 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-381f1c76-86ff-4211-a239-c8f795b123ad tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: d622d15d-b954-409c-a1f5-538da5de83db] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:26:07.335991 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-381f1c76-86ff-4211-a239-c8f795b123ad tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:07.336486 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-381f1c76-86ff-4211-a239-c8f795b123ad tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:07.336925 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-381f1c76-86ff-4211-a239-c8f795b123ad tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:07.337623 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-381f1c76-86ff-4211-a239-c8f795b123ad tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:07.338229 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-381f1c76-86ff-4211-a239-c8f795b123ad tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:07.338680 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-381f1c76-86ff-4211-a239-c8f795b123ad tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:07.465737 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-381f1c76-86ff-4211-a239-c8f795b123ad tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:26:07.474228 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-381f1c76-86ff-4211-a239-c8f795b123ad tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db" status: 200 len: 1520 microversion: 2.1 time: 0.149292 Sep 27 17:26:07.474784 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 134/287] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:26:07 2022] GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:26:07.655296 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-76b42a0f-c5ef-4e31-8c70-54be825cf85d tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:26:07.655902 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-76b42a0f-c5ef-4e31-8c70-54be825cf85d tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] [instance: 0e6c9900-b294-45b0-a692-18ed9f943669] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:26:07.661740 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-76b42a0f-c5ef-4e31-8c70-54be825cf85d tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:07.662260 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-76b42a0f-c5ef-4e31-8c70-54be825cf85d tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:07.662696 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-76b42a0f-c5ef-4e31-8c70-54be825cf85d tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:07.663460 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-76b42a0f-c5ef-4e31-8c70-54be825cf85d tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:07.663960 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-76b42a0f-c5ef-4e31-8c70-54be825cf85d tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:07.664411 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-76b42a0f-c5ef-4e31-8c70-54be825cf85d tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:07.726806 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-76b42a0f-c5ef-4e31-8c70-54be825cf85d tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48c146c0bba4583a92d157e2eed7f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c16b9aaa5ac4e6dac613614c1a570c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:26:07.735363 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-76b42a0f-c5ef-4e31-8c70-54be825cf85d tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] 10.222.0.55 "GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669" status: 200 len: 1345 microversion: 2.1 time: 0.084031 Sep 27 17:26:07.735936 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 154/288] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:26:07 2022] GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669 => generated 1345 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:26:08.497342 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-cfff99cd-703b-450f-93ff-71581a408ed2 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:26:08.498036 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-cfff99cd-703b-450f-93ff-71581a408ed2 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: d622d15d-b954-409c-a1f5-538da5de83db] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:26:08.504465 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cfff99cd-703b-450f-93ff-71581a408ed2 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:08.504943 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cfff99cd-703b-450f-93ff-71581a408ed2 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:08.505381 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cfff99cd-703b-450f-93ff-71581a408ed2 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:08.506115 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cfff99cd-703b-450f-93ff-71581a408ed2 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:08.506576 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cfff99cd-703b-450f-93ff-71581a408ed2 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:08.507010 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cfff99cd-703b-450f-93ff-71581a408ed2 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:08.639649 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-cfff99cd-703b-450f-93ff-71581a408ed2 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:26:08.648714 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-cfff99cd-703b-450f-93ff-71581a408ed2 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db" status: 200 len: 1520 microversion: 2.1 time: 0.155226 Sep 27 17:26:08.649286 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 135/289] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:26:08 2022] GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:26:08.758941 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-66e63aab-a7b5-43b3-bca5-bef5ecb09e3e tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:26:08.759557 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-66e63aab-a7b5-43b3-bca5-bef5ecb09e3e tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] [instance: 0e6c9900-b294-45b0-a692-18ed9f943669] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:26:08.766312 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-66e63aab-a7b5-43b3-bca5-bef5ecb09e3e tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:08.766786 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-66e63aab-a7b5-43b3-bca5-bef5ecb09e3e tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:08.767214 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-66e63aab-a7b5-43b3-bca5-bef5ecb09e3e tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:08.767894 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-66e63aab-a7b5-43b3-bca5-bef5ecb09e3e tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:08.768346 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-66e63aab-a7b5-43b3-bca5-bef5ecb09e3e tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:08.768763 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-66e63aab-a7b5-43b3-bca5-bef5ecb09e3e tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:08.829327 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-66e63aab-a7b5-43b3-bca5-bef5ecb09e3e tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48c146c0bba4583a92d157e2eed7f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c16b9aaa5ac4e6dac613614c1a570c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:26:08.837985 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-66e63aab-a7b5-43b3-bca5-bef5ecb09e3e tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] 10.222.0.55 "GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669" status: 200 len: 1345 microversion: 2.1 time: 0.082838 Sep 27 17:26:08.838601 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 155/290] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:26:08 2022] GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669 => generated 1345 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:26:09.673009 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-ee802d21-b345-44c0-82c6-e905fe4a0085 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:26:09.673537 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-ee802d21-b345-44c0-82c6-e905fe4a0085 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: d622d15d-b954-409c-a1f5-538da5de83db] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:26:09.679944 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ee802d21-b345-44c0-82c6-e905fe4a0085 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:09.680428 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ee802d21-b345-44c0-82c6-e905fe4a0085 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:09.680866 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ee802d21-b345-44c0-82c6-e905fe4a0085 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:09.681552 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ee802d21-b345-44c0-82c6-e905fe4a0085 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:09.682002 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ee802d21-b345-44c0-82c6-e905fe4a0085 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:09.682453 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ee802d21-b345-44c0-82c6-e905fe4a0085 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:09.812473 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-ee802d21-b345-44c0-82c6-e905fe4a0085 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:26:09.820190 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-ee802d21-b345-44c0-82c6-e905fe4a0085 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db" status: 200 len: 1520 microversion: 2.1 time: 0.151207 Sep 27 17:26:09.820757 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 136/291] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:26:09 2022] GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:26:09.861577 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-0eef8761-99cd-40d3-a53b-19b0570704e5 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:26:09.862267 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-0eef8761-99cd-40d3-a53b-19b0570704e5 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] [instance: 0e6c9900-b294-45b0-a692-18ed9f943669] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:26:09.868033 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-0eef8761-99cd-40d3-a53b-19b0570704e5 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:09.868503 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-0eef8761-99cd-40d3-a53b-19b0570704e5 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:09.869030 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-0eef8761-99cd-40d3-a53b-19b0570704e5 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:09.869718 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-0eef8761-99cd-40d3-a53b-19b0570704e5 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:09.870200 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-0eef8761-99cd-40d3-a53b-19b0570704e5 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:09.870627 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-0eef8761-99cd-40d3-a53b-19b0570704e5 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:09.888114 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_cell1:SELECT=100 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:26:09.931521 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-0eef8761-99cd-40d3-a53b-19b0570704e5 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48c146c0bba4583a92d157e2eed7f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c16b9aaa5ac4e6dac613614c1a570c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:26:09.939950 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-0eef8761-99cd-40d3-a53b-19b0570704e5 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] 10.222.0.55 "GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669" status: 200 len: 1345 microversion: 2.1 time: 0.082400 Sep 27 17:26:09.940519 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 156/292] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:26:09 2022] GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669 => generated 1345 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:26:10.850869 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-56f8976e-2015-4498-80c2-ef580975bffe tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:26:10.851525 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-56f8976e-2015-4498-80c2-ef580975bffe tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: d622d15d-b954-409c-a1f5-538da5de83db] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:26:10.858561 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-56f8976e-2015-4498-80c2-ef580975bffe tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:10.859036 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-56f8976e-2015-4498-80c2-ef580975bffe tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:10.859463 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-56f8976e-2015-4498-80c2-ef580975bffe tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:10.860152 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-56f8976e-2015-4498-80c2-ef580975bffe tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:10.860596 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-56f8976e-2015-4498-80c2-ef580975bffe tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:10.861010 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-56f8976e-2015-4498-80c2-ef580975bffe tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:10.963170 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-1ffc7443-9952-4e8d-a63b-990b06ee3f6f tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:26:10.963909 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-1ffc7443-9952-4e8d-a63b-990b06ee3f6f tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] [instance: 0e6c9900-b294-45b0-a692-18ed9f943669] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:26:10.969893 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1ffc7443-9952-4e8d-a63b-990b06ee3f6f tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:10.970492 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1ffc7443-9952-4e8d-a63b-990b06ee3f6f tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:10.970998 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1ffc7443-9952-4e8d-a63b-990b06ee3f6f tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:10.971780 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1ffc7443-9952-4e8d-a63b-990b06ee3f6f tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:10.972307 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1ffc7443-9952-4e8d-a63b-990b06ee3f6f tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:10.972801 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1ffc7443-9952-4e8d-a63b-990b06ee3f6f tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:10.998429 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-56f8976e-2015-4498-80c2-ef580975bffe tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:26:11.006361 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-56f8976e-2015-4498-80c2-ef580975bffe tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db" status: 200 len: 1520 microversion: 2.1 time: 0.160587 Sep 27 17:26:11.007129 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 137/293] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:26:10 2022] GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:26:11.033803 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-1ffc7443-9952-4e8d-a63b-990b06ee3f6f tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48c146c0bba4583a92d157e2eed7f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c16b9aaa5ac4e6dac613614c1a570c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:26:11.042267 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-1ffc7443-9952-4e8d-a63b-990b06ee3f6f tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] 10.222.0.55 "GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669" status: 200 len: 1345 microversion: 2.1 time: 0.082861 Sep 27 17:26:11.043331 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 157/294] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:26:10 2022] GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669 => generated 1345 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:26:12.032445 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-5b20c75c-78cd-4a48-a55d-b35bd1eeb935 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:26:12.033845 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-5b20c75c-78cd-4a48-a55d-b35bd1eeb935 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: d622d15d-b954-409c-a1f5-538da5de83db] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:26:12.041176 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5b20c75c-78cd-4a48-a55d-b35bd1eeb935 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:12.041656 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5b20c75c-78cd-4a48-a55d-b35bd1eeb935 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:12.042105 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5b20c75c-78cd-4a48-a55d-b35bd1eeb935 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:12.042789 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5b20c75c-78cd-4a48-a55d-b35bd1eeb935 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:12.043247 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5b20c75c-78cd-4a48-a55d-b35bd1eeb935 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:12.043653 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5b20c75c-78cd-4a48-a55d-b35bd1eeb935 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:12.065897 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-1f23020e-e281-4afa-bdf8-b95d88d9b93c tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:26:12.066726 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-1f23020e-e281-4afa-bdf8-b95d88d9b93c tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] [instance: 0e6c9900-b294-45b0-a692-18ed9f943669] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:26:12.077246 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1f23020e-e281-4afa-bdf8-b95d88d9b93c tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:12.078588 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1f23020e-e281-4afa-bdf8-b95d88d9b93c tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:12.079258 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1f23020e-e281-4afa-bdf8-b95d88d9b93c tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:12.080890 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1f23020e-e281-4afa-bdf8-b95d88d9b93c tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:12.081671 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1f23020e-e281-4afa-bdf8-b95d88d9b93c tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:12.082362 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1f23020e-e281-4afa-bdf8-b95d88d9b93c tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:12.162567 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-1f23020e-e281-4afa-bdf8-b95d88d9b93c tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48c146c0bba4583a92d157e2eed7f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c16b9aaa5ac4e6dac613614c1a570c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:26:12.172795 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-1f23020e-e281-4afa-bdf8-b95d88d9b93c tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] 10.222.0.55 "GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669" status: 200 len: 1345 microversion: 2.1 time: 0.110981 Sep 27 17:26:12.173808 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 158/295] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:26:12 2022] GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669 => generated 1345 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:26:12.329839 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-5b20c75c-78cd-4a48-a55d-b35bd1eeb935 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:26:12.337502 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-5b20c75c-78cd-4a48-a55d-b35bd1eeb935 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db" status: 200 len: 1500 microversion: 2.1 time: 0.309183 Sep 27 17:26:12.338064 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 138/296] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:26:12 2022] GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db => generated 1500 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:26:12.360570 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-144ba29b-a240-4774-bb9c-96a91fa89247 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:26:12.361176 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-144ba29b-a240-4774-bb9c-96a91fa89247 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: 95a7693f-d1df-43fb-81e7-1c83b069e269] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:26:12.367032 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-144ba29b-a240-4774-bb9c-96a91fa89247 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:12.367510 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-144ba29b-a240-4774-bb9c-96a91fa89247 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:12.367948 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-144ba29b-a240-4774-bb9c-96a91fa89247 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:12.368640 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-144ba29b-a240-4774-bb9c-96a91fa89247 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:12.369096 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-144ba29b-a240-4774-bb9c-96a91fa89247 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:12.369517 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-144ba29b-a240-4774-bb9c-96a91fa89247 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:12.502270 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-144ba29b-a240-4774-bb9c-96a91fa89247 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:26:12.509960 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-144ba29b-a240-4774-bb9c-96a91fa89247 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/95a7693f-d1df-43fb-81e7-1c83b069e269" status: 200 len: 1515 microversion: 2.1 time: 0.153157 Sep 27 17:26:12.510566 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 159/297] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:26:12 2022] GET /compute/v2.1/servers/95a7693f-d1df-43fb-81e7-1c83b069e269 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:26:13.196906 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-b5d344c3-afe8-47f9-ab20-7cf17da8fb28 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:26:13.197515 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-b5d344c3-afe8-47f9-ab20-7cf17da8fb28 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] [instance: 0e6c9900-b294-45b0-a692-18ed9f943669] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:26:13.204376 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b5d344c3-afe8-47f9-ab20-7cf17da8fb28 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:13.204852 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b5d344c3-afe8-47f9-ab20-7cf17da8fb28 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:13.205312 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b5d344c3-afe8-47f9-ab20-7cf17da8fb28 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:13.206033 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b5d344c3-afe8-47f9-ab20-7cf17da8fb28 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:13.206508 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b5d344c3-afe8-47f9-ab20-7cf17da8fb28 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:13.206930 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b5d344c3-afe8-47f9-ab20-7cf17da8fb28 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:13.267463 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-b5d344c3-afe8-47f9-ab20-7cf17da8fb28 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48c146c0bba4583a92d157e2eed7f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c16b9aaa5ac4e6dac613614c1a570c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:26:13.275721 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-b5d344c3-afe8-47f9-ab20-7cf17da8fb28 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] 10.222.0.55 "GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669" status: 200 len: 1345 microversion: 2.1 time: 0.082846 Sep 27 17:26:13.276281 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 139/298] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:26:13 2022] GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669 => generated 1345 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:26:14.300015 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-40c8fa7e-ae23-4288-8fbd-3f6853fb3c84 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:26:14.300534 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-40c8fa7e-ae23-4288-8fbd-3f6853fb3c84 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] [instance: 0e6c9900-b294-45b0-a692-18ed9f943669] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:26:14.321664 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_api:SELECT=64 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:26:14.324190 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-40c8fa7e-ae23-4288-8fbd-3f6853fb3c84 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:14.324684 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-40c8fa7e-ae23-4288-8fbd-3f6853fb3c84 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:14.325124 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-40c8fa7e-ae23-4288-8fbd-3f6853fb3c84 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:14.325833 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-40c8fa7e-ae23-4288-8fbd-3f6853fb3c84 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:14.326324 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-40c8fa7e-ae23-4288-8fbd-3f6853fb3c84 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:14.326754 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-40c8fa7e-ae23-4288-8fbd-3f6853fb3c84 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:14.396702 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-40c8fa7e-ae23-4288-8fbd-3f6853fb3c84 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48c146c0bba4583a92d157e2eed7f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c16b9aaa5ac4e6dac613614c1a570c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:26:14.406030 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-40c8fa7e-ae23-4288-8fbd-3f6853fb3c84 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] 10.222.0.55 "GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669" status: 200 len: 1345 microversion: 2.1 time: 0.109990 Sep 27 17:26:14.406646 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 160/299] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:26:14 2022] GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669 => generated 1345 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:26:15.429845 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-4a857fab-68d8-4ed7-91c4-6ba848381e11 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:26:15.430610 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-4a857fab-68d8-4ed7-91c4-6ba848381e11 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] [instance: 0e6c9900-b294-45b0-a692-18ed9f943669] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:26:15.433342 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:26:15.439245 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4a857fab-68d8-4ed7-91c4-6ba848381e11 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:15.439823 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4a857fab-68d8-4ed7-91c4-6ba848381e11 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:15.440262 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4a857fab-68d8-4ed7-91c4-6ba848381e11 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:15.440983 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4a857fab-68d8-4ed7-91c4-6ba848381e11 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:15.441440 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4a857fab-68d8-4ed7-91c4-6ba848381e11 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:15.441860 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4a857fab-68d8-4ed7-91c4-6ba848381e11 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:15.505550 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-4a857fab-68d8-4ed7-91c4-6ba848381e11 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48c146c0bba4583a92d157e2eed7f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c16b9aaa5ac4e6dac613614c1a570c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:26:15.514367 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-4a857fab-68d8-4ed7-91c4-6ba848381e11 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] 10.222.0.55 "GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669" status: 200 len: 1345 microversion: 2.1 time: 0.088451 Sep 27 17:26:15.515194 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 140/300] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:26:15 2022] GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669 => generated 1345 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:26:16.536539 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-595c7f38-2f65-4f2c-8935-fa495f64a4ec tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:26:16.537152 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-595c7f38-2f65-4f2c-8935-fa495f64a4ec tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] [instance: 0e6c9900-b294-45b0-a692-18ed9f943669] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:26:16.543707 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-595c7f38-2f65-4f2c-8935-fa495f64a4ec tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:16.544189 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-595c7f38-2f65-4f2c-8935-fa495f64a4ec tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:16.544623 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-595c7f38-2f65-4f2c-8935-fa495f64a4ec tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:16.545315 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-595c7f38-2f65-4f2c-8935-fa495f64a4ec tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:16.545770 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-595c7f38-2f65-4f2c-8935-fa495f64a4ec tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:16.546232 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-595c7f38-2f65-4f2c-8935-fa495f64a4ec tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:16.605986 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-595c7f38-2f65-4f2c-8935-fa495f64a4ec tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48c146c0bba4583a92d157e2eed7f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c16b9aaa5ac4e6dac613614c1a570c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:26:16.614206 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-595c7f38-2f65-4f2c-8935-fa495f64a4ec tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] 10.222.0.55 "GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669" status: 200 len: 1345 microversion: 2.1 time: 0.081460 Sep 27 17:26:16.614756 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 161/301] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:26:16 2022] GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669 => generated 1345 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:26:17.636757 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-64da228b-8c51-4aa2-910b-f0f188fb503f tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:26:17.638038 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-64da228b-8c51-4aa2-910b-f0f188fb503f tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] [instance: 0e6c9900-b294-45b0-a692-18ed9f943669] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:26:17.645236 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-64da228b-8c51-4aa2-910b-f0f188fb503f tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:17.645982 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-64da228b-8c51-4aa2-910b-f0f188fb503f tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:17.646568 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-64da228b-8c51-4aa2-910b-f0f188fb503f tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:17.647287 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-64da228b-8c51-4aa2-910b-f0f188fb503f tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:17.647740 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-64da228b-8c51-4aa2-910b-f0f188fb503f tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:17.648168 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-64da228b-8c51-4aa2-910b-f0f188fb503f tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:17.719060 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-64da228b-8c51-4aa2-910b-f0f188fb503f tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48c146c0bba4583a92d157e2eed7f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c16b9aaa5ac4e6dac613614c1a570c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:26:17.727514 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-64da228b-8c51-4aa2-910b-f0f188fb503f tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] 10.222.0.55 "GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669" status: 200 len: 1345 microversion: 2.1 time: 0.094678 Sep 27 17:26:17.728108 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 141/302] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:26:17 2022] GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669 => generated 1345 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:26:18.753396 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-827edff1-1f4b-4599-865d-876db0b49489 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:26:18.755058 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-827edff1-1f4b-4599-865d-876db0b49489 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] [instance: 0e6c9900-b294-45b0-a692-18ed9f943669] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:26:18.762051 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-827edff1-1f4b-4599-865d-876db0b49489 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:18.762565 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-827edff1-1f4b-4599-865d-876db0b49489 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:18.762994 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-827edff1-1f4b-4599-865d-876db0b49489 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:18.763688 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-827edff1-1f4b-4599-865d-876db0b49489 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:18.764137 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-827edff1-1f4b-4599-865d-876db0b49489 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:18.764594 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-827edff1-1f4b-4599-865d-876db0b49489 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:18.803680 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-827edff1-1f4b-4599-865d-876db0b49489 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:18.804341 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-827edff1-1f4b-4599-865d-876db0b49489 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:18.805061 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-827edff1-1f4b-4599-865d-876db0b49489 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:18.805501 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.objects.instance [None req-827edff1-1f4b-4599-865d-876db0b49489 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lazy-loading 'fault' on Instance uuid 0e6c9900-b294-45b0-a692-18ed9f943669 {{(pid=120416) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 17:26:18.865748 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-827edff1-1f4b-4599-865d-876db0b49489 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e48c146c0bba4583a92d157e2eed7f99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c16b9aaa5ac4e6dac613614c1a570c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:26:18.874901 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-827edff1-1f4b-4599-865d-876db0b49489 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] 10.222.0.55 "GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669" status: 200 len: 1350 microversion: 2.1 time: 0.126748 Sep 27 17:26:18.875763 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 162/303] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:26:18 2022] GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669 => generated 1350 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:26:19.898857 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-7903b858-13d3-438f-b7ec-fc8ff9087b72 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:26:19.899453 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-7903b858-13d3-438f-b7ec-fc8ff9087b72 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] [instance: 0e6c9900-b294-45b0-a692-18ed9f943669] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:26:19.906850 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7903b858-13d3-438f-b7ec-fc8ff9087b72 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:19.907332 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7903b858-13d3-438f-b7ec-fc8ff9087b72 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:19.907766 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7903b858-13d3-438f-b7ec-fc8ff9087b72 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:19.908449 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7903b858-13d3-438f-b7ec-fc8ff9087b72 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:19.908901 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7903b858-13d3-438f-b7ec-fc8ff9087b72 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:19.909320 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7903b858-13d3-438f-b7ec-fc8ff9087b72 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:19.923208 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.wsgi [None req-7903b858-13d3-438f-b7ec-fc8ff9087b72 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] HTTP exception thrown: Instance 0e6c9900-b294-45b0-a692-18ed9f943669 could not be found. Sep 27 17:26:19.927729 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-7903b858-13d3-438f-b7ec-fc8ff9087b72 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Request method failure captured: Sep 27 17:26:19.927729 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: request: GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669 HTTP/1.1 Sep 27 17:26:19.927729 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Accept: application/json Sep 27 17:26:19.927729 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Accept-Encoding: identity Sep 27 17:26:19.927729 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Connection: close Sep 27 17:26:19.927729 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Content-Length: 0 Sep 27 17:26:19.927729 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Content-Type: application/json Sep 27 17:26:19.927729 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Host: 10.222.0.55 Sep 27 17:26:19.927729 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Openstack-System-Scope: None Sep 27 17:26:19.927729 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: User-Agent: python-urllib3/1.26.12 Sep 27 17:26:19.927729 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Auth-Token: gAAAAABjMzHA-73FJDhyx_O33vOkK-uuiUwKHkdk9VJ_Qg95UbL_oxLAuI2aDV_zdzwewJ1Ampsi2fca22zzwkKd40rpLm1oIXJmtMeb5FlOcSoqL_GIpNlzWUq83vIrKjp1ITLGXUIYOlOeiAdbd0b5JFp5LB7JWIcPumj6tFshC60c5HhfCFk Sep 27 17:26:19.927729 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Domain-Id: None Sep 27 17:26:19.927729 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Domain-Name: None Sep 27 17:26:19.927729 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Identity-Status: Confirmed Sep 27 17:26:19.927729 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Is-Admin-Project: True Sep 27 17:26:19.927729 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Domain-Id: default Sep 27 17:26:19.927729 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Domain-Name: Default Sep 27 17:26:19.927729 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Id: 9c16b9aaa5ac4e6dac613614c1a570c8 Sep 27 17:26:19.927729 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Name: tempest-DeleteServersTestJSON-1298363214 Sep 27 17:26:19.927729 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Role: reader,member Sep 27 17:26:19.927729 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Roles: reader,member Sep 27 17:26:19.929268 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/9c16b9aaa5ac4e6dac613614c1a570c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_9c16b9aaa5ac4e6dac613614c1a570c8", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/9c16b9aaa5ac4e6dac613614c1a570c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/9c16b9aaa5ac4e6dac613614c1a570c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 27 17:26:19.929268 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Tenant: tempest-DeleteServersTestJSON-1298363214 Sep 27 17:26:19.929268 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Tenant-Id: 9c16b9aaa5ac4e6dac613614c1a570c8 Sep 27 17:26:19.929268 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Tenant-Name: tempest-DeleteServersTestJSON-1298363214 Sep 27 17:26:19.929268 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User: tempest-DeleteServersTestJSON-1298363214-project Sep 27 17:26:19.929268 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Domain-Id: default Sep 27 17:26:19.929268 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Domain-Name: Default Sep 27 17:26:19.929268 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Id: e48c146c0bba4583a92d157e2eed7f99 Sep 27 17:26:19.929268 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Name: tempest-DeleteServersTestJSON-1298363214-project Sep 27 17:26:19.929268 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: method: > Sep 27 17:26:19.929268 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: exception: Instance 0e6c9900-b294-45b0-a692-18ed9f943669 could not be found. Sep 27 17:26:19.929268 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: action_args: {'id': '0e6c9900-b294-45b0-a692-18ed9f943669'} Sep 27 17:26:19.930187 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 17:26:19.930187 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:26:19.930187 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 17:26:19.930187 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 17:26:19.930187 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 17:26:19.930187 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 17:26:19.930187 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 17:26:19.930187 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 17:26:19.930187 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 17:26:19.930187 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 17:26:19.930187 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e6c9900-b294-45b0-a692-18ed9f943669 could not be found. Sep 27 17:26:19.930187 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:26:19.930187 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:26:19.930187 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:26:19.930187 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:26:19.930187 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:26:19.930187 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:26:19.930187 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 17:26:19.930187 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 17:26:19.930187 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 17:26:19.931786 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 17:26:19.931786 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 17:26:19.931786 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 17:26:19.931786 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 17:26:19.931786 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 17:26:19.931786 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 17:26:19.931786 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 17:26:19.931786 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e6c9900-b294-45b0-a692-18ed9f943669 could not be found. Sep 27 17:26:19.931786 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:26:19.931786 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:26:19.931786 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:26:19.931786 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:26:19.931786 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:26:19.931786 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:26:19.931786 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 17:26:19.931786 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 17:26:19.931786 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e6c9900-b294-45b0-a692-18ed9f943669 could not be found. Sep 27 17:26:19.931786 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:26:19.933256 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-7903b858-13d3-438f-b7ec-fc8ff9087b72 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Returning 404 to user: Instance 0e6c9900-b294-45b0-a692-18ed9f943669 could not be found. {{(pid=120415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 17:26:19.933256 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-7903b858-13d3-438f-b7ec-fc8ff9087b72 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] 10.222.0.55 "GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669" status: 404 len: 111 microversion: 2.1 time: 0.034142 Sep 27 17:26:19.933256 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 142/304] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:26:19 2022] GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 17:26:20.057439 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-33195a4a-b8e1-43da-bd57-b91eb6c15680 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:26:20.060277 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-33195a4a-b8e1-43da-bd57-b91eb6c15680 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] [instance: 0e6c9900-b294-45b0-a692-18ed9f943669] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:26:20.066091 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-33195a4a-b8e1-43da-bd57-b91eb6c15680 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:20.066574 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-33195a4a-b8e1-43da-bd57-b91eb6c15680 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:20.067016 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-33195a4a-b8e1-43da-bd57-b91eb6c15680 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:20.067696 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-33195a4a-b8e1-43da-bd57-b91eb6c15680 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:20.068149 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-33195a4a-b8e1-43da-bd57-b91eb6c15680 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:20.068759 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-33195a4a-b8e1-43da-bd57-b91eb6c15680 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:20.082307 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.wsgi [None req-33195a4a-b8e1-43da-bd57-b91eb6c15680 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] HTTP exception thrown: Instance 0e6c9900-b294-45b0-a692-18ed9f943669 could not be found. Sep 27 17:26:20.086610 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-33195a4a-b8e1-43da-bd57-b91eb6c15680 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Request method failure captured: Sep 27 17:26:20.086610 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: request: GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669/os-volume_attachments HTTP/1.1 Sep 27 17:26:20.086610 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Accept: application/json Sep 27 17:26:20.086610 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Accept-Encoding: identity Sep 27 17:26:20.086610 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Connection: close Sep 27 17:26:20.086610 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Content-Length: 0 Sep 27 17:26:20.086610 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Content-Type: application/json Sep 27 17:26:20.086610 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Host: 10.222.0.55 Sep 27 17:26:20.086610 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Openstack-System-Scope: None Sep 27 17:26:20.086610 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: User-Agent: python-urllib3/1.26.12 Sep 27 17:26:20.086610 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Auth-Token: gAAAAABjMzHA-73FJDhyx_O33vOkK-uuiUwKHkdk9VJ_Qg95UbL_oxLAuI2aDV_zdzwewJ1Ampsi2fca22zzwkKd40rpLm1oIXJmtMeb5FlOcSoqL_GIpNlzWUq83vIrKjp1ITLGXUIYOlOeiAdbd0b5JFp5LB7JWIcPumj6tFshC60c5HhfCFk Sep 27 17:26:20.086610 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Domain-Id: None Sep 27 17:26:20.086610 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Domain-Name: None Sep 27 17:26:20.086610 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Identity-Status: Confirmed Sep 27 17:26:20.086610 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Is-Admin-Project: True Sep 27 17:26:20.086610 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Domain-Id: default Sep 27 17:26:20.086610 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Domain-Name: Default Sep 27 17:26:20.086610 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Id: 9c16b9aaa5ac4e6dac613614c1a570c8 Sep 27 17:26:20.086610 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Name: tempest-DeleteServersTestJSON-1298363214 Sep 27 17:26:20.086610 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Role: reader,member Sep 27 17:26:20.086610 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Roles: reader,member Sep 27 17:26:20.087999 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/9c16b9aaa5ac4e6dac613614c1a570c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_9c16b9aaa5ac4e6dac613614c1a570c8", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/9c16b9aaa5ac4e6dac613614c1a570c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/9c16b9aaa5ac4e6dac613614c1a570c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 27 17:26:20.087999 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Tenant: tempest-DeleteServersTestJSON-1298363214 Sep 27 17:26:20.087999 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Tenant-Id: 9c16b9aaa5ac4e6dac613614c1a570c8 Sep 27 17:26:20.087999 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Tenant-Name: tempest-DeleteServersTestJSON-1298363214 Sep 27 17:26:20.087999 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User: tempest-DeleteServersTestJSON-1298363214-project Sep 27 17:26:20.087999 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Domain-Id: default Sep 27 17:26:20.087999 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Domain-Name: Default Sep 27 17:26:20.087999 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Id: e48c146c0bba4583a92d157e2eed7f99 Sep 27 17:26:20.087999 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Name: tempest-DeleteServersTestJSON-1298363214-project Sep 27 17:26:20.087999 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: method: > Sep 27 17:26:20.087999 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: exception: Instance 0e6c9900-b294-45b0-a692-18ed9f943669 could not be found. Sep 27 17:26:20.087999 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: action_args: {'server_id': '0e6c9900-b294-45b0-a692-18ed9f943669'} Sep 27 17:26:20.089411 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 17:26:20.089411 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:26:20.089411 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 17:26:20.089411 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 17:26:20.089411 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 17:26:20.089411 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 17:26:20.089411 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 17:26:20.089411 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 17:26:20.089411 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 17:26:20.089411 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 17:26:20.089411 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e6c9900-b294-45b0-a692-18ed9f943669 could not be found. Sep 27 17:26:20.089411 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:26:20.089411 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:26:20.089411 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:26:20.089411 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:26:20.089411 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:26:20.089411 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:26:20.089411 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 17:26:20.089411 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 17:26:20.089411 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 17:26:20.091262 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 17:26:20.091262 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 27 17:26:20.091262 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 17:26:20.091262 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 27 17:26:20.091262 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 17:26:20.091262 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 27 17:26:20.091262 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 27 17:26:20.091262 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 17:26:20.091262 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 17:26:20.091262 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e6c9900-b294-45b0-a692-18ed9f943669 could not be found. Sep 27 17:26:20.091262 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:26:20.091262 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:26:20.091262 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:26:20.091262 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:26:20.091262 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:26:20.091262 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:26:20.091262 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 17:26:20.091262 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 17:26:20.091262 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e6c9900-b294-45b0-a692-18ed9f943669 could not be found. Sep 27 17:26:20.091262 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:26:20.092672 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-33195a4a-b8e1-43da-bd57-b91eb6c15680 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Returning 404 to user: Instance 0e6c9900-b294-45b0-a692-18ed9f943669 could not be found. {{(pid=120416) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 17:26:20.092672 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-33195a4a-b8e1-43da-bd57-b91eb6c15680 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] 10.222.0.55 "GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.034925 Sep 27 17:26:20.092672 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 163/305] 10.222.0.55 () {58 vars in 1302 bytes} [Tue Sep 27 17:26:20 2022] GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669/os-volume_attachments => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 17:26:20.092917 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-78fd4f2b-807b-464e-81f6-b14aa83e50c4 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:26:20.094872 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-78fd4f2b-807b-464e-81f6-b14aa83e50c4 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: 95a7693f-d1df-43fb-81e7-1c83b069e269] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:26:20.100738 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-78fd4f2b-807b-464e-81f6-b14aa83e50c4 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:20.101404 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-78fd4f2b-807b-464e-81f6-b14aa83e50c4 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:20.101839 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-78fd4f2b-807b-464e-81f6-b14aa83e50c4 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:20.102563 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-78fd4f2b-807b-464e-81f6-b14aa83e50c4 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:20.103030 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-78fd4f2b-807b-464e-81f6-b14aa83e50c4 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:20.103458 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-78fd4f2b-807b-464e-81f6-b14aa83e50c4 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:20.107439 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell1:SELECT=100 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:26:20.128449 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.objects.instance [None req-78fd4f2b-807b-464e-81f6-b14aa83e50c4 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lazy-loading 'flavor' on Instance uuid 95a7693f-d1df-43fb-81e7-1c83b069e269 {{(pid=120415) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 17:26:20.243665 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-78fd4f2b-807b-464e-81f6-b14aa83e50c4 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "POST /compute/v2.1/servers/95a7693f-d1df-43fb-81e7-1c83b069e269/action" status: 200 len: 32 microversion: 2.1 time: 0.155445 Sep 27 17:26:20.244475 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 143/306] 10.222.0.55 () {60 vars in 1278 bytes} [Tue Sep 27 17:26:20 2022] POST /compute/v2.1/servers/95a7693f-d1df-43fb-81e7-1c83b069e269/action => generated 32 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 27 17:26:20.255549 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-818aabd2-b373-41b9-9cf0-9208e102f7a6 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:26:20.256271 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-818aabd2-b373-41b9-9cf0-9208e102f7a6 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: 95a7693f-d1df-43fb-81e7-1c83b069e269] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:26:20.262989 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-818aabd2-b373-41b9-9cf0-9208e102f7a6 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:20.263784 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-818aabd2-b373-41b9-9cf0-9208e102f7a6 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:20.264361 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-818aabd2-b373-41b9-9cf0-9208e102f7a6 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:20.265232 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-818aabd2-b373-41b9-9cf0-9208e102f7a6 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:20.278793 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-818aabd2-b373-41b9-9cf0-9208e102f7a6 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:20.279356 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-818aabd2-b373-41b9-9cf0-9208e102f7a6 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:20.534568 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-818aabd2-b373-41b9-9cf0-9208e102f7a6 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:26:20.544271 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-818aabd2-b373-41b9-9cf0-9208e102f7a6 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/95a7693f-d1df-43fb-81e7-1c83b069e269" status: 200 len: 1521 microversion: 2.1 time: 0.293121 Sep 27 17:26:20.545874 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 164/307] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:26:20 2022] GET /compute/v2.1/servers/95a7693f-d1df-43fb-81e7-1c83b069e269 => generated 1521 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:26:21.321896 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-c01eb2c9-6a17-4d2c-8b17-532cd07b9844 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:26:21.322352 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-c01eb2c9-6a17-4d2c-8b17-532cd07b9844 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] [instance: 0e6c9900-b294-45b0-a692-18ed9f943669] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:26:21.330554 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c01eb2c9-6a17-4d2c-8b17-532cd07b9844 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:21.331213 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c01eb2c9-6a17-4d2c-8b17-532cd07b9844 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:21.331709 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c01eb2c9-6a17-4d2c-8b17-532cd07b9844 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:21.332460 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c01eb2c9-6a17-4d2c-8b17-532cd07b9844 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:21.332979 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c01eb2c9-6a17-4d2c-8b17-532cd07b9844 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:21.333687 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c01eb2c9-6a17-4d2c-8b17-532cd07b9844 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:21.348059 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.wsgi [None req-c01eb2c9-6a17-4d2c-8b17-532cd07b9844 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] HTTP exception thrown: Instance 0e6c9900-b294-45b0-a692-18ed9f943669 could not be found. Sep 27 17:26:21.349726 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-c01eb2c9-6a17-4d2c-8b17-532cd07b9844 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Request method failure captured: Sep 27 17:26:21.349726 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: request: DELETE /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669 HTTP/1.1 Sep 27 17:26:21.349726 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Accept: application/json Sep 27 17:26:21.349726 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Accept-Encoding: identity Sep 27 17:26:21.349726 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Connection: close Sep 27 17:26:21.349726 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Content-Length: 0 Sep 27 17:26:21.349726 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Content-Type: application/json Sep 27 17:26:21.349726 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Host: 10.222.0.55 Sep 27 17:26:21.349726 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Openstack-System-Scope: None Sep 27 17:26:21.349726 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: User-Agent: python-urllib3/1.26.12 Sep 27 17:26:21.349726 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Auth-Token: gAAAAABjMzHA-73FJDhyx_O33vOkK-uuiUwKHkdk9VJ_Qg95UbL_oxLAuI2aDV_zdzwewJ1Ampsi2fca22zzwkKd40rpLm1oIXJmtMeb5FlOcSoqL_GIpNlzWUq83vIrKjp1ITLGXUIYOlOeiAdbd0b5JFp5LB7JWIcPumj6tFshC60c5HhfCFk Sep 27 17:26:21.349726 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Domain-Id: None Sep 27 17:26:21.349726 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Domain-Name: None Sep 27 17:26:21.349726 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Identity-Status: Confirmed Sep 27 17:26:21.349726 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Is-Admin-Project: True Sep 27 17:26:21.349726 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Domain-Id: default Sep 27 17:26:21.349726 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Domain-Name: Default Sep 27 17:26:21.349726 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Id: 9c16b9aaa5ac4e6dac613614c1a570c8 Sep 27 17:26:21.349726 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Name: tempest-DeleteServersTestJSON-1298363214 Sep 27 17:26:21.349726 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Role: reader,member Sep 27 17:26:21.349726 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Roles: reader,member Sep 27 17:26:21.351207 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/9c16b9aaa5ac4e6dac613614c1a570c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_9c16b9aaa5ac4e6dac613614c1a570c8", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/9c16b9aaa5ac4e6dac613614c1a570c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/9c16b9aaa5ac4e6dac613614c1a570c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 27 17:26:21.351207 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Tenant: tempest-DeleteServersTestJSON-1298363214 Sep 27 17:26:21.351207 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Tenant-Id: 9c16b9aaa5ac4e6dac613614c1a570c8 Sep 27 17:26:21.351207 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Tenant-Name: tempest-DeleteServersTestJSON-1298363214 Sep 27 17:26:21.351207 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User: tempest-DeleteServersTestJSON-1298363214-project Sep 27 17:26:21.351207 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Domain-Id: default Sep 27 17:26:21.351207 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Domain-Name: Default Sep 27 17:26:21.351207 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Id: e48c146c0bba4583a92d157e2eed7f99 Sep 27 17:26:21.351207 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Name: tempest-DeleteServersTestJSON-1298363214-project Sep 27 17:26:21.351207 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: method: > Sep 27 17:26:21.351207 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: exception: Instance 0e6c9900-b294-45b0-a692-18ed9f943669 could not be found. Sep 27 17:26:21.351207 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: action_args: {'id': '0e6c9900-b294-45b0-a692-18ed9f943669'} Sep 27 17:26:21.352070 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 17:26:21.352070 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:26:21.352070 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 17:26:21.352070 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 17:26:21.352070 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 17:26:21.352070 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 17:26:21.352070 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 17:26:21.352070 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 17:26:21.352070 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 17:26:21.352070 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 17:26:21.352070 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e6c9900-b294-45b0-a692-18ed9f943669 could not be found. Sep 27 17:26:21.352070 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:26:21.352070 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:26:21.352070 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:26:21.352070 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:26:21.352070 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:26:21.352070 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:26:21.352070 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 17:26:21.352070 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 17:26:21.352070 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 17:26:21.353279 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 17:26:21.353279 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 27 17:26:21.353279 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 27 17:26:21.353279 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 27 17:26:21.353279 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 27 17:26:21.353279 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 17:26:21.353279 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 17:26:21.353279 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 17:26:21.353279 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 17:26:21.353279 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e6c9900-b294-45b0-a692-18ed9f943669 could not be found. Sep 27 17:26:21.353279 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:26:21.353279 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:26:21.353279 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:26:21.353279 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:26:21.353279 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:26:21.353279 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:26:21.353279 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 17:26:21.353279 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 17:26:21.353279 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e6c9900-b294-45b0-a692-18ed9f943669 could not be found. Sep 27 17:26:21.353279 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:26:21.354738 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-c01eb2c9-6a17-4d2c-8b17-532cd07b9844 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Returning 404 to user: Instance 0e6c9900-b294-45b0-a692-18ed9f943669 could not be found. {{(pid=120415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 17:26:21.354738 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-c01eb2c9-6a17-4d2c-8b17-532cd07b9844 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] 10.222.0.55 "DELETE /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669" status: 404 len: 111 microversion: 2.1 time: 0.033982 Sep 27 17:26:21.354738 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 144/308] 10.222.0.55 () {58 vars in 1239 bytes} [Tue Sep 27 17:26:21 2022] DELETE /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 17:26:21.360168 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-a4313208-55c1-44c7-a099-1ce0f41d5522 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:26:21.360784 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-a4313208-55c1-44c7-a099-1ce0f41d5522 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] [instance: 0e6c9900-b294-45b0-a692-18ed9f943669] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:26:21.366539 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a4313208-55c1-44c7-a099-1ce0f41d5522 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:21.367019 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a4313208-55c1-44c7-a099-1ce0f41d5522 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:21.367447 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a4313208-55c1-44c7-a099-1ce0f41d5522 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:21.368129 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a4313208-55c1-44c7-a099-1ce0f41d5522 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:21.368580 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a4313208-55c1-44c7-a099-1ce0f41d5522 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:21.368998 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a4313208-55c1-44c7-a099-1ce0f41d5522 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:21.388642 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.wsgi [None req-a4313208-55c1-44c7-a099-1ce0f41d5522 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] HTTP exception thrown: Instance 0e6c9900-b294-45b0-a692-18ed9f943669 could not be found. Sep 27 17:26:21.388768 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-a4313208-55c1-44c7-a099-1ce0f41d5522 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Request method failure captured: Sep 27 17:26:21.388768 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: request: GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669 HTTP/1.1 Sep 27 17:26:21.388768 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Accept: application/json Sep 27 17:26:21.388768 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Accept-Encoding: identity Sep 27 17:26:21.388768 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Connection: close Sep 27 17:26:21.388768 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Content-Length: 0 Sep 27 17:26:21.388768 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Content-Type: application/json Sep 27 17:26:21.388768 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Host: 10.222.0.55 Sep 27 17:26:21.388768 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Openstack-System-Scope: None Sep 27 17:26:21.388768 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: User-Agent: python-urllib3/1.26.12 Sep 27 17:26:21.388768 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Auth-Token: gAAAAABjMzHA-73FJDhyx_O33vOkK-uuiUwKHkdk9VJ_Qg95UbL_oxLAuI2aDV_zdzwewJ1Ampsi2fca22zzwkKd40rpLm1oIXJmtMeb5FlOcSoqL_GIpNlzWUq83vIrKjp1ITLGXUIYOlOeiAdbd0b5JFp5LB7JWIcPumj6tFshC60c5HhfCFk Sep 27 17:26:21.388768 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Domain-Id: None Sep 27 17:26:21.388768 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Domain-Name: None Sep 27 17:26:21.388768 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Identity-Status: Confirmed Sep 27 17:26:21.388768 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Is-Admin-Project: True Sep 27 17:26:21.388768 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Domain-Id: default Sep 27 17:26:21.388768 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Domain-Name: Default Sep 27 17:26:21.388768 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Id: 9c16b9aaa5ac4e6dac613614c1a570c8 Sep 27 17:26:21.388768 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Name: tempest-DeleteServersTestJSON-1298363214 Sep 27 17:26:21.388768 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Role: reader,member Sep 27 17:26:21.388768 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Roles: reader,member Sep 27 17:26:21.390160 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/9c16b9aaa5ac4e6dac613614c1a570c8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_9c16b9aaa5ac4e6dac613614c1a570c8", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/9c16b9aaa5ac4e6dac613614c1a570c8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/9c16b9aaa5ac4e6dac613614c1a570c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 27 17:26:21.390160 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Tenant: tempest-DeleteServersTestJSON-1298363214 Sep 27 17:26:21.390160 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Tenant-Id: 9c16b9aaa5ac4e6dac613614c1a570c8 Sep 27 17:26:21.390160 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Tenant-Name: tempest-DeleteServersTestJSON-1298363214 Sep 27 17:26:21.390160 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User: tempest-DeleteServersTestJSON-1298363214-project Sep 27 17:26:21.390160 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Domain-Id: default Sep 27 17:26:21.390160 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Domain-Name: Default Sep 27 17:26:21.390160 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Id: e48c146c0bba4583a92d157e2eed7f99 Sep 27 17:26:21.390160 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Name: tempest-DeleteServersTestJSON-1298363214-project Sep 27 17:26:21.390160 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: method: > Sep 27 17:26:21.390160 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: exception: Instance 0e6c9900-b294-45b0-a692-18ed9f943669 could not be found. Sep 27 17:26:21.390160 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: action_args: {'id': '0e6c9900-b294-45b0-a692-18ed9f943669'} Sep 27 17:26:21.391045 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 17:26:21.391045 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:26:21.391045 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 17:26:21.391045 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 17:26:21.391045 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 17:26:21.391045 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 17:26:21.391045 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 17:26:21.391045 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 17:26:21.391045 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 17:26:21.391045 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 17:26:21.391045 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e6c9900-b294-45b0-a692-18ed9f943669 could not be found. Sep 27 17:26:21.391045 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:26:21.391045 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:26:21.391045 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:26:21.391045 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:26:21.391045 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:26:21.391045 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:26:21.391045 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 17:26:21.391045 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 17:26:21.391045 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 17:26:21.392423 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 17:26:21.392423 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 17:26:21.392423 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 17:26:21.392423 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 17:26:21.392423 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 17:26:21.392423 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 17:26:21.392423 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 17:26:21.392423 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e6c9900-b294-45b0-a692-18ed9f943669 could not be found. Sep 27 17:26:21.392423 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:26:21.392423 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:26:21.392423 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:26:21.392423 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:26:21.392423 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:26:21.392423 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:26:21.392423 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 17:26:21.392423 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 17:26:21.392423 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e6c9900-b294-45b0-a692-18ed9f943669 could not be found. Sep 27 17:26:21.392423 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:26:21.393700 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-a4313208-55c1-44c7-a099-1ce0f41d5522 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] Returning 404 to user: Instance 0e6c9900-b294-45b0-a692-18ed9f943669 could not be found. {{(pid=120416) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 17:26:21.393700 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-a4313208-55c1-44c7-a099-1ce0f41d5522 tempest-DeleteServersTestJSON-1298363214 tempest-DeleteServersTestJSON-1298363214-project] 10.222.0.55 "GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669" status: 404 len: 111 microversion: 2.1 time: 0.033735 Sep 27 17:26:21.393700 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 165/309] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:26:21 2022] GET /compute/v2.1/servers/0e6c9900-b294-45b0-a692-18ed9f943669 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 17:26:21.568723 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-668cb10e-3022-4a95-99d8-e3c713745e66 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:26:21.569221 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-668cb10e-3022-4a95-99d8-e3c713745e66 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: 95a7693f-d1df-43fb-81e7-1c83b069e269] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:26:21.575448 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-668cb10e-3022-4a95-99d8-e3c713745e66 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:21.575924 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-668cb10e-3022-4a95-99d8-e3c713745e66 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:21.576357 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-668cb10e-3022-4a95-99d8-e3c713745e66 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:21.577031 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-668cb10e-3022-4a95-99d8-e3c713745e66 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:21.577479 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-668cb10e-3022-4a95-99d8-e3c713745e66 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:21.577896 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-668cb10e-3022-4a95-99d8-e3c713745e66 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:21.878607 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-668cb10e-3022-4a95-99d8-e3c713745e66 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:26:21.889702 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-668cb10e-3022-4a95-99d8-e3c713745e66 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/95a7693f-d1df-43fb-81e7-1c83b069e269" status: 200 len: 1521 microversion: 2.1 time: 0.324923 Sep 27 17:26:21.902540 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 145/310] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:26:21 2022] GET /compute/v2.1/servers/95a7693f-d1df-43fb-81e7-1c83b069e269 => generated 1521 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:26:22.920590 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-caf3194c-0bc4-4ea1-b2fd-a2c3035061e6 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:26:22.921382 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-caf3194c-0bc4-4ea1-b2fd-a2c3035061e6 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: 95a7693f-d1df-43fb-81e7-1c83b069e269] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:26:22.936423 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-caf3194c-0bc4-4ea1-b2fd-a2c3035061e6 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:22.937508 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-caf3194c-0bc4-4ea1-b2fd-a2c3035061e6 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:22.938605 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-caf3194c-0bc4-4ea1-b2fd-a2c3035061e6 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:22.939773 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-caf3194c-0bc4-4ea1-b2fd-a2c3035061e6 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:22.940696 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-caf3194c-0bc4-4ea1-b2fd-a2c3035061e6 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:22.941302 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-caf3194c-0bc4-4ea1-b2fd-a2c3035061e6 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:23.473280 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-caf3194c-0bc4-4ea1-b2fd-a2c3035061e6 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:26:23.485472 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-caf3194c-0bc4-4ea1-b2fd-a2c3035061e6 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/95a7693f-d1df-43fb-81e7-1c83b069e269" status: 200 len: 1521 microversion: 2.1 time: 0.571621 Sep 27 17:26:23.486039 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 166/311] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:26:22 2022] GET /compute/v2.1/servers/95a7693f-d1df-43fb-81e7-1c83b069e269 => generated 1521 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:26:24.514190 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-15c91dde-7f9c-4e84-8f48-cc4a7afc9793 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:26:24.514802 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-15c91dde-7f9c-4e84-8f48-cc4a7afc9793 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: 95a7693f-d1df-43fb-81e7-1c83b069e269] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:26:24.523260 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-15c91dde-7f9c-4e84-8f48-cc4a7afc9793 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:24.523751 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-15c91dde-7f9c-4e84-8f48-cc4a7afc9793 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:24.524185 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-15c91dde-7f9c-4e84-8f48-cc4a7afc9793 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:24.524886 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-15c91dde-7f9c-4e84-8f48-cc4a7afc9793 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:24.528103 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-15c91dde-7f9c-4e84-8f48-cc4a7afc9793 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:24.528880 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-15c91dde-7f9c-4e84-8f48-cc4a7afc9793 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:24.766646 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-15c91dde-7f9c-4e84-8f48-cc4a7afc9793 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:26:24.774535 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-15c91dde-7f9c-4e84-8f48-cc4a7afc9793 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/95a7693f-d1df-43fb-81e7-1c83b069e269" status: 200 len: 1521 microversion: 2.1 time: 0.265277 Sep 27 17:26:24.775111 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 146/312] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:26:24 2022] GET /compute/v2.1/servers/95a7693f-d1df-43fb-81e7-1c83b069e269 => generated 1521 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:26:25.803997 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-d167c4df-b990-4e60-840d-ef34339bac46 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:26:25.805307 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-d167c4df-b990-4e60-840d-ef34339bac46 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: 95a7693f-d1df-43fb-81e7-1c83b069e269] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:26:25.814119 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d167c4df-b990-4e60-840d-ef34339bac46 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:25.815033 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d167c4df-b990-4e60-840d-ef34339bac46 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:25.815505 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d167c4df-b990-4e60-840d-ef34339bac46 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:25.816341 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d167c4df-b990-4e60-840d-ef34339bac46 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:25.817188 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d167c4df-b990-4e60-840d-ef34339bac46 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:25.817590 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d167c4df-b990-4e60-840d-ef34339bac46 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:26.103519 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-d167c4df-b990-4e60-840d-ef34339bac46 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:26:26.122509 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-d167c4df-b990-4e60-840d-ef34339bac46 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/95a7693f-d1df-43fb-81e7-1c83b069e269" status: 200 len: 1521 microversion: 2.1 time: 0.323064 Sep 27 17:26:26.134741 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 167/313] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:26:25 2022] GET /compute/v2.1/servers/95a7693f-d1df-43fb-81e7-1c83b069e269 => generated 1521 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:26:27.150820 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-11d84fa3-4df4-4129-b35d-3280c729a96f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:26:27.151719 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-11d84fa3-4df4-4129-b35d-3280c729a96f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: 95a7693f-d1df-43fb-81e7-1c83b069e269] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:26:27.159065 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-11d84fa3-4df4-4129-b35d-3280c729a96f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:27.160041 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-11d84fa3-4df4-4129-b35d-3280c729a96f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:27.160485 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-11d84fa3-4df4-4129-b35d-3280c729a96f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:27.161182 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-11d84fa3-4df4-4129-b35d-3280c729a96f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:27.162311 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-11d84fa3-4df4-4129-b35d-3280c729a96f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:27.162743 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-11d84fa3-4df4-4129-b35d-3280c729a96f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:27.353706 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-11d84fa3-4df4-4129-b35d-3280c729a96f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:26:27.363279 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-11d84fa3-4df4-4129-b35d-3280c729a96f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/95a7693f-d1df-43fb-81e7-1c83b069e269" status: 200 len: 1521 microversion: 2.1 time: 0.217786 Sep 27 17:26:27.381231 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 147/314] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:26:27 2022] GET /compute/v2.1/servers/95a7693f-d1df-43fb-81e7-1c83b069e269 => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:26:28.390308 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-7dd2a4fb-546c-4233-b2f2-b83da1cbfc5d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:26:28.391001 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-7dd2a4fb-546c-4233-b2f2-b83da1cbfc5d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: 95a7693f-d1df-43fb-81e7-1c83b069e269] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:26:28.402469 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7dd2a4fb-546c-4233-b2f2-b83da1cbfc5d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:28.403236 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7dd2a4fb-546c-4233-b2f2-b83da1cbfc5d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:28.410971 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7dd2a4fb-546c-4233-b2f2-b83da1cbfc5d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:28.411919 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7dd2a4fb-546c-4233-b2f2-b83da1cbfc5d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:28.414305 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7dd2a4fb-546c-4233-b2f2-b83da1cbfc5d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:28.417858 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7dd2a4fb-546c-4233-b2f2-b83da1cbfc5d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:28.609755 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-7dd2a4fb-546c-4233-b2f2-b83da1cbfc5d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:26:28.618737 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-7dd2a4fb-546c-4233-b2f2-b83da1cbfc5d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/95a7693f-d1df-43fb-81e7-1c83b069e269" status: 200 len: 1521 microversion: 2.1 time: 0.233803 Sep 27 17:26:28.620099 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 168/315] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:26:28 2022] GET /compute/v2.1/servers/95a7693f-d1df-43fb-81e7-1c83b069e269 => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:26:29.646469 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-14f3c217-c639-4fc7-aef8-ce2e22118466 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:26:29.649527 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-14f3c217-c639-4fc7-aef8-ce2e22118466 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: 95a7693f-d1df-43fb-81e7-1c83b069e269] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:26:29.658799 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-14f3c217-c639-4fc7-aef8-ce2e22118466 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:29.659512 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-14f3c217-c639-4fc7-aef8-ce2e22118466 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:29.660764 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-14f3c217-c639-4fc7-aef8-ce2e22118466 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:29.661671 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-14f3c217-c639-4fc7-aef8-ce2e22118466 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:29.662317 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-14f3c217-c639-4fc7-aef8-ce2e22118466 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:29.662891 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-14f3c217-c639-4fc7-aef8-ce2e22118466 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:29.845512 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-14f3c217-c639-4fc7-aef8-ce2e22118466 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:26:29.858531 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-14f3c217-c639-4fc7-aef8-ce2e22118466 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/95a7693f-d1df-43fb-81e7-1c83b069e269" status: 200 len: 1521 microversion: 2.1 time: 0.217351 Sep 27 17:26:29.859672 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 148/316] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:26:29 2022] GET /compute/v2.1/servers/95a7693f-d1df-43fb-81e7-1c83b069e269 => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:26:30.884657 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-b4190d19-cf7b-473b-9a24-8819bea6f021 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:26:30.885356 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-b4190d19-cf7b-473b-9a24-8819bea6f021 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: 95a7693f-d1df-43fb-81e7-1c83b069e269] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:26:30.895185 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b4190d19-cf7b-473b-9a24-8819bea6f021 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:30.895756 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b4190d19-cf7b-473b-9a24-8819bea6f021 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:30.896497 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b4190d19-cf7b-473b-9a24-8819bea6f021 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:30.903108 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b4190d19-cf7b-473b-9a24-8819bea6f021 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:30.903888 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b4190d19-cf7b-473b-9a24-8819bea6f021 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:30.904525 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b4190d19-cf7b-473b-9a24-8819bea6f021 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:31.110916 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-b4190d19-cf7b-473b-9a24-8819bea6f021 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:26:31.127143 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-b4190d19-cf7b-473b-9a24-8819bea6f021 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/95a7693f-d1df-43fb-81e7-1c83b069e269" status: 200 len: 1521 microversion: 2.1 time: 0.246264 Sep 27 17:26:31.128200 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 169/317] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:26:30 2022] GET /compute/v2.1/servers/95a7693f-d1df-43fb-81e7-1c83b069e269 => generated 1521 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:26:32.152526 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-5dae8344-2db9-43bd-8aab-9a62c6eb1035 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:26:32.153693 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-5dae8344-2db9-43bd-8aab-9a62c6eb1035 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: 95a7693f-d1df-43fb-81e7-1c83b069e269] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:26:32.160801 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5dae8344-2db9-43bd-8aab-9a62c6eb1035 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:32.161607 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5dae8344-2db9-43bd-8aab-9a62c6eb1035 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:32.162181 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5dae8344-2db9-43bd-8aab-9a62c6eb1035 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:32.163437 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5dae8344-2db9-43bd-8aab-9a62c6eb1035 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:32.164194 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5dae8344-2db9-43bd-8aab-9a62c6eb1035 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:32.164749 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5dae8344-2db9-43bd-8aab-9a62c6eb1035 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:32.352944 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-5dae8344-2db9-43bd-8aab-9a62c6eb1035 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:26:32.366471 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-5dae8344-2db9-43bd-8aab-9a62c6eb1035 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/95a7693f-d1df-43fb-81e7-1c83b069e269" status: 200 len: 1521 microversion: 2.1 time: 0.217726 Sep 27 17:26:32.383362 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 149/318] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:26:32 2022] GET /compute/v2.1/servers/95a7693f-d1df-43fb-81e7-1c83b069e269 => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:26:33.398017 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-294d3542-60cf-4f6b-beeb-141130f31681 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:26:33.400180 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-294d3542-60cf-4f6b-beeb-141130f31681 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: 95a7693f-d1df-43fb-81e7-1c83b069e269] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:26:33.417159 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-294d3542-60cf-4f6b-beeb-141130f31681 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:33.417979 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-294d3542-60cf-4f6b-beeb-141130f31681 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:33.418805 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-294d3542-60cf-4f6b-beeb-141130f31681 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:33.420113 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-294d3542-60cf-4f6b-beeb-141130f31681 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:33.420791 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-294d3542-60cf-4f6b-beeb-141130f31681 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:33.421515 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-294d3542-60cf-4f6b-beeb-141130f31681 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:33.715308 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-294d3542-60cf-4f6b-beeb-141130f31681 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:26:33.732741 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-294d3542-60cf-4f6b-beeb-141130f31681 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/95a7693f-d1df-43fb-81e7-1c83b069e269" status: 200 len: 1521 microversion: 2.1 time: 0.342664 Sep 27 17:26:33.734275 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 170/319] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:26:33 2022] GET /compute/v2.1/servers/95a7693f-d1df-43fb-81e7-1c83b069e269 => generated 1521 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:26:34.764561 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-ae406663-3843-47db-a0ff-9f3d3c2da28b tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:26:34.765266 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-ae406663-3843-47db-a0ff-9f3d3c2da28b tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: 95a7693f-d1df-43fb-81e7-1c83b069e269] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:26:34.778768 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ae406663-3843-47db-a0ff-9f3d3c2da28b tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:34.780251 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ae406663-3843-47db-a0ff-9f3d3c2da28b tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:34.780860 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ae406663-3843-47db-a0ff-9f3d3c2da28b tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:34.784442 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ae406663-3843-47db-a0ff-9f3d3c2da28b tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:34.785142 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ae406663-3843-47db-a0ff-9f3d3c2da28b tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:34.786275 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ae406663-3843-47db-a0ff-9f3d3c2da28b tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:35.022877 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-ae406663-3843-47db-a0ff-9f3d3c2da28b tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:26:35.032476 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-ae406663-3843-47db-a0ff-9f3d3c2da28b tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/95a7693f-d1df-43fb-81e7-1c83b069e269" status: 200 len: 1521 microversion: 2.1 time: 0.272003 Sep 27 17:26:35.050124 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 150/320] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:26:34 2022] GET /compute/v2.1/servers/95a7693f-d1df-43fb-81e7-1c83b069e269 => generated 1521 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:26:36.059833 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-a3b107ae-9ed7-4852-8e32-4a80e8568e67 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:26:36.060506 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-a3b107ae-9ed7-4852-8e32-4a80e8568e67 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: 95a7693f-d1df-43fb-81e7-1c83b069e269] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:26:36.075224 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a3b107ae-9ed7-4852-8e32-4a80e8568e67 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:36.075426 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a3b107ae-9ed7-4852-8e32-4a80e8568e67 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:36.075893 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a3b107ae-9ed7-4852-8e32-4a80e8568e67 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:36.076629 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a3b107ae-9ed7-4852-8e32-4a80e8568e67 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:36.077127 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a3b107ae-9ed7-4852-8e32-4a80e8568e67 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:36.077551 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a3b107ae-9ed7-4852-8e32-4a80e8568e67 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:36.324237 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-a3b107ae-9ed7-4852-8e32-4a80e8568e67 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:26:36.338097 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-a3b107ae-9ed7-4852-8e32-4a80e8568e67 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/95a7693f-d1df-43fb-81e7-1c83b069e269" status: 200 len: 1521 microversion: 2.1 time: 0.281620 Sep 27 17:26:36.340173 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 151/321] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:26:36 2022] GET /compute/v2.1/servers/95a7693f-d1df-43fb-81e7-1c83b069e269 => generated 1521 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:26:36.359226 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-cc8adfc1-416d-448a-9959-c05c318e09b3 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Action: 'create', calling method: .version_select at 0x7fe724be50d0>, body: {"keypair": {"name": "tempest-keypair-1277881017", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK0cqlVTdVAJt7ILriDHDSQIJJtzYuxOHNjKVCV7APJjSfjuf71XutPfKBCp/no94JnaI4WQHEo13W/2fWgp1h+sNtTVnzf+/6T7NhQgvi7Ep4rXxebV6U1UNUYdITMyGA=="}} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:26:36.384224 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.quota [None req-cc8adfc1-416d-448a-9959-c05c318e09b3 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Getting quotas for project ef13103d3d8b43e1882d4820c8d9247b. Resources: {'key_pairs'} {{(pid=120416) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 17:26:36.390010 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.quota [None req-cc8adfc1-416d-448a-9959-c05c318e09b3 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Getting quotas for user 0b02c2ba9a0a48c294a11b42cbfe28e3 and project ef13103d3d8b43e1882d4820c8d9247b. Resources: {'key_pairs'} {{(pid=120416) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 17:26:36.438065 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-cc8adfc1-416d-448a-9959-c05c318e09b3 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.621382 Sep 27 17:26:36.446561 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 171/322] 10.222.0.55 () {60 vars in 1159 bytes} [Tue Sep 27 17:26:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:26:37.365046 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-ca0c3a83-2b8a-428f-92d3-1db7ca1d50a1 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:26:37.365665 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-ca0c3a83-2b8a-428f-92d3-1db7ca1d50a1 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: 95a7693f-d1df-43fb-81e7-1c83b069e269] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:26:37.380206 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ca0c3a83-2b8a-428f-92d3-1db7ca1d50a1 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:37.382888 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ca0c3a83-2b8a-428f-92d3-1db7ca1d50a1 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:37.383770 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ca0c3a83-2b8a-428f-92d3-1db7ca1d50a1 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:37.384518 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ca0c3a83-2b8a-428f-92d3-1db7ca1d50a1 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:37.398870 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ca0c3a83-2b8a-428f-92d3-1db7ca1d50a1 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:37.399528 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ca0c3a83-2b8a-428f-92d3-1db7ca1d50a1 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:37.818455 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-ca0c3a83-2b8a-428f-92d3-1db7ca1d50a1 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:26:37.832902 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-ca0c3a83-2b8a-428f-92d3-1db7ca1d50a1 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/95a7693f-d1df-43fb-81e7-1c83b069e269" status: 200 len: 1521 microversion: 2.1 time: 0.471670 Sep 27 17:26:37.833774 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 152/323] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:26:37 2022] GET /compute/v2.1/servers/95a7693f-d1df-43fb-81e7-1c83b069e269 => generated 1521 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:26:38.844083 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-3056baa4-d625-4233-908f-c0ec326349db tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1997983959", "imageRef": "9355bd92-0a49-42cd-b079-ff9f0d54b91b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "50dc8265-0d0d-49da-afd6-19daca5e673b"}], "security_groups": [{"name": "tempest-securitygroup--1733895017"}], "key_name": "tempest-keypair-1277881017", "user_data": "}} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:26:38.859021 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-ed97cc06-d85f-4f7d-8296-a10d5ee7eb21 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:26:38.859633 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-ed97cc06-d85f-4f7d-8296-a10d5ee7eb21 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: 95a7693f-d1df-43fb-81e7-1c83b069e269] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:26:38.894969 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ed97cc06-d85f-4f7d-8296-a10d5ee7eb21 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:38.895566 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ed97cc06-d85f-4f7d-8296-a10d5ee7eb21 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:38.898942 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ed97cc06-d85f-4f7d-8296-a10d5ee7eb21 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:38.902753 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ed97cc06-d85f-4f7d-8296-a10d5ee7eb21 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:38.903324 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ed97cc06-d85f-4f7d-8296-a10d5ee7eb21 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:38.904009 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ed97cc06-d85f-4f7d-8296-a10d5ee7eb21 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:39.165549 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.network.neutron [None req-3056baa4-d625-4233-908f-c0ec326349db tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] validate_networks() for [('50dc8265-0d0d-49da-afd6-19daca5e673b', None, None, None, None, None)] {{(pid=120416) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 17:26:39.423539 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-ed97cc06-d85f-4f7d-8296-a10d5ee7eb21 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:26:39.435620 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-ed97cc06-d85f-4f7d-8296-a10d5ee7eb21 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/95a7693f-d1df-43fb-81e7-1c83b069e269" status: 200 len: 1521 microversion: 2.1 time: 0.580615 Sep 27 17:26:39.436193 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 153/324] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:26:38 2022] GET /compute/v2.1/servers/95a7693f-d1df-43fb-81e7-1c83b069e269 => generated 1521 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:26:40.336133 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.virt.hardware [None req-3056baa4-d625-4233-908f-c0ec326349db tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Flavor limits 0:0:0 {{(pid=120416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 17:26:40.339433 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.virt.hardware [None req-3056baa4-d625-4233-908f-c0ec326349db tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Image limits 0:0:0 {{(pid=120416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 17:26:40.339593 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.virt.hardware [None req-3056baa4-d625-4233-908f-c0ec326349db tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Flavor pref 0:0:0 {{(pid=120416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 17:26:40.340717 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.virt.hardware [None req-3056baa4-d625-4233-908f-c0ec326349db tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Image pref 0:0:0 {{(pid=120416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 17:26:40.341741 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.virt.hardware [None req-3056baa4-d625-4233-908f-c0ec326349db tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 17:26:40.360208 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3056baa4-d625-4233-908f-c0ec326349db tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:40.360796 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3056baa4-d625-4233-908f-c0ec326349db tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:40.361281 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3056baa4-d625-4233-908f-c0ec326349db tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:40.363216 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3056baa4-d625-4233-908f-c0ec326349db tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:40.364006 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3056baa4-d625-4233-908f-c0ec326349db tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:40.369146 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3056baa4-d625-4233-908f-c0ec326349db tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:40.376290 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_cell1:SELECT=81 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:26:40.409732 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.quota [None req-3056baa4-d625-4233-908f-c0ec326349db tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Getting quotas for project ef13103d3d8b43e1882d4820c8d9247b. Resources: {'cores', 'ram', 'instances'} {{(pid=120416) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 17:26:40.414816 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.quota [None req-3056baa4-d625-4233-908f-c0ec326349db tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Getting quotas for user 0b02c2ba9a0a48c294a11b42cbfe28e3 and project ef13103d3d8b43e1882d4820c8d9247b. Resources: {'cores', 'ram', 'instances'} {{(pid=120416) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 17:26:40.432243 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-3056baa4-d625-4233-908f-c0ec326349db tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Going to run 1 instances... {{(pid=120416) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 17:26:40.435656 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-3056baa4-d625-4233-908f-c0ec326349db tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: fef20d9a-42bf-4605-bbcb-b673d215a5b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9355bd92-0a49-42cd-b079-ff9f0d54b91b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120416) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 17:26:40.463174 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-2d739848-ef2c-416c-a167-5eea4522278f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:26:40.463890 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-2d739848-ef2c-416c-a167-5eea4522278f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: 95a7693f-d1df-43fb-81e7-1c83b069e269] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:26:40.478876 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2d739848-ef2c-416c-a167-5eea4522278f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:40.479444 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2d739848-ef2c-416c-a167-5eea4522278f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:40.479890 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2d739848-ef2c-416c-a167-5eea4522278f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:40.492024 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2d739848-ef2c-416c-a167-5eea4522278f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:40.492696 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2d739848-ef2c-416c-a167-5eea4522278f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:40.493155 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2d739848-ef2c-416c-a167-5eea4522278f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:40.554766 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-3056baa4-d625-4233-908f-c0ec326349db tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.715449 Sep 27 17:26:40.556167 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 172/325] 10.222.0.55 () {60 vars in 1147 bytes} [Tue Sep 27 17:26:38 2022] POST /compute/v2.1/servers => generated 402 bytes in 1718 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 17:26:40.571707 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-36bd708d-72d4-47bb-99c5-3466e2feb2c7 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:26:40.574241 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-36bd708d-72d4-47bb-99c5-3466e2feb2c7 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: fef20d9a-42bf-4605-bbcb-b673d215a5b9] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:26:40.957150 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-36bd708d-72d4-47bb-99c5-3466e2feb2c7 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b02c2ba9a0a48c294a11b42cbfe28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef13103d3d8b43e1882d4820c8d9247b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:26:40.972712 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-36bd708d-72d4-47bb-99c5-3466e2feb2c7 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9" status: 200 len: 1242 microversion: 2.1 time: 0.401124 Sep 27 17:26:40.982662 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 173/326] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:26:40 2022] GET /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9 => generated 1242 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:26:41.234781 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-2d739848-ef2c-416c-a167-5eea4522278f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:26:41.259902 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-2d739848-ef2c-416c-a167-5eea4522278f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/95a7693f-d1df-43fb-81e7-1c83b069e269" status: 200 len: 1521 microversion: 2.1 time: 0.801275 Sep 27 17:26:41.260863 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 154/327] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:26:40 2022] GET /compute/v2.1/servers/95a7693f-d1df-43fb-81e7-1c83b069e269 => generated 1521 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:26:42.012079 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-c610cc2f-d093-4068-9ef4-d3fd3f787087 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:26:42.013383 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-c610cc2f-d093-4068-9ef4-d3fd3f787087 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: fef20d9a-42bf-4605-bbcb-b673d215a5b9] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:26:42.020739 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c610cc2f-d093-4068-9ef4-d3fd3f787087 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:42.022191 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c610cc2f-d093-4068-9ef4-d3fd3f787087 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:42.022786 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c610cc2f-d093-4068-9ef4-d3fd3f787087 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:42.023669 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c610cc2f-d093-4068-9ef4-d3fd3f787087 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:42.024277 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c610cc2f-d093-4068-9ef4-d3fd3f787087 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:42.024857 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c610cc2f-d093-4068-9ef4-d3fd3f787087 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:42.189029 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-c610cc2f-d093-4068-9ef4-d3fd3f787087 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b02c2ba9a0a48c294a11b42cbfe28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef13103d3d8b43e1882d4820c8d9247b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:26:42.199241 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-c610cc2f-d093-4068-9ef4-d3fd3f787087 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9" status: 200 len: 1238 microversion: 2.1 time: 0.194840 Sep 27 17:26:42.210943 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 174/328] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:26:42 2022] GET /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9 => generated 1238 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:26:42.295227 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-3ef5c5b2-1d2d-49b7-b69f-fb6b51ff266d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:26:42.295864 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-3ef5c5b2-1d2d-49b7-b69f-fb6b51ff266d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: 95a7693f-d1df-43fb-81e7-1c83b069e269] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:26:42.325787 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3ef5c5b2-1d2d-49b7-b69f-fb6b51ff266d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:42.331874 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3ef5c5b2-1d2d-49b7-b69f-fb6b51ff266d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:42.332841 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3ef5c5b2-1d2d-49b7-b69f-fb6b51ff266d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:42.335052 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3ef5c5b2-1d2d-49b7-b69f-fb6b51ff266d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:42.346565 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3ef5c5b2-1d2d-49b7-b69f-fb6b51ff266d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:42.349552 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3ef5c5b2-1d2d-49b7-b69f-fb6b51ff266d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:42.745435 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-3ef5c5b2-1d2d-49b7-b69f-fb6b51ff266d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:26:42.765393 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-3ef5c5b2-1d2d-49b7-b69f-fb6b51ff266d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/95a7693f-d1df-43fb-81e7-1c83b069e269" status: 200 len: 1501 microversion: 2.1 time: 0.474412 Sep 27 17:26:42.782117 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 155/329] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:26:42 2022] GET /compute/v2.1/servers/95a7693f-d1df-43fb-81e7-1c83b069e269 => generated 1501 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:26:42.795605 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-7fbecdc4-1338-4018-a9bb-7959552b90f1 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5522980d-c381-4b85-a872-16e2e277c714"}} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:26:42.798492 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-7fbecdc4-1338-4018-a9bb-7959552b90f1 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: 95a7693f-d1df-43fb-81e7-1c83b069e269] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:26:42.817381 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7fbecdc4-1338-4018-a9bb-7959552b90f1 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:42.821668 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7fbecdc4-1338-4018-a9bb-7959552b90f1 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:42.823754 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7fbecdc4-1338-4018-a9bb-7959552b90f1 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:42.826492 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7fbecdc4-1338-4018-a9bb-7959552b90f1 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:42.829735 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7fbecdc4-1338-4018-a9bb-7959552b90f1 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:42.830646 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7fbecdc4-1338-4018-a9bb-7959552b90f1 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:42.945162 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.wsgi [None req-7fbecdc4-1338-4018-a9bb-7959552b90f1 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] HTTP exception thrown: Cannot 'attach_volume' instance 95a7693f-d1df-43fb-81e7-1c83b069e269 while it is in vm_state rescued Sep 27 17:26:42.949552 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-7fbecdc4-1338-4018-a9bb-7959552b90f1 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Request method failure captured: Sep 27 17:26:42.949552 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: request: POST /compute/v2.1/servers/95a7693f-d1df-43fb-81e7-1c83b069e269/os-volume_attachments HTTP/1.1 Sep 27 17:26:42.949552 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Accept: application/json Sep 27 17:26:42.949552 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Accept-Encoding: identity Sep 27 17:26:42.949552 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Connection: close Sep 27 17:26:42.949552 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Content-Length: 74 Sep 27 17:26:42.949552 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Content-Type: application/json Sep 27 17:26:42.949552 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Host: 10.222.0.55 Sep 27 17:26:42.949552 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Openstack-System-Scope: None Sep 27 17:26:42.949552 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: User-Agent: python-urllib3/1.26.12 Sep 27 17:26:42.949552 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Auth-Token: gAAAAABjMzG_oYsxxnSJCNk_tQmKplbiP8h3imjUWos1S01buLQp6CXEw5BhuA_PsGqwDIqMw-PI9rCZuq5MdQs4oib-fTI5tt7xrSk-xzMiyY02qpRv4aq4oNkQg1Pn7OKJFQCc5SdwkX3vwqfdurESDHgoSkrIRuwNUUO4Aup43BAcJ7MoD5U Sep 27 17:26:42.949552 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Domain-Id: None Sep 27 17:26:42.949552 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Domain-Name: None Sep 27 17:26:42.949552 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Identity-Status: Confirmed Sep 27 17:26:42.949552 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Is-Admin-Project: True Sep 27 17:26:42.949552 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Domain-Id: default Sep 27 17:26:42.949552 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Domain-Name: Default Sep 27 17:26:42.949552 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Id: fd5caa5782e74721a4c2991524182668 Sep 27 17:26:42.949552 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1705185754 Sep 27 17:26:42.949552 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Role: reader,member Sep 27 17:26:42.949552 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Roles: reader,member Sep 27 17:26:42.950961 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/fd5caa5782e74721a4c2991524182668"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_fd5caa5782e74721a4c2991524182668", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/fd5caa5782e74721a4c2991524182668"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/fd5caa5782e74721a4c2991524182668"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 27 17:26:42.950961 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1705185754 Sep 27 17:26:42.950961 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Tenant-Id: fd5caa5782e74721a4c2991524182668 Sep 27 17:26:42.950961 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1705185754 Sep 27 17:26:42.950961 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User: tempest-ServerRescueNegativeTestJSON-1705185754-project Sep 27 17:26:42.950961 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Domain-Id: default Sep 27 17:26:42.950961 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Domain-Name: Default Sep 27 17:26:42.950961 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Id: d23a498bde00483c8fdd68dcde975e5d Sep 27 17:26:42.950961 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1705185754-project Sep 27 17:26:42.950961 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Sep 27 17:26:42.950961 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: {"volumeAttachment": {"volumeId": "5522980d-c381-4b85-a872-16e2e277c714"}} Sep 27 17:26:42.950961 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: method: > Sep 27 17:26:42.951910 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: exception: Cannot 'attach_volume' instance 95a7693f-d1df-43fb-81e7-1c83b069e269 while it is in vm_state rescued Sep 27 17:26:42.951910 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: action_args: {'server_id': '95a7693f-d1df-43fb-81e7-1c83b069e269', 'body': {'volumeAttachment': {'volumeId': '5522980d-c381-4b85-a872-16e2e277c714'}}} Sep 27 17:26:42.951910 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 17:26:42.951910 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:26:42.951910 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 27 17:26:42.951910 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 27 17:26:42.951910 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 27 17:26:42.951910 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 27 17:26:42.951910 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 27 17:26:42.951910 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 27 17:26:42.951910 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 95a7693f-d1df-43fb-81e7-1c83b069e269 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 27 17:26:42.951910 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:26:42.951910 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:26:42.951910 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:26:42.951910 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:26:42.951910 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:26:42.951910 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:26:42.951910 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 17:26:42.951910 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 17:26:42.953442 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 17:26:42.953442 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 17:26:42.953442 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 17:26:42.953442 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 17:26:42.953442 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 17:26:42.953442 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 17:26:42.953442 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 17:26:42.953442 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 17:26:42.953442 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 27 17:26:42.953442 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 27 17:26:42.953442 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 27 17:26:42.953442 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 27 17:26:42.953442 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 95a7693f-d1df-43fb-81e7-1c83b069e269 while it is in vm_state rescued Sep 27 17:26:42.953442 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:26:42.953442 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:26:42.953442 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:26:42.953442 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:26:42.953442 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:26:42.953442 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:26:42.955175 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 17:26:42.955175 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 17:26:42.955175 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 95a7693f-d1df-43fb-81e7-1c83b069e269 while it is in vm_state rescued Sep 27 17:26:42.955175 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:26:42.958498 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-7fbecdc4-1338-4018-a9bb-7959552b90f1 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Returning 409 to user: Cannot 'attach_volume' instance 95a7693f-d1df-43fb-81e7-1c83b069e269 while it is in vm_state rescued {{(pid=120416) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 17:26:42.974661 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-7fbecdc4-1338-4018-a9bb-7959552b90f1 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "POST /compute/v2.1/servers/95a7693f-d1df-43fb-81e7-1c83b069e269/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.169942 Sep 27 17:26:42.978618 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 175/330] 10.222.0.55 () {60 vars in 1323 bytes} [Tue Sep 27 17:26:42 2022] POST /compute/v2.1/servers/95a7693f-d1df-43fb-81e7-1c83b069e269/os-volume_attachments => generated 152 bytes in 189 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 27 17:26:42.988849 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-6d0b83e4-7631-42b3-91e9-c95e9a4e2b68 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:26:42.989565 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-6d0b83e4-7631-42b3-91e9-c95e9a4e2b68 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: 95a7693f-d1df-43fb-81e7-1c83b069e269] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:26:43.019379 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6d0b83e4-7631-42b3-91e9-c95e9a4e2b68 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:43.019884 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6d0b83e4-7631-42b3-91e9-c95e9a4e2b68 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:43.025838 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6d0b83e4-7631-42b3-91e9-c95e9a4e2b68 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:43.030588 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6d0b83e4-7631-42b3-91e9-c95e9a4e2b68 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:43.031244 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6d0b83e4-7631-42b3-91e9-c95e9a4e2b68 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:43.033392 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6d0b83e4-7631-42b3-91e9-c95e9a4e2b68 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:43.236537 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-d91246dc-ff60-44b3-b744-763093ac9b4d tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:26:43.242951 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-d91246dc-ff60-44b3-b744-763093ac9b4d tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: fef20d9a-42bf-4605-bbcb-b673d215a5b9] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:26:43.279908 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d91246dc-ff60-44b3-b744-763093ac9b4d tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:43.280538 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d91246dc-ff60-44b3-b744-763093ac9b4d tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:43.280991 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d91246dc-ff60-44b3-b744-763093ac9b4d tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:43.281742 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d91246dc-ff60-44b3-b744-763093ac9b4d tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:43.282233 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d91246dc-ff60-44b3-b744-763093ac9b4d tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:43.282671 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d91246dc-ff60-44b3-b744-763093ac9b4d tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:43.364650 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-6d0b83e4-7631-42b3-91e9-c95e9a4e2b68 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "POST /compute/v2.1/servers/95a7693f-d1df-43fb-81e7-1c83b069e269/action" status: 202 len: 0 microversion: 2.1 time: 0.382701 Sep 27 17:26:43.373393 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 156/331] 10.222.0.55 () {60 vars in 1278 bytes} [Tue Sep 27 17:26:42 2022] POST /compute/v2.1/servers/95a7693f-d1df-43fb-81e7-1c83b069e269/action => generated 0 bytes in 393 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 17:26:43.383756 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-666cf27f-49d7-4598-9ed6-e016e5a46f2d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:26:43.401857 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-666cf27f-49d7-4598-9ed6-e016e5a46f2d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: 95a7693f-d1df-43fb-81e7-1c83b069e269] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:26:43.437586 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-666cf27f-49d7-4598-9ed6-e016e5a46f2d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:43.438998 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-666cf27f-49d7-4598-9ed6-e016e5a46f2d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:43.440932 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-666cf27f-49d7-4598-9ed6-e016e5a46f2d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:43.441704 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-666cf27f-49d7-4598-9ed6-e016e5a46f2d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:43.442777 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-666cf27f-49d7-4598-9ed6-e016e5a46f2d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:43.443219 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-666cf27f-49d7-4598-9ed6-e016e5a46f2d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:43.477874 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:26:43.482652 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-d91246dc-ff60-44b3-b744-763093ac9b4d tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b02c2ba9a0a48c294a11b42cbfe28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef13103d3d8b43e1882d4820c8d9247b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:26:43.498599 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-d91246dc-ff60-44b3-b744-763093ac9b4d tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9" status: 200 len: 1312 microversion: 2.1 time: 0.266133 Sep 27 17:26:43.499609 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 176/332] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:26:43 2022] GET /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9 => generated 1312 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:26:44.203459 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-666cf27f-49d7-4598-9ed6-e016e5a46f2d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:26:44.213097 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-666cf27f-49d7-4598-9ed6-e016e5a46f2d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/95a7693f-d1df-43fb-81e7-1c83b069e269" status: 200 len: 1509 microversion: 2.1 time: 0.834916 Sep 27 17:26:44.216446 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 157/333] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:26:43 2022] GET /compute/v2.1/servers/95a7693f-d1df-43fb-81e7-1c83b069e269 => generated 1509 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:26:44.525136 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-57b9bebf-ecdf-428d-b3af-ce49607ec18a tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:26:44.527069 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-57b9bebf-ecdf-428d-b3af-ce49607ec18a tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: fef20d9a-42bf-4605-bbcb-b673d215a5b9] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:26:44.530533 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=4 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:26:44.541539 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-57b9bebf-ecdf-428d-b3af-ce49607ec18a tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:44.543063 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-57b9bebf-ecdf-428d-b3af-ce49607ec18a tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:44.543525 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-57b9bebf-ecdf-428d-b3af-ce49607ec18a tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:44.544248 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-57b9bebf-ecdf-428d-b3af-ce49607ec18a tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:44.548025 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-57b9bebf-ecdf-428d-b3af-ce49607ec18a tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:44.548534 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-57b9bebf-ecdf-428d-b3af-ce49607ec18a tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:44.794611 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-57b9bebf-ecdf-428d-b3af-ce49607ec18a tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b02c2ba9a0a48c294a11b42cbfe28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef13103d3d8b43e1882d4820c8d9247b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:26:44.811092 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-57b9bebf-ecdf-428d-b3af-ce49607ec18a tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9" status: 200 len: 1300 microversion: 2.1 time: 0.291636 Sep 27 17:26:44.826226 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 177/334] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:26:44 2022] GET /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9 => generated 1300 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:26:45.243024 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-710ec594-87a2-4020-a7c8-8d33670f89b1 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:26:45.243630 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-710ec594-87a2-4020-a7c8-8d33670f89b1 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: 95a7693f-d1df-43fb-81e7-1c83b069e269] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:26:45.256699 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-710ec594-87a2-4020-a7c8-8d33670f89b1 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:45.258636 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-710ec594-87a2-4020-a7c8-8d33670f89b1 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:45.261126 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-710ec594-87a2-4020-a7c8-8d33670f89b1 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:45.261861 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-710ec594-87a2-4020-a7c8-8d33670f89b1 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:45.262346 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-710ec594-87a2-4020-a7c8-8d33670f89b1 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:45.262766 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-710ec594-87a2-4020-a7c8-8d33670f89b1 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:45.763105 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-710ec594-87a2-4020-a7c8-8d33670f89b1 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:26:45.778001 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-710ec594-87a2-4020-a7c8-8d33670f89b1 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/95a7693f-d1df-43fb-81e7-1c83b069e269" status: 200 len: 1509 microversion: 2.1 time: 0.534703 Sep 27 17:26:45.782781 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 158/335] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:26:45 2022] GET /compute/v2.1/servers/95a7693f-d1df-43fb-81e7-1c83b069e269 => generated 1509 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:26:45.841264 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-51fd44a7-357d-4a28-a76d-1d3711883819 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:26:45.841957 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-51fd44a7-357d-4a28-a76d-1d3711883819 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: fef20d9a-42bf-4605-bbcb-b673d215a5b9] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:26:45.849265 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-51fd44a7-357d-4a28-a76d-1d3711883819 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:45.853515 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-51fd44a7-357d-4a28-a76d-1d3711883819 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:45.854671 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-51fd44a7-357d-4a28-a76d-1d3711883819 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:45.857588 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-51fd44a7-357d-4a28-a76d-1d3711883819 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:45.857970 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-51fd44a7-357d-4a28-a76d-1d3711883819 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:45.859369 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-51fd44a7-357d-4a28-a76d-1d3711883819 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:46.303849 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-51fd44a7-357d-4a28-a76d-1d3711883819 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b02c2ba9a0a48c294a11b42cbfe28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef13103d3d8b43e1882d4820c8d9247b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:26:46.337464 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-51fd44a7-357d-4a28-a76d-1d3711883819 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9" status: 200 len: 1368 microversion: 2.1 time: 0.500785 Sep 27 17:26:46.338210 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 178/336] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:26:45 2022] GET /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9 => generated 1368 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:26:46.820020 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-ec1691dc-9135-4589-ae4a-834f372faeb6 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:26:46.820625 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-ec1691dc-9135-4589-ae4a-834f372faeb6 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: 95a7693f-d1df-43fb-81e7-1c83b069e269] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:26:46.827383 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_api:SELECT=38 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:26:46.829755 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ec1691dc-9135-4589-ae4a-834f372faeb6 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:46.830638 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ec1691dc-9135-4589-ae4a-834f372faeb6 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:46.831390 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ec1691dc-9135-4589-ae4a-834f372faeb6 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:46.832295 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ec1691dc-9135-4589-ae4a-834f372faeb6 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:46.832940 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ec1691dc-9135-4589-ae4a-834f372faeb6 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:46.833581 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ec1691dc-9135-4589-ae4a-834f372faeb6 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:47.122101 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-ec1691dc-9135-4589-ae4a-834f372faeb6 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:26:47.130667 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-ec1691dc-9135-4589-ae4a-834f372faeb6 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/95a7693f-d1df-43fb-81e7-1c83b069e269" status: 200 len: 1509 microversion: 2.1 time: 0.314427 Sep 27 17:26:47.136051 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 159/337] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:26:46 2022] GET /compute/v2.1/servers/95a7693f-d1df-43fb-81e7-1c83b069e269 => generated 1509 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:26:47.364075 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-2d7d3595-0c69-4d09-ac94-a03d837d547e tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:26:47.365417 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-2d7d3595-0c69-4d09-ac94-a03d837d547e tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: fef20d9a-42bf-4605-bbcb-b673d215a5b9] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:26:47.379013 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-2d7d3595-0c69-4d09-ac94-a03d837d547e tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:47.380557 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-2d7d3595-0c69-4d09-ac94-a03d837d547e tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:47.382731 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-2d7d3595-0c69-4d09-ac94-a03d837d547e tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:47.383623 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-2d7d3595-0c69-4d09-ac94-a03d837d547e tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:47.384254 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-2d7d3595-0c69-4d09-ac94-a03d837d547e tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:47.386990 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-2d7d3595-0c69-4d09-ac94-a03d837d547e tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:47.640151 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-2d7d3595-0c69-4d09-ac94-a03d837d547e tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b02c2ba9a0a48c294a11b42cbfe28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef13103d3d8b43e1882d4820c8d9247b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:26:47.648875 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-2d7d3595-0c69-4d09-ac94-a03d837d547e tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9" status: 200 len: 1368 microversion: 2.1 time: 0.288566 Sep 27 17:26:47.650263 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 179/338] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:26:47 2022] GET /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9 => generated 1368 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:26:48.157429 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-8b217cd6-79be-4c6a-b475-df012f600c82 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:26:48.158289 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-8b217cd6-79be-4c6a-b475-df012f600c82 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: 95a7693f-d1df-43fb-81e7-1c83b069e269] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:26:48.170354 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8b217cd6-79be-4c6a-b475-df012f600c82 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:48.186285 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8b217cd6-79be-4c6a-b475-df012f600c82 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:48.192077 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8b217cd6-79be-4c6a-b475-df012f600c82 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:48.193035 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8b217cd6-79be-4c6a-b475-df012f600c82 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:48.193685 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8b217cd6-79be-4c6a-b475-df012f600c82 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:48.194301 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8b217cd6-79be-4c6a-b475-df012f600c82 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:48.402234 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-8b217cd6-79be-4c6a-b475-df012f600c82 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:26:48.415500 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-8b217cd6-79be-4c6a-b475-df012f600c82 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/95a7693f-d1df-43fb-81e7-1c83b069e269" status: 200 len: 1509 microversion: 2.1 time: 0.262007 Sep 27 17:26:48.431796 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 160/339] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:26:48 2022] GET /compute/v2.1/servers/95a7693f-d1df-43fb-81e7-1c83b069e269 => generated 1509 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:26:48.678409 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-01ab9282-c809-4753-8550-bd36ad7f686f tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:26:48.679345 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-01ab9282-c809-4753-8550-bd36ad7f686f tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: fef20d9a-42bf-4605-bbcb-b673d215a5b9] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:26:48.686105 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-01ab9282-c809-4753-8550-bd36ad7f686f tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:48.686598 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-01ab9282-c809-4753-8550-bd36ad7f686f tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:48.687028 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-01ab9282-c809-4753-8550-bd36ad7f686f tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:48.687716 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-01ab9282-c809-4753-8550-bd36ad7f686f tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:48.688163 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-01ab9282-c809-4753-8550-bd36ad7f686f tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:48.688580 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-01ab9282-c809-4753-8550-bd36ad7f686f tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:49.084909 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-01ab9282-c809-4753-8550-bd36ad7f686f tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b02c2ba9a0a48c294a11b42cbfe28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef13103d3d8b43e1882d4820c8d9247b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:26:49.094990 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-01ab9282-c809-4753-8550-bd36ad7f686f tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9" status: 200 len: 1368 microversion: 2.1 time: 0.424337 Sep 27 17:26:49.096205 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 180/340] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:26:48 2022] GET /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9 => generated 1368 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:26:49.439328 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-b68cb1af-7109-4391-a87e-4380ed2c7fa4 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:26:49.440570 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-b68cb1af-7109-4391-a87e-4380ed2c7fa4 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: 95a7693f-d1df-43fb-81e7-1c83b069e269] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:26:49.451250 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b68cb1af-7109-4391-a87e-4380ed2c7fa4 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:49.452050 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b68cb1af-7109-4391-a87e-4380ed2c7fa4 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:49.452679 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b68cb1af-7109-4391-a87e-4380ed2c7fa4 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:49.453608 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b68cb1af-7109-4391-a87e-4380ed2c7fa4 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:49.454297 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b68cb1af-7109-4391-a87e-4380ed2c7fa4 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:49.456630 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b68cb1af-7109-4391-a87e-4380ed2c7fa4 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:49.646969 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-b68cb1af-7109-4391-a87e-4380ed2c7fa4 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:26:49.655316 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-b68cb1af-7109-4391-a87e-4380ed2c7fa4 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/95a7693f-d1df-43fb-81e7-1c83b069e269" status: 200 len: 1509 microversion: 2.1 time: 0.219920 Sep 27 17:26:49.655876 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 161/341] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:26:49 2022] GET /compute/v2.1/servers/95a7693f-d1df-43fb-81e7-1c83b069e269 => generated 1509 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:26:50.124072 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-73f7864c-62f2-41b7-b2b7-4c63266fb3bf tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:26:50.124685 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-73f7864c-62f2-41b7-b2b7-4c63266fb3bf tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: fef20d9a-42bf-4605-bbcb-b673d215a5b9] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:26:50.132594 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-73f7864c-62f2-41b7-b2b7-4c63266fb3bf tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:50.133365 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-73f7864c-62f2-41b7-b2b7-4c63266fb3bf tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:50.133938 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-73f7864c-62f2-41b7-b2b7-4c63266fb3bf tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:50.134870 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-73f7864c-62f2-41b7-b2b7-4c63266fb3bf tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:50.135545 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-73f7864c-62f2-41b7-b2b7-4c63266fb3bf tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:50.136113 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-73f7864c-62f2-41b7-b2b7-4c63266fb3bf tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:50.365790 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-73f7864c-62f2-41b7-b2b7-4c63266fb3bf tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b02c2ba9a0a48c294a11b42cbfe28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef13103d3d8b43e1882d4820c8d9247b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:26:50.389376 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_cell0:SELECT=2 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:26:50.395912 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-73f7864c-62f2-41b7-b2b7-4c63266fb3bf tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9" status: 200 len: 1368 microversion: 2.1 time: 0.281008 Sep 27 17:26:50.396479 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 181/342] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:26:50 2022] GET /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9 => generated 1368 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:26:50.681017 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-cecc5568-605d-424b-acb9-f584147b4a4d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:26:50.681600 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-cecc5568-605d-424b-acb9-f584147b4a4d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: 95a7693f-d1df-43fb-81e7-1c83b069e269] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:26:50.692420 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cecc5568-605d-424b-acb9-f584147b4a4d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:50.692874 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cecc5568-605d-424b-acb9-f584147b4a4d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:50.699242 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cecc5568-605d-424b-acb9-f584147b4a4d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:50.700050 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cecc5568-605d-424b-acb9-f584147b4a4d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:50.700617 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cecc5568-605d-424b-acb9-f584147b4a4d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:50.701189 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cecc5568-605d-424b-acb9-f584147b4a4d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:50.866835 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-cecc5568-605d-424b-acb9-f584147b4a4d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:26:50.876833 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-cecc5568-605d-424b-acb9-f584147b4a4d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/95a7693f-d1df-43fb-81e7-1c83b069e269" status: 200 len: 1509 microversion: 2.1 time: 0.199742 Sep 27 17:26:50.877968 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 162/343] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:26:50 2022] GET /compute/v2.1/servers/95a7693f-d1df-43fb-81e7-1c83b069e269 => generated 1509 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:26:51.421302 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-158efb3f-9037-4b99-919f-cd861e76bef6 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:26:51.421916 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-158efb3f-9037-4b99-919f-cd861e76bef6 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: fef20d9a-42bf-4605-bbcb-b673d215a5b9] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:26:51.429043 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_cell0:SELECT=12 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:26:51.434553 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-158efb3f-9037-4b99-919f-cd861e76bef6 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:51.443173 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-158efb3f-9037-4b99-919f-cd861e76bef6 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:51.443991 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-158efb3f-9037-4b99-919f-cd861e76bef6 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:51.444948 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-158efb3f-9037-4b99-919f-cd861e76bef6 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:51.445660 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-158efb3f-9037-4b99-919f-cd861e76bef6 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:51.446606 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-158efb3f-9037-4b99-919f-cd861e76bef6 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:51.649086 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-158efb3f-9037-4b99-919f-cd861e76bef6 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b02c2ba9a0a48c294a11b42cbfe28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef13103d3d8b43e1882d4820c8d9247b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:26:51.659498 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-158efb3f-9037-4b99-919f-cd861e76bef6 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9" status: 200 len: 1368 microversion: 2.1 time: 0.244284 Sep 27 17:26:51.660214 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 182/344] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:26:51 2022] GET /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9 => generated 1368 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:26:51.907469 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-49378cb8-ea9c-45b3-9bf0-685fe441bb5b tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:26:51.908073 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-49378cb8-ea9c-45b3-9bf0-685fe441bb5b tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: 95a7693f-d1df-43fb-81e7-1c83b069e269] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:26:51.915755 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-49378cb8-ea9c-45b3-9bf0-685fe441bb5b tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:51.917386 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-49378cb8-ea9c-45b3-9bf0-685fe441bb5b tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:51.918001 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-49378cb8-ea9c-45b3-9bf0-685fe441bb5b tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:51.918894 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-49378cb8-ea9c-45b3-9bf0-685fe441bb5b tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:51.919349 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-49378cb8-ea9c-45b3-9bf0-685fe441bb5b tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:51.919770 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-49378cb8-ea9c-45b3-9bf0-685fe441bb5b tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:52.085535 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-49378cb8-ea9c-45b3-9bf0-685fe441bb5b tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:26:52.094140 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-49378cb8-ea9c-45b3-9bf0-685fe441bb5b tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/95a7693f-d1df-43fb-81e7-1c83b069e269" status: 200 len: 1509 microversion: 2.1 time: 0.190416 Sep 27 17:26:52.094794 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 163/345] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:26:51 2022] GET /compute/v2.1/servers/95a7693f-d1df-43fb-81e7-1c83b069e269 => generated 1509 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:26:52.685339 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-44fec0c5-1caf-4805-b00d-75d38b834191 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:26:52.687892 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-44fec0c5-1caf-4805-b00d-75d38b834191 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: fef20d9a-42bf-4605-bbcb-b673d215a5b9] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:26:52.699856 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-44fec0c5-1caf-4805-b00d-75d38b834191 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:52.701541 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-44fec0c5-1caf-4805-b00d-75d38b834191 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:52.702851 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-44fec0c5-1caf-4805-b00d-75d38b834191 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:52.704238 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-44fec0c5-1caf-4805-b00d-75d38b834191 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:52.706047 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-44fec0c5-1caf-4805-b00d-75d38b834191 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:52.708271 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-44fec0c5-1caf-4805-b00d-75d38b834191 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:52.965813 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-44fec0c5-1caf-4805-b00d-75d38b834191 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b02c2ba9a0a48c294a11b42cbfe28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef13103d3d8b43e1882d4820c8d9247b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:26:52.977288 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-44fec0c5-1caf-4805-b00d-75d38b834191 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9" status: 200 len: 1368 microversion: 2.1 time: 0.296933 Sep 27 17:26:52.995093 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 183/346] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:26:52 2022] GET /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9 => generated 1368 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:26:53.121047 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-5e3552db-476f-47eb-b121-7353d1c8cc39 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:26:53.122685 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-5e3552db-476f-47eb-b121-7353d1c8cc39 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: 95a7693f-d1df-43fb-81e7-1c83b069e269] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:26:53.138693 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5e3552db-476f-47eb-b121-7353d1c8cc39 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:53.139325 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5e3552db-476f-47eb-b121-7353d1c8cc39 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:53.139765 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5e3552db-476f-47eb-b121-7353d1c8cc39 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:53.140469 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5e3552db-476f-47eb-b121-7353d1c8cc39 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:53.140916 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5e3552db-476f-47eb-b121-7353d1c8cc39 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:53.141330 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5e3552db-476f-47eb-b121-7353d1c8cc39 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:53.378202 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-5e3552db-476f-47eb-b121-7353d1c8cc39 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:26:53.388441 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-5e3552db-476f-47eb-b121-7353d1c8cc39 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/95a7693f-d1df-43fb-81e7-1c83b069e269" status: 200 len: 1509 microversion: 2.1 time: 0.274040 Sep 27 17:26:53.395612 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 164/347] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:26:53 2022] GET /compute/v2.1/servers/95a7693f-d1df-43fb-81e7-1c83b069e269 => generated 1509 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:26:53.488461 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [req-95958b5e-3e19-4c2e-b073-2ecb39e9ed46 req-d769e318-dc3c-4fab-ba1c-d775e08419d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fef20d9a-42bf-4605-bbcb-b673d215a5b9", "tag": "154c5998-5a7a-4e89-abf9-12d9614c0120"}]} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:26:53.525631 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-95958b5e-3e19-4c2e-b073-2ecb39e9ed46 req-d769e318-dc3c-4fab-ba1c-d775e08419d8 service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:53.527049 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-95958b5e-3e19-4c2e-b073-2ecb39e9ed46 req-d769e318-dc3c-4fab-ba1c-d775e08419d8 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:53.528239 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-95958b5e-3e19-4c2e-b073-2ecb39e9ed46 req-d769e318-dc3c-4fab-ba1c-d775e08419d8 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:53.565206 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.compute.server_external_events [req-95958b5e-3e19-4c2e-b073-2ecb39e9ed46 req-d769e318-dc3c-4fab-ba1c-d775e08419d8 service nova] Creating event network-changed:154c5998-5a7a-4e89-abf9-12d9614c0120 for instance fef20d9a-42bf-4605-bbcb-b673d215a5b9 on hv-cinder-84914 Sep 27 17:26:53.578700 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [req-95958b5e-3e19-4c2e-b073-2ecb39e9ed46 req-d769e318-dc3c-4fab-ba1c-d775e08419d8 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094368 Sep 27 17:26:53.579710 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 184/348] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:26:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:26:53.810158 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-f022c9b7-c065-44a8-83ab-7c474cdc4793 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "db1a6c4e-57c1-4b7e-97e1-b0860977d38f", "device": "/dev/sdb"}} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:26:53.813370 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-f022c9b7-c065-44a8-83ab-7c474cdc4793 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] [instance: 2e206773-221a-4857-b437-2b1a852b8277] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:26:53.819826 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f022c9b7-c065-44a8-83ab-7c474cdc4793 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:53.820414 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f022c9b7-c065-44a8-83ab-7c474cdc4793 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:53.820905 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f022c9b7-c065-44a8-83ab-7c474cdc4793 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:53.821680 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f022c9b7-c065-44a8-83ab-7c474cdc4793 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:53.822949 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f022c9b7-c065-44a8-83ab-7c474cdc4793 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:53.823440 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f022c9b7-c065-44a8-83ab-7c474cdc4793 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:54.010230 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-7397775c-a52f-4e72-93f4-b620e86e1550 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:26:54.011568 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-7397775c-a52f-4e72-93f4-b620e86e1550 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: fef20d9a-42bf-4605-bbcb-b673d215a5b9] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:26:54.017808 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7397775c-a52f-4e72-93f4-b620e86e1550 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:54.018420 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7397775c-a52f-4e72-93f4-b620e86e1550 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:54.018845 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7397775c-a52f-4e72-93f4-b620e86e1550 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:54.019518 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7397775c-a52f-4e72-93f4-b620e86e1550 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:54.019963 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7397775c-a52f-4e72-93f4-b620e86e1550 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:54.020379 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7397775c-a52f-4e72-93f4-b620e86e1550 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:54.180460 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-7397775c-a52f-4e72-93f4-b620e86e1550 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b02c2ba9a0a48c294a11b42cbfe28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef13103d3d8b43e1882d4820c8d9247b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:26:54.191010 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-7397775c-a52f-4e72-93f4-b620e86e1550 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9" status: 200 len: 1368 microversion: 2.1 time: 0.185362 Sep 27 17:26:54.191885 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 185/349] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:26:54 2022] GET /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9 => generated 1368 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:26:54.412391 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-f84bec4f-af4a-499f-a186-50237dc90e88 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:26:54.413157 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-f84bec4f-af4a-499f-a186-50237dc90e88 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: 95a7693f-d1df-43fb-81e7-1c83b069e269] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:26:54.429622 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f84bec4f-af4a-499f-a186-50237dc90e88 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:54.430016 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f84bec4f-af4a-499f-a186-50237dc90e88 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:54.430478 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f84bec4f-af4a-499f-a186-50237dc90e88 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:54.431189 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f84bec4f-af4a-499f-a186-50237dc90e88 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:54.431649 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f84bec4f-af4a-499f-a186-50237dc90e88 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:54.432132 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f84bec4f-af4a-499f-a186-50237dc90e88 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:54.596136 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-f84bec4f-af4a-499f-a186-50237dc90e88 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:26:54.606380 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-f84bec4f-af4a-499f-a186-50237dc90e88 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/95a7693f-d1df-43fb-81e7-1c83b069e269" status: 200 len: 1515 microversion: 2.1 time: 0.195516 Sep 27 17:26:54.607563 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 186/350] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:26:54 2022] GET /compute/v2.1/servers/95a7693f-d1df-43fb-81e7-1c83b069e269 => generated 1515 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:26:55.214954 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-59e3c413-da11-4635-a7b0-946bd2c40ede tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:26:55.215968 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-59e3c413-da11-4635-a7b0-946bd2c40ede tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: fef20d9a-42bf-4605-bbcb-b673d215a5b9] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:26:55.222722 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-59e3c413-da11-4635-a7b0-946bd2c40ede tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:55.223518 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-59e3c413-da11-4635-a7b0-946bd2c40ede tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:55.224023 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-59e3c413-da11-4635-a7b0-946bd2c40ede tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:55.224791 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-59e3c413-da11-4635-a7b0-946bd2c40ede tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:55.225313 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-59e3c413-da11-4635-a7b0-946bd2c40ede tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:55.225821 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-59e3c413-da11-4635-a7b0-946bd2c40ede tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:55.372342 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-59e3c413-da11-4635-a7b0-946bd2c40ede tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b02c2ba9a0a48c294a11b42cbfe28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef13103d3d8b43e1882d4820c8d9247b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:26:55.384947 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-59e3c413-da11-4635-a7b0-946bd2c40ede tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9" status: 200 len: 1368 microversion: 2.1 time: 0.174645 Sep 27 17:26:55.386208 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 187/351] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:26:55 2022] GET /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9 => generated 1368 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:26:56.408927 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-8f366558-5877-467d-8f42-9b218fd7c9e2 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:26:56.410305 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-8f366558-5877-467d-8f42-9b218fd7c9e2 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: fef20d9a-42bf-4605-bbcb-b673d215a5b9] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:26:56.416503 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8f366558-5877-467d-8f42-9b218fd7c9e2 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:56.417194 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8f366558-5877-467d-8f42-9b218fd7c9e2 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:56.417629 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8f366558-5877-467d-8f42-9b218fd7c9e2 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:56.418520 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8f366558-5877-467d-8f42-9b218fd7c9e2 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:56.419141 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8f366558-5877-467d-8f42-9b218fd7c9e2 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:56.419622 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8f366558-5877-467d-8f42-9b218fd7c9e2 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:56.568417 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-8f366558-5877-467d-8f42-9b218fd7c9e2 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b02c2ba9a0a48c294a11b42cbfe28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef13103d3d8b43e1882d4820c8d9247b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:26:56.577481 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-8f366558-5877-467d-8f42-9b218fd7c9e2 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9" status: 200 len: 1368 microversion: 2.1 time: 0.172421 Sep 27 17:26:56.582302 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 188/352] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:26:56 2022] GET /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9 => generated 1368 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:26:57.390237 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-40056260-50db-4147-90ae-7d962270a8ad tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Action: 'create', calling method: .version_select at 0x7fe724b91430>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-270604046", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL6EOO0a0ryEoVKBvAKvxHavysm4FVLiDjpsGdai0/abG+y4Y0hKsFKJXkY5cAELrte2NzTLL9cs0GeeEzyFOz7LWK13PjeVu+Rr4YmFsfH7HCwPnPRqADHql0EYYvXkcA=="}} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:26:57.404921 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.quota [None req-40056260-50db-4147-90ae-7d962270a8ad tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Getting quotas for project 9bf4e20a59f147afb4f036fc8d04adb2. Resources: {'key_pairs'} {{(pid=120416) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 17:26:57.408572 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.quota [None req-40056260-50db-4147-90ae-7d962270a8ad tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Getting quotas for user c3acafe7ed414c87a5ca235b96047aca and project 9bf4e20a59f147afb4f036fc8d04adb2. Resources: {'key_pairs'} {{(pid=120416) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 17:26:57.430410 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-40056260-50db-4147-90ae-7d962270a8ad tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.044083 Sep 27 17:26:57.431035 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 189/353] 10.222.0.55 () {60 vars in 1159 bytes} [Tue Sep 27 17:26:57 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 17:26:57.481205 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-019e6702-e8c7-4677-bd69-c59d5408d371 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-989267137", "imageRef": "6c3950e7-535d-4a8f-8d38-bae3d375a64a", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-270604046", "networks": [{"uuid": "f6df37ce-4072-424a-afc9-d720386b4649"}]}} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:26:57.531892 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.network.neutron [None req-019e6702-e8c7-4677-bd69-c59d5408d371 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] validate_networks() for [('f6df37ce-4072-424a-afc9-d720386b4649', None, None, None, None, None)] {{(pid=120416) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 17:26:57.812265 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-f022c9b7-c065-44a8-83ab-7c474cdc4793 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] 10.222.0.55 "POST /compute/v2.1/servers/2e206773-221a-4857-b437-2b1a852b8277/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.006645 Sep 27 17:26:57.813614 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 165/354] 10.222.0.55 () {60 vars in 1323 bytes} [Tue Sep 27 17:26:53 2022] POST /compute/v2.1/servers/2e206773-221a-4857-b437-2b1a852b8277/os-volume_attachments => generated 194 bytes in 4009 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:26:57.830291 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-ed73bf8e-a8c6-43c2-8c3a-e935571d63c6 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:26:57.831827 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-ed73bf8e-a8c6-43c2-8c3a-e935571d63c6 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: fef20d9a-42bf-4605-bbcb-b673d215a5b9] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:26:57.842791 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ed73bf8e-a8c6-43c2-8c3a-e935571d63c6 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:57.843264 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ed73bf8e-a8c6-43c2-8c3a-e935571d63c6 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:57.843686 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ed73bf8e-a8c6-43c2-8c3a-e935571d63c6 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:57.844370 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ed73bf8e-a8c6-43c2-8c3a-e935571d63c6 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:57.844812 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ed73bf8e-a8c6-43c2-8c3a-e935571d63c6 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:57.845221 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ed73bf8e-a8c6-43c2-8c3a-e935571d63c6 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:58.051262 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-ed73bf8e-a8c6-43c2-8c3a-e935571d63c6 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b02c2ba9a0a48c294a11b42cbfe28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef13103d3d8b43e1882d4820c8d9247b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:26:58.059083 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-ed73bf8e-a8c6-43c2-8c3a-e935571d63c6 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9" status: 200 len: 1368 microversion: 2.1 time: 0.244182 Sep 27 17:26:58.059657 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 166/355] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:26:57 2022] GET /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9 => generated 1368 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:26:58.074956 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.virt.hardware [None req-019e6702-e8c7-4677-bd69-c59d5408d371 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Flavor limits 0:0:0 {{(pid=120416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 17:26:58.075469 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.virt.hardware [None req-019e6702-e8c7-4677-bd69-c59d5408d371 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Image limits 0:0:0 {{(pid=120416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 17:26:58.075943 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.virt.hardware [None req-019e6702-e8c7-4677-bd69-c59d5408d371 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Flavor pref 0:0:0 {{(pid=120416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 17:26:58.076346 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.virt.hardware [None req-019e6702-e8c7-4677-bd69-c59d5408d371 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Image pref 0:0:0 {{(pid=120416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 17:26:58.076782 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.virt.hardware [None req-019e6702-e8c7-4677-bd69-c59d5408d371 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 17:26:58.085810 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-019e6702-e8c7-4677-bd69-c59d5408d371 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:58.086325 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-019e6702-e8c7-4677-bd69-c59d5408d371 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:58.086754 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-019e6702-e8c7-4677-bd69-c59d5408d371 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:58.087629 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-019e6702-e8c7-4677-bd69-c59d5408d371 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:58.088802 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-019e6702-e8c7-4677-bd69-c59d5408d371 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:58.089158 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-019e6702-e8c7-4677-bd69-c59d5408d371 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:58.108474 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.quota [None req-019e6702-e8c7-4677-bd69-c59d5408d371 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Getting quotas for project 9bf4e20a59f147afb4f036fc8d04adb2. Resources: {'cores', 'ram', 'instances'} {{(pid=120416) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 17:26:58.114065 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.quota [None req-019e6702-e8c7-4677-bd69-c59d5408d371 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Getting quotas for user c3acafe7ed414c87a5ca235b96047aca and project 9bf4e20a59f147afb4f036fc8d04adb2. Resources: {'cores', 'ram', 'instances'} {{(pid=120416) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 17:26:58.130428 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-019e6702-e8c7-4677-bd69-c59d5408d371 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Going to run 1 instances... {{(pid=120416) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 17:26:58.133789 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-019e6702-e8c7-4677-bd69-c59d5408d371 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6c3950e7-535d-4a8f-8d38-bae3d375a64a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120416) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 17:26:58.184725 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-019e6702-e8c7-4677-bd69-c59d5408d371 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.708037 Sep 27 17:26:58.185517 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 190/356] 10.222.0.55 () {60 vars in 1147 bytes} [Tue Sep 27 17:26:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 709 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 27 17:26:58.196345 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-18765e29-6975-4d5f-9a3e-683bdaf5d120 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:26:58.196953 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-18765e29-6975-4d5f-9a3e-683bdaf5d120 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:26:58.259507 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-18765e29-6975-4d5f-9a3e-683bdaf5d120 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acafe7ed414c87a5ca235b96047aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf4e20a59f147afb4f036fc8d04adb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:26:58.267450 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-18765e29-6975-4d5f-9a3e-683bdaf5d120 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b" status: 200 len: 1257 microversion: 2.1 time: 0.074893 Sep 27 17:26:58.268323 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 167/357] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:26:58 2022] GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b => generated 1257 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:26:59.084887 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-6a94f09d-0d08-47d0-8494-c0cad967ae2b tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:26:59.085493 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-6a94f09d-0d08-47d0-8494-c0cad967ae2b tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: fef20d9a-42bf-4605-bbcb-b673d215a5b9] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:26:59.092216 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6a94f09d-0d08-47d0-8494-c0cad967ae2b tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:59.092698 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6a94f09d-0d08-47d0-8494-c0cad967ae2b tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:59.093161 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6a94f09d-0d08-47d0-8494-c0cad967ae2b tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:59.093851 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6a94f09d-0d08-47d0-8494-c0cad967ae2b tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:59.094329 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6a94f09d-0d08-47d0-8494-c0cad967ae2b tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:59.094772 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6a94f09d-0d08-47d0-8494-c0cad967ae2b tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:59.222153 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-6a94f09d-0d08-47d0-8494-c0cad967ae2b tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b02c2ba9a0a48c294a11b42cbfe28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef13103d3d8b43e1882d4820c8d9247b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:26:59.231317 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-6a94f09d-0d08-47d0-8494-c0cad967ae2b tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9" status: 200 len: 1368 microversion: 2.1 time: 0.152014 Sep 27 17:26:59.231870 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 191/358] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:26:59 2022] GET /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9 => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:26:59.290349 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-fdc1a4b6-8ee2-4f0c-aed5-6490ce19d4ee tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:26:59.291207 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-fdc1a4b6-8ee2-4f0c-aed5-6490ce19d4ee tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:26:59.298922 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fdc1a4b6-8ee2-4f0c-aed5-6490ce19d4ee tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:59.299404 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fdc1a4b6-8ee2-4f0c-aed5-6490ce19d4ee tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:59.299836 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fdc1a4b6-8ee2-4f0c-aed5-6490ce19d4ee tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:59.300521 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fdc1a4b6-8ee2-4f0c-aed5-6490ce19d4ee tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:26:59.300983 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fdc1a4b6-8ee2-4f0c-aed5-6490ce19d4ee tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:26:59.301398 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fdc1a4b6-8ee2-4f0c-aed5-6490ce19d4ee tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:26:59.364838 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-fdc1a4b6-8ee2-4f0c-aed5-6490ce19d4ee tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acafe7ed414c87a5ca235b96047aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf4e20a59f147afb4f036fc8d04adb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:26:59.373340 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-fdc1a4b6-8ee2-4f0c-aed5-6490ce19d4ee tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b" status: 200 len: 1261 microversion: 2.1 time: 0.086810 Sep 27 17:26:59.374336 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 168/359] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:26:59 2022] GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b => generated 1261 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:27:00.255443 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-1b3a34e3-e654-4607-be5c-253d440142fe tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:00.256613 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-1b3a34e3-e654-4607-be5c-253d440142fe tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: fef20d9a-42bf-4605-bbcb-b673d215a5b9] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:00.262615 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1b3a34e3-e654-4607-be5c-253d440142fe tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:00.263094 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1b3a34e3-e654-4607-be5c-253d440142fe tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:00.263570 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1b3a34e3-e654-4607-be5c-253d440142fe tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:00.264566 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1b3a34e3-e654-4607-be5c-253d440142fe tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:00.265222 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1b3a34e3-e654-4607-be5c-253d440142fe tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:00.265652 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1b3a34e3-e654-4607-be5c-253d440142fe tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:00.270401 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-a0247c36-053b-4589-9cb6-19387663bb27 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Action: 'create', calling method: .version_select at 0x7fe724c10a60>, body: {"keypair": {"name": "tempest-keypair-2116257343", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGkUBZEPkZOs1Gz/HPJVbBVLFuKiivtLtv1X5RtFbU5A2xLxWKglvVnnsR8zcaYedZzP3gVEWy55TbYiM5EdAq/yYbrGyyo07jgT86wf2x2ERm07HMvmHdFXbmVJYzgt6A=="}} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:27:00.289831 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.quota [None req-a0247c36-053b-4589-9cb6-19387663bb27 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Getting quotas for project fd5caa5782e74721a4c2991524182668. Resources: {'key_pairs'} {{(pid=120415) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 17:27:00.295286 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.quota [None req-a0247c36-053b-4589-9cb6-19387663bb27 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Getting quotas for user d23a498bde00483c8fdd68dcde975e5d and project fd5caa5782e74721a4c2991524182668. Resources: {'key_pairs'} {{(pid=120415) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 17:27:00.320987 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-a0247c36-053b-4589-9cb6-19387663bb27 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.054679 Sep 27 17:27:00.321114 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 169/360] 10.222.0.55 () {60 vars in 1159 bytes} [Tue Sep 27 17:27:00 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:27:00.397033 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-d1e58ff5-7f59-4138-982b-f3ecf6c4eac3 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:00.397892 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-d1e58ff5-7f59-4138-982b-f3ecf6c4eac3 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:00.406621 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d1e58ff5-7f59-4138-982b-f3ecf6c4eac3 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:00.407944 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d1e58ff5-7f59-4138-982b-f3ecf6c4eac3 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:00.408547 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d1e58ff5-7f59-4138-982b-f3ecf6c4eac3 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:00.409304 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d1e58ff5-7f59-4138-982b-f3ecf6c4eac3 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:00.409948 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d1e58ff5-7f59-4138-982b-f3ecf6c4eac3 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:00.410907 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d1e58ff5-7f59-4138-982b-f3ecf6c4eac3 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:00.422755 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-1b3a34e3-e654-4607-be5c-253d440142fe tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b02c2ba9a0a48c294a11b42cbfe28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef13103d3d8b43e1882d4820c8d9247b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:00.433494 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-1b3a34e3-e654-4607-be5c-253d440142fe tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9" status: 200 len: 1368 microversion: 2.1 time: 0.182155 Sep 27 17:27:00.434902 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 192/361] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:00 2022] GET /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9 => generated 1368 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:27:00.482833 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-d1e58ff5-7f59-4138-982b-f3ecf6c4eac3 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acafe7ed414c87a5ca235b96047aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf4e20a59f147afb4f036fc8d04adb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:00.491511 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-d1e58ff5-7f59-4138-982b-f3ecf6c4eac3 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b" status: 200 len: 1261 microversion: 2.1 time: 0.098490 Sep 27 17:27:00.492189 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 170/362] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:00 2022] GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b => generated 1261 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:27:01.460335 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-2e043da4-6152-4f12-b375-d6a1b3d7a235 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:01.462322 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-2e043da4-6152-4f12-b375-d6a1b3d7a235 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: fef20d9a-42bf-4605-bbcb-b673d215a5b9] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:01.469234 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-2e043da4-6152-4f12-b375-d6a1b3d7a235 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:01.470134 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-2e043da4-6152-4f12-b375-d6a1b3d7a235 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:01.470993 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-2e043da4-6152-4f12-b375-d6a1b3d7a235 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:01.471875 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-2e043da4-6152-4f12-b375-d6a1b3d7a235 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:01.472517 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-2e043da4-6152-4f12-b375-d6a1b3d7a235 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:01.473087 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-2e043da4-6152-4f12-b375-d6a1b3d7a235 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:01.478241 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_cell1:SELECT=100 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:27:01.517208 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-659f5cc8-1838-4824-9fc9-b9631b3dc625 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:01.517816 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-659f5cc8-1838-4824-9fc9-b9631b3dc625 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:01.530155 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-659f5cc8-1838-4824-9fc9-b9631b3dc625 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:01.531900 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-659f5cc8-1838-4824-9fc9-b9631b3dc625 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:01.532943 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-659f5cc8-1838-4824-9fc9-b9631b3dc625 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:01.533984 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-659f5cc8-1838-4824-9fc9-b9631b3dc625 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:01.534798 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-659f5cc8-1838-4824-9fc9-b9631b3dc625 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:01.535436 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-659f5cc8-1838-4824-9fc9-b9631b3dc625 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:01.665291 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-659f5cc8-1838-4824-9fc9-b9631b3dc625 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acafe7ed414c87a5ca235b96047aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf4e20a59f147afb4f036fc8d04adb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:01.672965 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-659f5cc8-1838-4824-9fc9-b9631b3dc625 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b" status: 200 len: 1261 microversion: 2.1 time: 0.159785 Sep 27 17:27:01.673828 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 171/363] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:01 2022] GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b => generated 1261 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:27:01.695855 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-2e043da4-6152-4f12-b375-d6a1b3d7a235 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b02c2ba9a0a48c294a11b42cbfe28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef13103d3d8b43e1882d4820c8d9247b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:01.696183 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-c7994ff9-2c8e-434f-85ca-839cee15824b tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1039162325", "imageRef": "9355bd92-0a49-42cd-b079-ff9f0d54b91b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "77098589-b75d-4cff-80ff-98fbc8a6384d"}], "security_groups": [{"name": "tempest-securitygroup--1113177752"}], "key_name": "tempest-keypair-2116257343", "user_data": "}} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:27:01.704652 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-2e043da4-6152-4f12-b375-d6a1b3d7a235 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9" status: 200 len: 1368 microversion: 2.1 time: 0.251644 Sep 27 17:27:01.705892 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 193/364] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:01 2022] GET /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9 => generated 1368 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:27:01.917490 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.network.neutron [None req-c7994ff9-2c8e-434f-85ca-839cee15824b tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] validate_networks() for [('77098589-b75d-4cff-80ff-98fbc8a6384d', None, None, None, None, None)] {{(pid=120415) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 17:27:02.699595 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-c2588573-b9bb-4773-81c1-a7fc16e1d7f2 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:02.700353 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-c2588573-b9bb-4773-81c1-a7fc16e1d7f2 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:02.715170 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c2588573-b9bb-4773-81c1-a7fc16e1d7f2 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:02.717669 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c2588573-b9bb-4773-81c1-a7fc16e1d7f2 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:02.719002 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c2588573-b9bb-4773-81c1-a7fc16e1d7f2 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:02.720070 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c2588573-b9bb-4773-81c1-a7fc16e1d7f2 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:02.720665 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c2588573-b9bb-4773-81c1-a7fc16e1d7f2 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:02.721203 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c2588573-b9bb-4773-81c1-a7fc16e1d7f2 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:02.944146 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-c2588573-b9bb-4773-81c1-a7fc16e1d7f2 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acafe7ed414c87a5ca235b96047aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf4e20a59f147afb4f036fc8d04adb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:02.969288 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-c2588573-b9bb-4773-81c1-a7fc16e1d7f2 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b" status: 200 len: 1327 microversion: 2.1 time: 0.269244 Sep 27 17:27:02.970177 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 194/365] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:02 2022] GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b => generated 1327 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:27:02.981842 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-681c49b8-e004-474f-b5c7-994fc69ee2e1 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:02.983142 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-681c49b8-e004-474f-b5c7-994fc69ee2e1 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: fef20d9a-42bf-4605-bbcb-b673d215a5b9] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:02.999616 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-681c49b8-e004-474f-b5c7-994fc69ee2e1 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:03.004668 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-681c49b8-e004-474f-b5c7-994fc69ee2e1 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:03.006224 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-681c49b8-e004-474f-b5c7-994fc69ee2e1 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:03.007827 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-681c49b8-e004-474f-b5c7-994fc69ee2e1 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:03.010808 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-681c49b8-e004-474f-b5c7-994fc69ee2e1 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:03.011355 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-681c49b8-e004-474f-b5c7-994fc69ee2e1 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:03.462117 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-c7994ff9-2c8e-434f-85ca-839cee15824b tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Flavor limits 0:0:0 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 17:27:03.462631 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-c7994ff9-2c8e-434f-85ca-839cee15824b tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Image limits 0:0:0 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 17:27:03.463816 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-c7994ff9-2c8e-434f-85ca-839cee15824b tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Flavor pref 0:0:0 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 17:27:03.464232 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-c7994ff9-2c8e-434f-85ca-839cee15824b tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Image pref 0:0:0 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 17:27:03.464651 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-c7994ff9-2c8e-434f-85ca-839cee15824b tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 17:27:03.467005 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-681c49b8-e004-474f-b5c7-994fc69ee2e1 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b02c2ba9a0a48c294a11b42cbfe28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef13103d3d8b43e1882d4820c8d9247b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:03.478046 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-681c49b8-e004-474f-b5c7-994fc69ee2e1 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9" status: 200 len: 1368 microversion: 2.1 time: 0.506542 Sep 27 17:27:03.478901 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 195/366] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:02 2022] GET /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9 => generated 1368 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:27:03.486185 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c7994ff9-2c8e-434f-85ca-839cee15824b tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:03.487068 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c7994ff9-2c8e-434f-85ca-839cee15824b tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:03.487603 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c7994ff9-2c8e-434f-85ca-839cee15824b tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:03.488594 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c7994ff9-2c8e-434f-85ca-839cee15824b tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:03.489259 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c7994ff9-2c8e-434f-85ca-839cee15824b tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:03.490192 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c7994ff9-2c8e-434f-85ca-839cee15824b tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:03.511530 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.quota [None req-c7994ff9-2c8e-434f-85ca-839cee15824b tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Getting quotas for project fd5caa5782e74721a4c2991524182668. Resources: {'cores', 'ram', 'instances'} {{(pid=120415) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 17:27:03.517072 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.quota [None req-c7994ff9-2c8e-434f-85ca-839cee15824b tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Getting quotas for user d23a498bde00483c8fdd68dcde975e5d and project fd5caa5782e74721a4c2991524182668. Resources: {'cores', 'ram', 'instances'} {{(pid=120415) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 17:27:03.532094 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-c7994ff9-2c8e-434f-85ca-839cee15824b tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Going to run 1 instances... {{(pid=120415) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 17:27:03.535205 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-c7994ff9-2c8e-434f-85ca-839cee15824b tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9355bd92-0a49-42cd-b079-ff9f0d54b91b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120415) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 17:27:03.630541 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-c7994ff9-2c8e-434f-85ca-839cee15824b tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.939256 Sep 27 17:27:03.632152 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 172/367] 10.222.0.55 () {60 vars in 1147 bytes} [Tue Sep 27 17:27:01 2022] POST /compute/v2.1/servers => generated 409 bytes in 1942 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 27 17:27:03.644998 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-45ba1ef0-e924-4b1b-9a27-782c1303d6ab tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:03.645699 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-45ba1ef0-e924-4b1b-9a27-782c1303d6ab tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:03.743828 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-45ba1ef0-e924-4b1b-9a27-782c1303d6ab tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:03.753030 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-45ba1ef0-e924-4b1b-9a27-782c1303d6ab tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1" status: 200 len: 1246 microversion: 2.1 time: 0.112777 Sep 27 17:27:03.758137 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 196/368] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:03 2022] GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1 => generated 1246 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:27:03.998213 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-a0c4ecf4-894e-48ed-b7f1-ba3ec2f64fa6 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:03.999090 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-a0c4ecf4-894e-48ed-b7f1-ba3ec2f64fa6 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:04.016630 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a0c4ecf4-894e-48ed-b7f1-ba3ec2f64fa6 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:04.017423 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a0c4ecf4-894e-48ed-b7f1-ba3ec2f64fa6 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:04.019601 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a0c4ecf4-894e-48ed-b7f1-ba3ec2f64fa6 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:04.020499 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a0c4ecf4-894e-48ed-b7f1-ba3ec2f64fa6 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:04.022696 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a0c4ecf4-894e-48ed-b7f1-ba3ec2f64fa6 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:04.024527 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a0c4ecf4-894e-48ed-b7f1-ba3ec2f64fa6 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:04.258035 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-a0c4ecf4-894e-48ed-b7f1-ba3ec2f64fa6 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acafe7ed414c87a5ca235b96047aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf4e20a59f147afb4f036fc8d04adb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:04.273188 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-a0c4ecf4-894e-48ed-b7f1-ba3ec2f64fa6 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b" status: 200 len: 1315 microversion: 2.1 time: 0.274603 Sep 27 17:27:04.274033 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 173/369] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:03 2022] GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b => generated 1315 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:27:04.501642 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-2dd7e7b7-fb01-4a89-be48-5059226db508 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:04.502354 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-2dd7e7b7-fb01-4a89-be48-5059226db508 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: fef20d9a-42bf-4605-bbcb-b673d215a5b9] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:04.515914 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-2dd7e7b7-fb01-4a89-be48-5059226db508 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:04.516322 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-2dd7e7b7-fb01-4a89-be48-5059226db508 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:04.519894 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-2dd7e7b7-fb01-4a89-be48-5059226db508 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:04.520749 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-2dd7e7b7-fb01-4a89-be48-5059226db508 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:04.522795 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-2dd7e7b7-fb01-4a89-be48-5059226db508 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:04.525639 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-2dd7e7b7-fb01-4a89-be48-5059226db508 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:04.778869 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-49ea1e1e-74a7-4373-bd1f-255c14fe3b01 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:04.779468 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-49ea1e1e-74a7-4373-bd1f-255c14fe3b01 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:04.786115 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-49ea1e1e-74a7-4373-bd1f-255c14fe3b01 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:04.791836 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-49ea1e1e-74a7-4373-bd1f-255c14fe3b01 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:04.794690 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-49ea1e1e-74a7-4373-bd1f-255c14fe3b01 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:04.796040 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-49ea1e1e-74a7-4373-bd1f-255c14fe3b01 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:04.798016 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-49ea1e1e-74a7-4373-bd1f-255c14fe3b01 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:04.799432 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-49ea1e1e-74a7-4373-bd1f-255c14fe3b01 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:04.977157 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-49ea1e1e-74a7-4373-bd1f-255c14fe3b01 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:04.992312 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-49ea1e1e-74a7-4373-bd1f-255c14fe3b01 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1" status: 200 len: 1250 microversion: 2.1 time: 0.213473 Sep 27 17:27:04.997435 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 174/370] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:04 2022] GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1 => generated 1250 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:27:05.048729 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-2dd7e7b7-fb01-4a89-be48-5059226db508 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b02c2ba9a0a48c294a11b42cbfe28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef13103d3d8b43e1882d4820c8d9247b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:05.057456 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-2dd7e7b7-fb01-4a89-be48-5059226db508 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9" status: 200 len: 1368 microversion: 2.1 time: 0.559344 Sep 27 17:27:05.084885 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 197/371] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:04 2022] GET /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9 => generated 1368 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:27:05.300077 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-647ded61-6097-41d4-bb28-3ac033cc93cd tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:05.301053 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-647ded61-6097-41d4-bb28-3ac033cc93cd tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:05.313805 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-647ded61-6097-41d4-bb28-3ac033cc93cd tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:05.316178 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-647ded61-6097-41d4-bb28-3ac033cc93cd tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:05.318705 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-647ded61-6097-41d4-bb28-3ac033cc93cd tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:05.323713 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-647ded61-6097-41d4-bb28-3ac033cc93cd tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:05.324455 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-647ded61-6097-41d4-bb28-3ac033cc93cd tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:05.326797 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-647ded61-6097-41d4-bb28-3ac033cc93cd tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:05.397053 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [req-51701907-fdbc-4d01-94e4-bc4b0ab6794e req-2b480df8-8389-40fc-bb07-cf06cfa91f17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fef20d9a-42bf-4605-bbcb-b673d215a5b9", "name": "network-vif-plugged", "status": "completed", "tag": "154c5998-5a7a-4e89-abf9-12d9614c0120"}]} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:27:05.413469 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:27:05.429592 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-51701907-fdbc-4d01-94e4-bc4b0ab6794e req-2b480df8-8389-40fc-bb07-cf06cfa91f17 service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:05.433544 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-51701907-fdbc-4d01-94e4-bc4b0ab6794e req-2b480df8-8389-40fc-bb07-cf06cfa91f17 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:05.434278 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-51701907-fdbc-4d01-94e4-bc4b0ab6794e req-2b480df8-8389-40fc-bb07-cf06cfa91f17 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:05.478948 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.compute.server_external_events [req-51701907-fdbc-4d01-94e4-bc4b0ab6794e req-2b480df8-8389-40fc-bb07-cf06cfa91f17 service nova] Creating event network-vif-plugged:154c5998-5a7a-4e89-abf9-12d9614c0120 for instance fef20d9a-42bf-4605-bbcb-b673d215a5b9 on hv-cinder-84914 Sep 27 17:27:05.500344 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [req-51701907-fdbc-4d01-94e4-bc4b0ab6794e req-2b480df8-8389-40fc-bb07-cf06cfa91f17 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108166 Sep 27 17:27:05.503066 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 198/372] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:27:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 17:27:05.842685 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-647ded61-6097-41d4-bb28-3ac033cc93cd tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acafe7ed414c87a5ca235b96047aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf4e20a59f147afb4f036fc8d04adb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:05.859737 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-647ded61-6097-41d4-bb28-3ac033cc93cd tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b" status: 200 len: 1357 microversion: 2.1 time: 0.563583 Sep 27 17:27:05.863875 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 175/373] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:05 2022] GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b => generated 1357 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:27:06.028758 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-f06ebb6a-99df-4de0-8f1a-894fa359605e tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:06.030781 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-f06ebb6a-99df-4de0-8f1a-894fa359605e tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:06.052638 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f06ebb6a-99df-4de0-8f1a-894fa359605e tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:06.053802 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f06ebb6a-99df-4de0-8f1a-894fa359605e tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:06.054327 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f06ebb6a-99df-4de0-8f1a-894fa359605e tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:06.055044 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f06ebb6a-99df-4de0-8f1a-894fa359605e tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:06.055889 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f06ebb6a-99df-4de0-8f1a-894fa359605e tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:06.056387 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f06ebb6a-99df-4de0-8f1a-894fa359605e tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:06.085110 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-90cee3d1-2bdc-4a73-8595-6d941b434d14 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:06.085872 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-90cee3d1-2bdc-4a73-8595-6d941b434d14 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: fef20d9a-42bf-4605-bbcb-b673d215a5b9] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:06.093752 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-90cee3d1-2bdc-4a73-8595-6d941b434d14 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:06.094285 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-90cee3d1-2bdc-4a73-8595-6d941b434d14 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:06.095934 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-90cee3d1-2bdc-4a73-8595-6d941b434d14 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:06.100051 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-90cee3d1-2bdc-4a73-8595-6d941b434d14 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:06.101601 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-90cee3d1-2bdc-4a73-8595-6d941b434d14 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:06.102643 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-90cee3d1-2bdc-4a73-8595-6d941b434d14 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:06.229400 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-f06ebb6a-99df-4de0-8f1a-894fa359605e tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:06.241389 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-f06ebb6a-99df-4de0-8f1a-894fa359605e tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1" status: 200 len: 1250 microversion: 2.1 time: 0.221461 Sep 27 17:27:06.246714 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 199/374] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:06 2022] GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1 => generated 1250 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:27:06.419638 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-90cee3d1-2bdc-4a73-8595-6d941b434d14 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b02c2ba9a0a48c294a11b42cbfe28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef13103d3d8b43e1882d4820c8d9247b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:06.432423 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-90cee3d1-2bdc-4a73-8595-6d941b434d14 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9" status: 200 len: 1368 microversion: 2.1 time: 0.350258 Sep 27 17:27:06.436894 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 176/375] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:06 2022] GET /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9 => generated 1368 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:27:06.539497 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [req-068d0b13-ba24-4175-806d-a3dafdb5ed93 req-118e8765-cbfa-47c2-b9d1-0103b70dfe00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7c9bb60-e05b-4527-aa2f-bc6a3c55306b", "tag": "9d1590c2-6fed-40c4-8aca-ed18ef3c13df"}]} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:27:06.553988 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-068d0b13-ba24-4175-806d-a3dafdb5ed93 req-118e8765-cbfa-47c2-b9d1-0103b70dfe00 service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:06.554511 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-068d0b13-ba24-4175-806d-a3dafdb5ed93 req-118e8765-cbfa-47c2-b9d1-0103b70dfe00 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:06.554951 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-068d0b13-ba24-4175-806d-a3dafdb5ed93 req-118e8765-cbfa-47c2-b9d1-0103b70dfe00 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:06.569875 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.compute.server_external_events [req-068d0b13-ba24-4175-806d-a3dafdb5ed93 req-118e8765-cbfa-47c2-b9d1-0103b70dfe00 service nova] Creating event network-changed:9d1590c2-6fed-40c4-8aca-ed18ef3c13df for instance d7c9bb60-e05b-4527-aa2f-bc6a3c55306b on hv-cinder-84914 Sep 27 17:27:06.575611 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [req-068d0b13-ba24-4175-806d-a3dafdb5ed93 req-118e8765-cbfa-47c2-b9d1-0103b70dfe00 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040760 Sep 27 17:27:06.577026 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 200/376] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:27:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:27:06.885547 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-1cdb2600-2379-4961-86b8-0507151cd8f8 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:06.886795 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-1cdb2600-2379-4961-86b8-0507151cd8f8 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:06.894947 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1cdb2600-2379-4961-86b8-0507151cd8f8 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:06.895573 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1cdb2600-2379-4961-86b8-0507151cd8f8 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:06.896331 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1cdb2600-2379-4961-86b8-0507151cd8f8 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:06.897540 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1cdb2600-2379-4961-86b8-0507151cd8f8 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:06.898184 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1cdb2600-2379-4961-86b8-0507151cd8f8 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:06.898750 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1cdb2600-2379-4961-86b8-0507151cd8f8 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:07.057151 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-1cdb2600-2379-4961-86b8-0507151cd8f8 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acafe7ed414c87a5ca235b96047aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf4e20a59f147afb4f036fc8d04adb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:07.066756 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-1cdb2600-2379-4961-86b8-0507151cd8f8 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b" status: 200 len: 1357 microversion: 2.1 time: 0.184968 Sep 27 17:27:07.067621 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 177/377] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:06 2022] GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b => generated 1357 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:27:07.270450 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-e52b63c2-4427-4300-abca-228a147b0aef tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:07.271869 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-e52b63c2-4427-4300-abca-228a147b0aef tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:07.280730 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e52b63c2-4427-4300-abca-228a147b0aef tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:07.282058 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e52b63c2-4427-4300-abca-228a147b0aef tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:07.282887 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e52b63c2-4427-4300-abca-228a147b0aef tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:07.283842 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e52b63c2-4427-4300-abca-228a147b0aef tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:07.284510 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e52b63c2-4427-4300-abca-228a147b0aef tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:07.285145 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e52b63c2-4427-4300-abca-228a147b0aef tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:07.373504 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-e52b63c2-4427-4300-abca-228a147b0aef tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:07.382493 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-e52b63c2-4427-4300-abca-228a147b0aef tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1" status: 200 len: 1250 microversion: 2.1 time: 0.116689 Sep 27 17:27:07.383869 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 201/378] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:07 2022] GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1 => generated 1250 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:27:07.464972 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-834ba033-69c0-401c-9e5d-175c52192696 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:07.465788 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-834ba033-69c0-401c-9e5d-175c52192696 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: fef20d9a-42bf-4605-bbcb-b673d215a5b9] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:07.473134 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-834ba033-69c0-401c-9e5d-175c52192696 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:07.473639 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-834ba033-69c0-401c-9e5d-175c52192696 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:07.474135 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-834ba033-69c0-401c-9e5d-175c52192696 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:07.474867 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-834ba033-69c0-401c-9e5d-175c52192696 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:07.475378 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-834ba033-69c0-401c-9e5d-175c52192696 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:07.475827 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-834ba033-69c0-401c-9e5d-175c52192696 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:07.622378 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-834ba033-69c0-401c-9e5d-175c52192696 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b02c2ba9a0a48c294a11b42cbfe28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef13103d3d8b43e1882d4820c8d9247b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:07.631313 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-834ba033-69c0-401c-9e5d-175c52192696 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9" status: 200 len: 1368 microversion: 2.1 time: 0.170361 Sep 27 17:27:07.631883 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 178/379] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:07 2022] GET /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9 => generated 1368 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:27:08.093031 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-c8912a2c-1887-4849-b06c-3cac44785038 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:08.093649 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-c8912a2c-1887-4849-b06c-3cac44785038 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:08.102603 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_cell0:SELECT=2 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:27:08.105084 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c8912a2c-1887-4849-b06c-3cac44785038 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:08.105826 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c8912a2c-1887-4849-b06c-3cac44785038 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:08.106290 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c8912a2c-1887-4849-b06c-3cac44785038 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:08.107000 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c8912a2c-1887-4849-b06c-3cac44785038 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:08.107455 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c8912a2c-1887-4849-b06c-3cac44785038 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:08.108925 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c8912a2c-1887-4849-b06c-3cac44785038 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:08.253779 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-c8912a2c-1887-4849-b06c-3cac44785038 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acafe7ed414c87a5ca235b96047aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf4e20a59f147afb4f036fc8d04adb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:08.271201 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-c8912a2c-1887-4849-b06c-3cac44785038 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b" status: 200 len: 1357 microversion: 2.1 time: 0.181950 Sep 27 17:27:08.272742 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 202/380] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:08 2022] GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b => generated 1357 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:27:08.414904 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-c6f806f2-3803-4d8b-8be4-cd20e39b4a66 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:08.414904 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-c6f806f2-3803-4d8b-8be4-cd20e39b4a66 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:08.419891 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c6f806f2-3803-4d8b-8be4-cd20e39b4a66 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:08.420657 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c6f806f2-3803-4d8b-8be4-cd20e39b4a66 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:08.421322 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c6f806f2-3803-4d8b-8be4-cd20e39b4a66 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:08.422302 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c6f806f2-3803-4d8b-8be4-cd20e39b4a66 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:08.423084 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c6f806f2-3803-4d8b-8be4-cd20e39b4a66 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:08.423720 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c6f806f2-3803-4d8b-8be4-cd20e39b4a66 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:08.550186 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-c6f806f2-3803-4d8b-8be4-cd20e39b4a66 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:08.568875 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-c6f806f2-3803-4d8b-8be4-cd20e39b4a66 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1" status: 200 len: 1250 microversion: 2.1 time: 0.165245 Sep 27 17:27:08.569440 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 179/381] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:08 2022] GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1 => generated 1250 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:27:08.656613 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-b6804fe4-1268-484e-9af0-82aade0c0730 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:08.657213 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-b6804fe4-1268-484e-9af0-82aade0c0730 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: fef20d9a-42bf-4605-bbcb-b673d215a5b9] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:08.671537 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b6804fe4-1268-484e-9af0-82aade0c0730 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:08.672020 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b6804fe4-1268-484e-9af0-82aade0c0730 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:08.672493 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b6804fe4-1268-484e-9af0-82aade0c0730 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:08.673397 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b6804fe4-1268-484e-9af0-82aade0c0730 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:08.673871 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b6804fe4-1268-484e-9af0-82aade0c0730 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:08.674376 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b6804fe4-1268-484e-9af0-82aade0c0730 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:08.846638 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-b6804fe4-1268-484e-9af0-82aade0c0730 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b02c2ba9a0a48c294a11b42cbfe28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef13103d3d8b43e1882d4820c8d9247b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:08.857383 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-b6804fe4-1268-484e-9af0-82aade0c0730 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9" status: 200 len: 1368 microversion: 2.1 time: 0.205049 Sep 27 17:27:08.858562 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 203/382] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:08 2022] GET /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9 => generated 1368 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:27:09.301214 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-4c7e3c81-63e7-488c-9686-3bc63039fd2a tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:09.301884 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-4c7e3c81-63e7-488c-9686-3bc63039fd2a tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:09.308807 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4c7e3c81-63e7-488c-9686-3bc63039fd2a tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:09.309408 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4c7e3c81-63e7-488c-9686-3bc63039fd2a tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:09.310541 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4c7e3c81-63e7-488c-9686-3bc63039fd2a tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:09.311565 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4c7e3c81-63e7-488c-9686-3bc63039fd2a tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:09.312170 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4c7e3c81-63e7-488c-9686-3bc63039fd2a tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:09.312747 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4c7e3c81-63e7-488c-9686-3bc63039fd2a tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:09.472462 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-4c7e3c81-63e7-488c-9686-3bc63039fd2a tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acafe7ed414c87a5ca235b96047aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf4e20a59f147afb4f036fc8d04adb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:09.481474 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-4c7e3c81-63e7-488c-9686-3bc63039fd2a tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b" status: 200 len: 1357 microversion: 2.1 time: 0.184596 Sep 27 17:27:09.489731 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 180/383] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:09 2022] GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b => generated 1357 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:27:09.595763 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-10c1b627-4d05-4a02-8e34-0647b9196e2c tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:09.597381 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-10c1b627-4d05-4a02-8e34-0647b9196e2c tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:09.609761 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-10c1b627-4d05-4a02-8e34-0647b9196e2c tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:09.610437 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-10c1b627-4d05-4a02-8e34-0647b9196e2c tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:09.612609 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-10c1b627-4d05-4a02-8e34-0647b9196e2c tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:09.614741 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-10c1b627-4d05-4a02-8e34-0647b9196e2c tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:09.616622 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-10c1b627-4d05-4a02-8e34-0647b9196e2c tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:09.617169 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-10c1b627-4d05-4a02-8e34-0647b9196e2c tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:09.748146 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-10c1b627-4d05-4a02-8e34-0647b9196e2c tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:09.767214 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-10c1b627-4d05-4a02-8e34-0647b9196e2c tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1" status: 200 len: 1250 microversion: 2.1 time: 0.175031 Sep 27 17:27:09.769252 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 204/384] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:09 2022] GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1 => generated 1250 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:27:09.893640 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-b7ab2005-3fe0-446f-99d8-6fa02407ba44 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:09.894739 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-b7ab2005-3fe0-446f-99d8-6fa02407ba44 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: fef20d9a-42bf-4605-bbcb-b673d215a5b9] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:09.906725 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b7ab2005-3fe0-446f-99d8-6fa02407ba44 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:09.907968 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b7ab2005-3fe0-446f-99d8-6fa02407ba44 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:09.908685 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b7ab2005-3fe0-446f-99d8-6fa02407ba44 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:09.909533 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b7ab2005-3fe0-446f-99d8-6fa02407ba44 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:09.910179 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b7ab2005-3fe0-446f-99d8-6fa02407ba44 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:09.910646 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b7ab2005-3fe0-446f-99d8-6fa02407ba44 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:10.108992 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-b7ab2005-3fe0-446f-99d8-6fa02407ba44 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b02c2ba9a0a48c294a11b42cbfe28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef13103d3d8b43e1882d4820c8d9247b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:10.117765 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-b7ab2005-3fe0-446f-99d8-6fa02407ba44 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9" status: 200 len: 1368 microversion: 2.1 time: 0.229682 Sep 27 17:27:10.118630 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 181/385] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:09 2022] GET /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9 => generated 1368 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:27:10.505180 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-4cc0fee3-ebd2-4470-849a-8bfbf6bc8d67 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:10.506533 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-4cc0fee3-ebd2-4470-849a-8bfbf6bc8d67 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:10.513435 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4cc0fee3-ebd2-4470-849a-8bfbf6bc8d67 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:10.514148 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4cc0fee3-ebd2-4470-849a-8bfbf6bc8d67 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:10.514856 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4cc0fee3-ebd2-4470-849a-8bfbf6bc8d67 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:10.516122 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4cc0fee3-ebd2-4470-849a-8bfbf6bc8d67 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:10.516691 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4cc0fee3-ebd2-4470-849a-8bfbf6bc8d67 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:10.517280 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4cc0fee3-ebd2-4470-849a-8bfbf6bc8d67 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:10.677558 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-4cc0fee3-ebd2-4470-849a-8bfbf6bc8d67 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acafe7ed414c87a5ca235b96047aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf4e20a59f147afb4f036fc8d04adb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:10.686337 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-4cc0fee3-ebd2-4470-849a-8bfbf6bc8d67 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b" status: 200 len: 1357 microversion: 2.1 time: 0.185022 Sep 27 17:27:10.689932 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 205/386] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:10 2022] GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b => generated 1357 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:27:10.792767 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-a47f7f1c-71ee-41cf-9219-0267cda528a2 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:10.794050 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-a47f7f1c-71ee-41cf-9219-0267cda528a2 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:10.801128 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a47f7f1c-71ee-41cf-9219-0267cda528a2 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:10.802133 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a47f7f1c-71ee-41cf-9219-0267cda528a2 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:10.802951 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a47f7f1c-71ee-41cf-9219-0267cda528a2 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:10.803824 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a47f7f1c-71ee-41cf-9219-0267cda528a2 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:10.804405 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a47f7f1c-71ee-41cf-9219-0267cda528a2 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:10.804974 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a47f7f1c-71ee-41cf-9219-0267cda528a2 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:10.883196 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-a47f7f1c-71ee-41cf-9219-0267cda528a2 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:10.893730 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-a47f7f1c-71ee-41cf-9219-0267cda528a2 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1" status: 200 len: 1250 microversion: 2.1 time: 0.105747 Sep 27 17:27:10.906145 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 182/387] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:10 2022] GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1 => generated 1250 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:27:11.143505 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-1140ee2f-c681-4588-996d-8c3dda7ae24c tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:11.144211 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-1140ee2f-c681-4588-996d-8c3dda7ae24c tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: fef20d9a-42bf-4605-bbcb-b673d215a5b9] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:11.150504 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1140ee2f-c681-4588-996d-8c3dda7ae24c tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:11.151073 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1140ee2f-c681-4588-996d-8c3dda7ae24c tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:11.151582 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1140ee2f-c681-4588-996d-8c3dda7ae24c tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:11.152360 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1140ee2f-c681-4588-996d-8c3dda7ae24c tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:11.152871 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1140ee2f-c681-4588-996d-8c3dda7ae24c tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:11.153294 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1140ee2f-c681-4588-996d-8c3dda7ae24c tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:11.317672 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-1140ee2f-c681-4588-996d-8c3dda7ae24c tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b02c2ba9a0a48c294a11b42cbfe28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef13103d3d8b43e1882d4820c8d9247b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:11.328949 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-1140ee2f-c681-4588-996d-8c3dda7ae24c tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9" status: 200 len: 1368 microversion: 2.1 time: 0.189264 Sep 27 17:27:11.331058 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 206/388] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:11 2022] GET /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9 => generated 1368 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:27:11.716726 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-2c92847d-d893-4d2a-a69a-7e3ebaae4a29 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:11.717321 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-2c92847d-d893-4d2a-a69a-7e3ebaae4a29 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:11.723708 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2c92847d-d893-4d2a-a69a-7e3ebaae4a29 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:11.724196 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2c92847d-d893-4d2a-a69a-7e3ebaae4a29 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:11.724635 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2c92847d-d893-4d2a-a69a-7e3ebaae4a29 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:11.725332 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2c92847d-d893-4d2a-a69a-7e3ebaae4a29 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:11.725787 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2c92847d-d893-4d2a-a69a-7e3ebaae4a29 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:11.726243 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2c92847d-d893-4d2a-a69a-7e3ebaae4a29 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:11.868548 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-2c92847d-d893-4d2a-a69a-7e3ebaae4a29 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acafe7ed414c87a5ca235b96047aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf4e20a59f147afb4f036fc8d04adb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:11.876515 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-2c92847d-d893-4d2a-a69a-7e3ebaae4a29 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b" status: 200 len: 1357 microversion: 2.1 time: 0.163812 Sep 27 17:27:11.877085 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 183/389] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:11 2022] GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:27:11.921421 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-b3ddfa3c-dbe0-4274-8880-7c967c53715e tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:11.922044 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-b3ddfa3c-dbe0-4274-8880-7c967c53715e tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:11.928020 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b3ddfa3c-dbe0-4274-8880-7c967c53715e tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:11.928504 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b3ddfa3c-dbe0-4274-8880-7c967c53715e tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:11.928936 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b3ddfa3c-dbe0-4274-8880-7c967c53715e tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:11.929635 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b3ddfa3c-dbe0-4274-8880-7c967c53715e tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:11.930103 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b3ddfa3c-dbe0-4274-8880-7c967c53715e tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:11.930530 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b3ddfa3c-dbe0-4274-8880-7c967c53715e tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:11.993243 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-b3ddfa3c-dbe0-4274-8880-7c967c53715e tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:12.001980 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-b3ddfa3c-dbe0-4274-8880-7c967c53715e tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1" status: 200 len: 1250 microversion: 2.1 time: 0.084398 Sep 27 17:27:12.002575 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 207/390] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:11 2022] GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1 => generated 1250 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:27:12.358806 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-33ba615b-d46e-4d77-bdcc-fed6633f3cc7 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:12.359618 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-33ba615b-d46e-4d77-bdcc-fed6633f3cc7 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: fef20d9a-42bf-4605-bbcb-b673d215a5b9] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:12.366223 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-33ba615b-d46e-4d77-bdcc-fed6633f3cc7 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:12.367101 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-33ba615b-d46e-4d77-bdcc-fed6633f3cc7 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:12.367786 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-33ba615b-d46e-4d77-bdcc-fed6633f3cc7 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:12.385421 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-33ba615b-d46e-4d77-bdcc-fed6633f3cc7 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:12.385975 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-33ba615b-d46e-4d77-bdcc-fed6633f3cc7 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:12.386515 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-33ba615b-d46e-4d77-bdcc-fed6633f3cc7 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:12.563726 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-33ba615b-d46e-4d77-bdcc-fed6633f3cc7 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b02c2ba9a0a48c294a11b42cbfe28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef13103d3d8b43e1882d4820c8d9247b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:12.571480 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-33ba615b-d46e-4d77-bdcc-fed6633f3cc7 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9" status: 200 len: 1368 microversion: 2.1 time: 0.218193 Sep 27 17:27:12.574414 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 184/391] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:12 2022] GET /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9 => generated 1368 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:27:12.901114 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-ba194dec-5817-4f89-b63c-17f0d4674eee tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:12.902418 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-ba194dec-5817-4f89-b63c-17f0d4674eee tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:12.909477 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ba194dec-5817-4f89-b63c-17f0d4674eee tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:12.910653 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ba194dec-5817-4f89-b63c-17f0d4674eee tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:12.911622 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ba194dec-5817-4f89-b63c-17f0d4674eee tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:12.912624 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ba194dec-5817-4f89-b63c-17f0d4674eee tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:12.913432 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ba194dec-5817-4f89-b63c-17f0d4674eee tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:12.914152 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ba194dec-5817-4f89-b63c-17f0d4674eee tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:13.024730 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-fd6bd414-2252-4064-902d-c74cc2a78499 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:13.025635 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-fd6bd414-2252-4064-902d-c74cc2a78499 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:13.032149 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fd6bd414-2252-4064-902d-c74cc2a78499 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:13.032645 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fd6bd414-2252-4064-902d-c74cc2a78499 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:13.033076 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fd6bd414-2252-4064-902d-c74cc2a78499 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:13.033776 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fd6bd414-2252-4064-902d-c74cc2a78499 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:13.034259 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fd6bd414-2252-4064-902d-c74cc2a78499 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:13.034676 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fd6bd414-2252-4064-902d-c74cc2a78499 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:13.058049 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-ba194dec-5817-4f89-b63c-17f0d4674eee tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acafe7ed414c87a5ca235b96047aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf4e20a59f147afb4f036fc8d04adb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:13.067182 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-ba194dec-5817-4f89-b63c-17f0d4674eee tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b" status: 200 len: 1357 microversion: 2.1 time: 0.171217 Sep 27 17:27:13.068651 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 208/392] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:12 2022] GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b => generated 1357 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:27:13.100534 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-fd6bd414-2252-4064-902d-c74cc2a78499 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:13.110037 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-fd6bd414-2252-4064-902d-c74cc2a78499 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1" status: 200 len: 1250 microversion: 2.1 time: 0.089141 Sep 27 17:27:13.114738 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 185/393] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:13 2022] GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1 => generated 1250 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:27:13.596287 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-bd8c599e-56ac-40cb-91cd-855f0c27856f tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:13.596905 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-bd8c599e-56ac-40cb-91cd-855f0c27856f tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: fef20d9a-42bf-4605-bbcb-b673d215a5b9] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:13.610002 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-bd8c599e-56ac-40cb-91cd-855f0c27856f tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:13.610800 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-bd8c599e-56ac-40cb-91cd-855f0c27856f tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:13.611235 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-bd8c599e-56ac-40cb-91cd-855f0c27856f tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:13.611936 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-bd8c599e-56ac-40cb-91cd-855f0c27856f tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:13.612380 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-bd8c599e-56ac-40cb-91cd-855f0c27856f tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:13.612802 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-bd8c599e-56ac-40cb-91cd-855f0c27856f tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:13.748651 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_cell0:SELECT=12 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:27:13.808531 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-bd8c599e-56ac-40cb-91cd-855f0c27856f tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b02c2ba9a0a48c294a11b42cbfe28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef13103d3d8b43e1882d4820c8d9247b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:13.820548 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-bd8c599e-56ac-40cb-91cd-855f0c27856f tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9" status: 200 len: 1368 microversion: 2.1 time: 0.228125 Sep 27 17:27:13.836982 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 209/394] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:13 2022] GET /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9 => generated 1368 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:27:14.092862 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-c2f72c95-30e9-4857-8b1b-06e5808c3d3f tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:14.093552 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-c2f72c95-30e9-4857-8b1b-06e5808c3d3f tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:14.095315 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell0:SELECT=2 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:27:14.096070 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell0:SELECT=12 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:27:14.102272 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c2f72c95-30e9-4857-8b1b-06e5808c3d3f tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:14.102751 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c2f72c95-30e9-4857-8b1b-06e5808c3d3f tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:14.103859 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c2f72c95-30e9-4857-8b1b-06e5808c3d3f tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:14.104550 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c2f72c95-30e9-4857-8b1b-06e5808c3d3f tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:14.105000 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c2f72c95-30e9-4857-8b1b-06e5808c3d3f tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:14.105785 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c2f72c95-30e9-4857-8b1b-06e5808c3d3f tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:14.141300 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-2efd860b-cc3c-4120-8a6a-845bb6eff903 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:14.142017 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-2efd860b-cc3c-4120-8a6a-845bb6eff903 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:14.148995 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-2efd860b-cc3c-4120-8a6a-845bb6eff903 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:14.150629 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-2efd860b-cc3c-4120-8a6a-845bb6eff903 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:14.151420 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-2efd860b-cc3c-4120-8a6a-845bb6eff903 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:14.152504 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-2efd860b-cc3c-4120-8a6a-845bb6eff903 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:14.153103 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-2efd860b-cc3c-4120-8a6a-845bb6eff903 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:14.153618 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-2efd860b-cc3c-4120-8a6a-845bb6eff903 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:14.247683 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-2efd860b-cc3c-4120-8a6a-845bb6eff903 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:14.273068 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-2efd860b-cc3c-4120-8a6a-845bb6eff903 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1" status: 200 len: 1250 microversion: 2.1 time: 0.135909 Sep 27 17:27:14.274232 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 210/395] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:14 2022] GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1 => generated 1250 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:27:14.296199 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-c2f72c95-30e9-4857-8b1b-06e5808c3d3f tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acafe7ed414c87a5ca235b96047aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf4e20a59f147afb4f036fc8d04adb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:14.305141 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-c2f72c95-30e9-4857-8b1b-06e5808c3d3f tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b" status: 200 len: 1357 microversion: 2.1 time: 0.216098 Sep 27 17:27:14.305724 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 186/396] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:14 2022] GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b => generated 1357 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:27:14.844598 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-0f5fd6e7-61b4-4f52-a23d-8c01fc5156fc tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:14.845209 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-0f5fd6e7-61b4-4f52-a23d-8c01fc5156fc tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: fef20d9a-42bf-4605-bbcb-b673d215a5b9] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:14.847039 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:27:14.853004 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-0f5fd6e7-61b4-4f52-a23d-8c01fc5156fc tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:14.853526 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-0f5fd6e7-61b4-4f52-a23d-8c01fc5156fc tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:14.853969 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-0f5fd6e7-61b4-4f52-a23d-8c01fc5156fc tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:14.854682 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-0f5fd6e7-61b4-4f52-a23d-8c01fc5156fc tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:14.855134 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-0f5fd6e7-61b4-4f52-a23d-8c01fc5156fc tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:14.855809 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-0f5fd6e7-61b4-4f52-a23d-8c01fc5156fc tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:14.985427 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-0f5fd6e7-61b4-4f52-a23d-8c01fc5156fc tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b02c2ba9a0a48c294a11b42cbfe28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef13103d3d8b43e1882d4820c8d9247b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:14.992923 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-0f5fd6e7-61b4-4f52-a23d-8c01fc5156fc tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9" status: 200 len: 1368 microversion: 2.1 time: 0.152157 Sep 27 17:27:14.993479 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 211/397] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:14 2022] GET /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:27:15.303763 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-0c89e25a-7fec-478c-96f9-c17766bc10a3 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:15.304434 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-0c89e25a-7fec-478c-96f9-c17766bc10a3 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:15.310816 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0c89e25a-7fec-478c-96f9-c17766bc10a3 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:15.311291 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0c89e25a-7fec-478c-96f9-c17766bc10a3 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:15.311716 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0c89e25a-7fec-478c-96f9-c17766bc10a3 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:15.312399 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0c89e25a-7fec-478c-96f9-c17766bc10a3 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:15.312850 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0c89e25a-7fec-478c-96f9-c17766bc10a3 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:15.313266 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0c89e25a-7fec-478c-96f9-c17766bc10a3 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:15.328773 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-c20050b0-f5e4-4e7b-8240-d8b3dfee2b72 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:15.329383 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-c20050b0-f5e4-4e7b-8240-d8b3dfee2b72 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:15.335131 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c20050b0-f5e4-4e7b-8240-d8b3dfee2b72 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:15.335614 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c20050b0-f5e4-4e7b-8240-d8b3dfee2b72 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:15.336044 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c20050b0-f5e4-4e7b-8240-d8b3dfee2b72 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:15.336728 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c20050b0-f5e4-4e7b-8240-d8b3dfee2b72 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:15.337179 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c20050b0-f5e4-4e7b-8240-d8b3dfee2b72 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:15.338202 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c20050b0-f5e4-4e7b-8240-d8b3dfee2b72 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:15.340703 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_cell1:SELECT=100 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:27:15.377283 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-0c89e25a-7fec-478c-96f9-c17766bc10a3 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:15.385436 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-0c89e25a-7fec-478c-96f9-c17766bc10a3 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1" status: 200 len: 1250 microversion: 2.1 time: 0.085458 Sep 27 17:27:15.386007 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 187/398] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:15 2022] GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1 => generated 1250 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:27:15.468522 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-c20050b0-f5e4-4e7b-8240-d8b3dfee2b72 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acafe7ed414c87a5ca235b96047aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf4e20a59f147afb4f036fc8d04adb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:15.476060 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-c20050b0-f5e4-4e7b-8240-d8b3dfee2b72 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b" status: 200 len: 1357 microversion: 2.1 time: 0.151181 Sep 27 17:27:15.476623 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 212/399] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:15 2022] GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:27:16.016299 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-fb91f24c-0a5c-43b7-a9cd-27bab41ec1c8 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:16.016821 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-fb91f24c-0a5c-43b7-a9cd-27bab41ec1c8 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: fef20d9a-42bf-4605-bbcb-b673d215a5b9] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:16.022729 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fb91f24c-0a5c-43b7-a9cd-27bab41ec1c8 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:16.023206 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fb91f24c-0a5c-43b7-a9cd-27bab41ec1c8 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:16.023635 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fb91f24c-0a5c-43b7-a9cd-27bab41ec1c8 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:16.024316 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fb91f24c-0a5c-43b7-a9cd-27bab41ec1c8 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:16.024765 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fb91f24c-0a5c-43b7-a9cd-27bab41ec1c8 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:16.025449 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fb91f24c-0a5c-43b7-a9cd-27bab41ec1c8 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:16.156894 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-fb91f24c-0a5c-43b7-a9cd-27bab41ec1c8 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b02c2ba9a0a48c294a11b42cbfe28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef13103d3d8b43e1882d4820c8d9247b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:16.164401 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-fb91f24c-0a5c-43b7-a9cd-27bab41ec1c8 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9" status: 200 len: 1368 microversion: 2.1 time: 0.152020 Sep 27 17:27:16.164966 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 188/400] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:16 2022] GET /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:27:16.408428 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-bb9dc7d4-e707-44c1-9780-6bc1b2d81360 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:16.409038 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-bb9dc7d4-e707-44c1-9780-6bc1b2d81360 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:16.414929 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-bb9dc7d4-e707-44c1-9780-6bc1b2d81360 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:16.415412 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-bb9dc7d4-e707-44c1-9780-6bc1b2d81360 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:16.416459 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-bb9dc7d4-e707-44c1-9780-6bc1b2d81360 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:16.417139 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-bb9dc7d4-e707-44c1-9780-6bc1b2d81360 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:16.417592 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-bb9dc7d4-e707-44c1-9780-6bc1b2d81360 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:16.418013 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-bb9dc7d4-e707-44c1-9780-6bc1b2d81360 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:16.476415 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-bb9dc7d4-e707-44c1-9780-6bc1b2d81360 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:16.484795 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-bb9dc7d4-e707-44c1-9780-6bc1b2d81360 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1" status: 200 len: 1250 microversion: 2.1 time: 0.080245 Sep 27 17:27:16.485344 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 213/401] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:16 2022] GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1 => generated 1250 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:27:16.498526 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-1b83000f-b024-4e55-a14b-213445ee319a tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:16.499244 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-1b83000f-b024-4e55-a14b-213445ee319a tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:16.505609 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1b83000f-b024-4e55-a14b-213445ee319a tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:16.506108 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1b83000f-b024-4e55-a14b-213445ee319a tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:16.506543 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1b83000f-b024-4e55-a14b-213445ee319a tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:16.507229 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1b83000f-b024-4e55-a14b-213445ee319a tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:16.507675 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1b83000f-b024-4e55-a14b-213445ee319a tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:16.508093 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1b83000f-b024-4e55-a14b-213445ee319a tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:16.635252 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-1b83000f-b024-4e55-a14b-213445ee319a tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acafe7ed414c87a5ca235b96047aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf4e20a59f147afb4f036fc8d04adb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:16.642712 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-1b83000f-b024-4e55-a14b-213445ee319a tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b" status: 200 len: 1357 microversion: 2.1 time: 0.148058 Sep 27 17:27:16.643275 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 189/402] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:16 2022] GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b => generated 1357 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:27:17.188086 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-1969249c-90d9-480a-a63b-2721afe4e766 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:17.188696 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-1969249c-90d9-480a-a63b-2721afe4e766 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: fef20d9a-42bf-4605-bbcb-b673d215a5b9] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:17.194527 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1969249c-90d9-480a-a63b-2721afe4e766 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:17.195004 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1969249c-90d9-480a-a63b-2721afe4e766 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:17.195433 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1969249c-90d9-480a-a63b-2721afe4e766 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:17.196115 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1969249c-90d9-480a-a63b-2721afe4e766 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:17.196564 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1969249c-90d9-480a-a63b-2721afe4e766 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:17.197638 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1969249c-90d9-480a-a63b-2721afe4e766 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:17.334207 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-1969249c-90d9-480a-a63b-2721afe4e766 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b02c2ba9a0a48c294a11b42cbfe28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef13103d3d8b43e1882d4820c8d9247b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:17.341772 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-1969249c-90d9-480a-a63b-2721afe4e766 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9" status: 200 len: 1368 microversion: 2.1 time: 0.157549 Sep 27 17:27:17.342369 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 214/403] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:17 2022] GET /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9 => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:27:17.507201 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-c27ba02b-d609-410b-9bef-5234e3aadf92 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:17.507745 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-c27ba02b-d609-410b-9bef-5234e3aadf92 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:17.510093 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=4 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:27:17.515335 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c27ba02b-d609-410b-9bef-5234e3aadf92 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:17.515817 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c27ba02b-d609-410b-9bef-5234e3aadf92 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:17.516255 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c27ba02b-d609-410b-9bef-5234e3aadf92 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:17.516946 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c27ba02b-d609-410b-9bef-5234e3aadf92 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:17.517398 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c27ba02b-d609-410b-9bef-5234e3aadf92 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:17.517820 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c27ba02b-d609-410b-9bef-5234e3aadf92 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:17.578225 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-c27ba02b-d609-410b-9bef-5234e3aadf92 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:17.585748 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-c27ba02b-d609-410b-9bef-5234e3aadf92 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1" status: 200 len: 1250 microversion: 2.1 time: 0.082463 Sep 27 17:27:17.586346 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 190/404] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:17 2022] GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1 => generated 1250 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:27:17.666189 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-33271595-fae2-494e-bf9d-eeac50471b8c tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:17.666799 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-33271595-fae2-494e-bf9d-eeac50471b8c tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:17.672671 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-33271595-fae2-494e-bf9d-eeac50471b8c tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:17.673147 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-33271595-fae2-494e-bf9d-eeac50471b8c tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:17.673583 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-33271595-fae2-494e-bf9d-eeac50471b8c tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:17.674300 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-33271595-fae2-494e-bf9d-eeac50471b8c tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:17.674750 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-33271595-fae2-494e-bf9d-eeac50471b8c tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:17.675168 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-33271595-fae2-494e-bf9d-eeac50471b8c tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:17.802871 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-33271595-fae2-494e-bf9d-eeac50471b8c tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acafe7ed414c87a5ca235b96047aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf4e20a59f147afb4f036fc8d04adb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:17.810983 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-33271595-fae2-494e-bf9d-eeac50471b8c tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b" status: 200 len: 1357 microversion: 2.1 time: 0.149224 Sep 27 17:27:17.811541 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 215/405] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:17 2022] GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b => generated 1357 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:27:18.365014 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-f4726aba-2bc3-4cb0-be45-546b8a54a57b tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:18.365621 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-f4726aba-2bc3-4cb0-be45-546b8a54a57b tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: fef20d9a-42bf-4605-bbcb-b673d215a5b9] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:18.371664 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f4726aba-2bc3-4cb0-be45-546b8a54a57b tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:18.372140 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f4726aba-2bc3-4cb0-be45-546b8a54a57b tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:18.372570 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f4726aba-2bc3-4cb0-be45-546b8a54a57b tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:18.373250 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f4726aba-2bc3-4cb0-be45-546b8a54a57b tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:18.373699 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f4726aba-2bc3-4cb0-be45-546b8a54a57b tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:18.374146 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f4726aba-2bc3-4cb0-be45-546b8a54a57b tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:18.501034 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-f4726aba-2bc3-4cb0-be45-546b8a54a57b tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b02c2ba9a0a48c294a11b42cbfe28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef13103d3d8b43e1882d4820c8d9247b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:18.508678 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-f4726aba-2bc3-4cb0-be45-546b8a54a57b tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9" status: 200 len: 1368 microversion: 2.1 time: 0.147597 Sep 27 17:27:18.509745 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 191/406] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:18 2022] GET /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9 => generated 1368 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:27:18.608772 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-7f600481-1453-4316-84b4-6b2dddc5d056 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:18.609409 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-7f600481-1453-4316-84b4-6b2dddc5d056 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:18.615580 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7f600481-1453-4316-84b4-6b2dddc5d056 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:18.616068 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7f600481-1453-4316-84b4-6b2dddc5d056 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:18.616504 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7f600481-1453-4316-84b4-6b2dddc5d056 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:18.617195 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7f600481-1453-4316-84b4-6b2dddc5d056 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:18.617654 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7f600481-1453-4316-84b4-6b2dddc5d056 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:18.618142 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7f600481-1453-4316-84b4-6b2dddc5d056 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:18.678160 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-7f600481-1453-4316-84b4-6b2dddc5d056 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:18.686225 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-7f600481-1453-4316-84b4-6b2dddc5d056 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1" status: 200 len: 1250 microversion: 2.1 time: 0.081866 Sep 27 17:27:18.686785 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 216/407] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:18 2022] GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1 => generated 1250 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:27:18.834049 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-0a98dc20-33b3-4d23-b8db-ffcb18ddc298 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:18.834598 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-0a98dc20-33b3-4d23-b8db-ffcb18ddc298 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:18.840852 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0a98dc20-33b3-4d23-b8db-ffcb18ddc298 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:18.841319 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0a98dc20-33b3-4d23-b8db-ffcb18ddc298 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:18.841741 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0a98dc20-33b3-4d23-b8db-ffcb18ddc298 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:18.842442 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0a98dc20-33b3-4d23-b8db-ffcb18ddc298 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:18.842884 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0a98dc20-33b3-4d23-b8db-ffcb18ddc298 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:18.843295 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0a98dc20-33b3-4d23-b8db-ffcb18ddc298 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:18.847180 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell1:SELECT=100 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:27:18.977081 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-0a98dc20-33b3-4d23-b8db-ffcb18ddc298 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acafe7ed414c87a5ca235b96047aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf4e20a59f147afb4f036fc8d04adb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:18.985387 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-0a98dc20-33b3-4d23-b8db-ffcb18ddc298 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b" status: 200 len: 1357 microversion: 2.1 time: 0.155349 Sep 27 17:27:18.985951 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 192/408] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:18 2022] GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:27:19.531878 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-5f04e422-f00a-41b0-a124-00cccdb7a86f tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:19.532485 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-5f04e422-f00a-41b0-a124-00cccdb7a86f tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: fef20d9a-42bf-4605-bbcb-b673d215a5b9] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:19.538482 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5f04e422-f00a-41b0-a124-00cccdb7a86f tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:19.538939 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5f04e422-f00a-41b0-a124-00cccdb7a86f tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:19.539368 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5f04e422-f00a-41b0-a124-00cccdb7a86f tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:19.540058 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5f04e422-f00a-41b0-a124-00cccdb7a86f tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:19.541158 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5f04e422-f00a-41b0-a124-00cccdb7a86f tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:19.541582 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5f04e422-f00a-41b0-a124-00cccdb7a86f tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:19.676400 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-5f04e422-f00a-41b0-a124-00cccdb7a86f tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b02c2ba9a0a48c294a11b42cbfe28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef13103d3d8b43e1882d4820c8d9247b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:19.683921 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-5f04e422-f00a-41b0-a124-00cccdb7a86f tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9" status: 200 len: 1368 microversion: 2.1 time: 0.155841 Sep 27 17:27:19.684517 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 217/409] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:19 2022] GET /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9 => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:27:19.708904 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-1baa07de-d9e6-43ea-8902-01a1ce29e3a6 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:19.709511 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-1baa07de-d9e6-43ea-8902-01a1ce29e3a6 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:19.716009 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1baa07de-d9e6-43ea-8902-01a1ce29e3a6 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:19.716487 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1baa07de-d9e6-43ea-8902-01a1ce29e3a6 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:19.716921 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1baa07de-d9e6-43ea-8902-01a1ce29e3a6 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:19.717600 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1baa07de-d9e6-43ea-8902-01a1ce29e3a6 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:19.718051 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1baa07de-d9e6-43ea-8902-01a1ce29e3a6 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:19.718493 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1baa07de-d9e6-43ea-8902-01a1ce29e3a6 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:19.777229 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-1baa07de-d9e6-43ea-8902-01a1ce29e3a6 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:19.784833 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-1baa07de-d9e6-43ea-8902-01a1ce29e3a6 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1" status: 200 len: 1250 microversion: 2.1 time: 0.079685 Sep 27 17:27:19.785389 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 193/410] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:19 2022] GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1 => generated 1250 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:27:20.008585 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-4f8c31b9-e435-4fb9-ad89-c05a8389273c tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:20.009740 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-4f8c31b9-e435-4fb9-ad89-c05a8389273c tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:20.015797 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4f8c31b9-e435-4fb9-ad89-c05a8389273c tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:20.016276 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4f8c31b9-e435-4fb9-ad89-c05a8389273c tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:20.016711 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4f8c31b9-e435-4fb9-ad89-c05a8389273c tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:20.017404 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4f8c31b9-e435-4fb9-ad89-c05a8389273c tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:20.017859 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4f8c31b9-e435-4fb9-ad89-c05a8389273c tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:20.018315 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4f8c31b9-e435-4fb9-ad89-c05a8389273c tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:20.155154 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-4f8c31b9-e435-4fb9-ad89-c05a8389273c tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acafe7ed414c87a5ca235b96047aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf4e20a59f147afb4f036fc8d04adb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:20.163751 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-4f8c31b9-e435-4fb9-ad89-c05a8389273c tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b" status: 200 len: 1357 microversion: 2.1 time: 0.158952 Sep 27 17:27:20.164320 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 218/411] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:20 2022] GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:27:20.707107 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-fb7bce5a-6b85-47c9-9598-713961318b05 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:20.707711 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-fb7bce5a-6b85-47c9-9598-713961318b05 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: fef20d9a-42bf-4605-bbcb-b673d215a5b9] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:20.714708 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fb7bce5a-6b85-47c9-9598-713961318b05 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:20.715269 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fb7bce5a-6b85-47c9-9598-713961318b05 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:20.715598 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fb7bce5a-6b85-47c9-9598-713961318b05 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:20.716273 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fb7bce5a-6b85-47c9-9598-713961318b05 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:20.716723 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fb7bce5a-6b85-47c9-9598-713961318b05 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:20.717144 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fb7bce5a-6b85-47c9-9598-713961318b05 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:20.807478 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-a8283a17-3ef0-4cf8-b64e-455b2cc970f2 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:20.808201 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-a8283a17-3ef0-4cf8-b64e-455b2cc970f2 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:20.814044 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a8283a17-3ef0-4cf8-b64e-455b2cc970f2 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:20.814612 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a8283a17-3ef0-4cf8-b64e-455b2cc970f2 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:20.815050 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a8283a17-3ef0-4cf8-b64e-455b2cc970f2 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:20.815744 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a8283a17-3ef0-4cf8-b64e-455b2cc970f2 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:20.816202 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a8283a17-3ef0-4cf8-b64e-455b2cc970f2 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:20.816637 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a8283a17-3ef0-4cf8-b64e-455b2cc970f2 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:20.844487 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-fb7bce5a-6b85-47c9-9598-713961318b05 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b02c2ba9a0a48c294a11b42cbfe28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef13103d3d8b43e1882d4820c8d9247b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:20.852181 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-fb7bce5a-6b85-47c9-9598-713961318b05 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9" status: 200 len: 1368 microversion: 2.1 time: 0.148868 Sep 27 17:27:20.852778 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 194/412] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:20 2022] GET /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9 => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:27:20.879303 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-a8283a17-3ef0-4cf8-b64e-455b2cc970f2 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:20.887667 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-a8283a17-3ef0-4cf8-b64e-455b2cc970f2 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1" status: 200 len: 1242 microversion: 2.1 time: 0.084161 Sep 27 17:27:20.888278 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 219/413] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:20 2022] GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1 => generated 1242 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:27:21.186108 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-03985117-e917-4675-ad12-317526e392a9 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:21.186713 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-03985117-e917-4675-ad12-317526e392a9 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:21.192930 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-03985117-e917-4675-ad12-317526e392a9 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:21.193415 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-03985117-e917-4675-ad12-317526e392a9 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:21.193840 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-03985117-e917-4675-ad12-317526e392a9 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:21.194555 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-03985117-e917-4675-ad12-317526e392a9 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:21.194998 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-03985117-e917-4675-ad12-317526e392a9 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:21.195406 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-03985117-e917-4675-ad12-317526e392a9 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:21.596940 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-03985117-e917-4675-ad12-317526e392a9 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acafe7ed414c87a5ca235b96047aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf4e20a59f147afb4f036fc8d04adb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:21.604906 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-03985117-e917-4675-ad12-317526e392a9 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b" status: 200 len: 1357 microversion: 2.1 time: 0.422741 Sep 27 17:27:21.619940 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 195/414] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:21 2022] GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b => generated 1357 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:27:21.878840 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-f3912d58-403d-4a87-9c59-6b814e32295e tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:21.881140 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-f3912d58-403d-4a87-9c59-6b814e32295e tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: fef20d9a-42bf-4605-bbcb-b673d215a5b9] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:21.900335 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f3912d58-403d-4a87-9c59-6b814e32295e tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:21.901926 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f3912d58-403d-4a87-9c59-6b814e32295e tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:21.905176 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f3912d58-403d-4a87-9c59-6b814e32295e tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:21.907269 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f3912d58-403d-4a87-9c59-6b814e32295e tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:21.909557 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f3912d58-403d-4a87-9c59-6b814e32295e tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:21.912098 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f3912d58-403d-4a87-9c59-6b814e32295e tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:21.912688 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-723420e3-4b33-456c-bcf9-bf3c607682cf tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:21.913602 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-723420e3-4b33-456c-bcf9-bf3c607682cf tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:21.924807 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-723420e3-4b33-456c-bcf9-bf3c607682cf tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:21.925315 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-723420e3-4b33-456c-bcf9-bf3c607682cf tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:21.925733 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-723420e3-4b33-456c-bcf9-bf3c607682cf tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:21.926466 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-723420e3-4b33-456c-bcf9-bf3c607682cf tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:21.926914 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-723420e3-4b33-456c-bcf9-bf3c607682cf tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:21.927329 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-723420e3-4b33-456c-bcf9-bf3c607682cf tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:22.117886 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-723420e3-4b33-456c-bcf9-bf3c607682cf tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:22.128614 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-723420e3-4b33-456c-bcf9-bf3c607682cf tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1" status: 200 len: 1298 microversion: 2.1 time: 0.221529 Sep 27 17:27:22.129593 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 196/415] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:21 2022] GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1 => generated 1298 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:27:22.190227 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-f3912d58-403d-4a87-9c59-6b814e32295e tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b02c2ba9a0a48c294a11b42cbfe28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef13103d3d8b43e1882d4820c8d9247b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:22.198708 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-f3912d58-403d-4a87-9c59-6b814e32295e tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9" status: 200 len: 1368 microversion: 2.1 time: 0.325417 Sep 27 17:27:22.199266 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 220/416] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:21 2022] GET /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9 => generated 1368 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:27:22.630359 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-40206100-9f51-4384-b718-bb42f986f43b tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:22.630944 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-40206100-9f51-4384-b718-bb42f986f43b tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:22.636804 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-40206100-9f51-4384-b718-bb42f986f43b tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:22.637280 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-40206100-9f51-4384-b718-bb42f986f43b tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:22.637713 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-40206100-9f51-4384-b718-bb42f986f43b tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:22.638418 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-40206100-9f51-4384-b718-bb42f986f43b tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:22.638860 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-40206100-9f51-4384-b718-bb42f986f43b tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:22.639277 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-40206100-9f51-4384-b718-bb42f986f43b tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:22.807966 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-40206100-9f51-4384-b718-bb42f986f43b tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acafe7ed414c87a5ca235b96047aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf4e20a59f147afb4f036fc8d04adb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:22.816478 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-40206100-9f51-4384-b718-bb42f986f43b tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b" status: 200 len: 1357 microversion: 2.1 time: 0.189847 Sep 27 17:27:22.817349 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 197/417] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:22 2022] GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b => generated 1357 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:27:23.153038 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-03f028ce-ad04-4f34-aec9-89df969c600f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:23.153697 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-03f028ce-ad04-4f34-aec9-89df969c600f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:23.161215 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-03f028ce-ad04-4f34-aec9-89df969c600f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:23.161930 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-03f028ce-ad04-4f34-aec9-89df969c600f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:23.162645 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-03f028ce-ad04-4f34-aec9-89df969c600f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:23.163903 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-03f028ce-ad04-4f34-aec9-89df969c600f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:23.164453 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-03f028ce-ad04-4f34-aec9-89df969c600f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:23.164940 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-03f028ce-ad04-4f34-aec9-89df969c600f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:23.222487 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-70c96033-da88-4ac4-88b7-9b5c5d959a92 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:23.223203 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-70c96033-da88-4ac4-88b7-9b5c5d959a92 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: fef20d9a-42bf-4605-bbcb-b673d215a5b9] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:23.233285 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-70c96033-da88-4ac4-88b7-9b5c5d959a92 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:23.236541 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-70c96033-da88-4ac4-88b7-9b5c5d959a92 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:23.238540 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-70c96033-da88-4ac4-88b7-9b5c5d959a92 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:23.239347 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-70c96033-da88-4ac4-88b7-9b5c5d959a92 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:23.241383 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-70c96033-da88-4ac4-88b7-9b5c5d959a92 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:23.242178 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-70c96033-da88-4ac4-88b7-9b5c5d959a92 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:23.251422 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-03f028ce-ad04-4f34-aec9-89df969c600f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:23.266094 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-03f028ce-ad04-4f34-aec9-89df969c600f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1" status: 200 len: 1298 microversion: 2.1 time: 0.111436 Sep 27 17:27:23.266953 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 221/418] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:23 2022] GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1 => generated 1298 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:27:23.399906 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-70c96033-da88-4ac4-88b7-9b5c5d959a92 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b02c2ba9a0a48c294a11b42cbfe28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef13103d3d8b43e1882d4820c8d9247b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:23.409574 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-70c96033-da88-4ac4-88b7-9b5c5d959a92 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9" status: 200 len: 1368 microversion: 2.1 time: 0.190909 Sep 27 17:27:23.410355 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 198/419] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:23 2022] GET /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9 => generated 1368 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:27:23.840428 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-4bd1421e-7898-4dc2-8d7c-c20f2f5fe863 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:23.841051 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-4bd1421e-7898-4dc2-8d7c-c20f2f5fe863 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:23.847074 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4bd1421e-7898-4dc2-8d7c-c20f2f5fe863 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:23.847554 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4bd1421e-7898-4dc2-8d7c-c20f2f5fe863 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:23.847985 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4bd1421e-7898-4dc2-8d7c-c20f2f5fe863 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:23.848677 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4bd1421e-7898-4dc2-8d7c-c20f2f5fe863 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:23.849131 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4bd1421e-7898-4dc2-8d7c-c20f2f5fe863 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:23.849557 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4bd1421e-7898-4dc2-8d7c-c20f2f5fe863 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:24.007375 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-4bd1421e-7898-4dc2-8d7c-c20f2f5fe863 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acafe7ed414c87a5ca235b96047aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf4e20a59f147afb4f036fc8d04adb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:24.016369 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-4bd1421e-7898-4dc2-8d7c-c20f2f5fe863 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b" status: 200 len: 1357 microversion: 2.1 time: 0.179995 Sep 27 17:27:24.030328 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 222/420] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:23 2022] GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b => generated 1357 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:27:24.288613 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-85ae0c4f-5856-430e-8977-1ea0f98fc807 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:24.289313 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-85ae0c4f-5856-430e-8977-1ea0f98fc807 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:24.296074 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-85ae0c4f-5856-430e-8977-1ea0f98fc807 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:24.296672 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-85ae0c4f-5856-430e-8977-1ea0f98fc807 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:24.297145 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-85ae0c4f-5856-430e-8977-1ea0f98fc807 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:24.297872 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-85ae0c4f-5856-430e-8977-1ea0f98fc807 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:24.298374 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-85ae0c4f-5856-430e-8977-1ea0f98fc807 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:24.298799 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-85ae0c4f-5856-430e-8977-1ea0f98fc807 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:24.368177 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-85ae0c4f-5856-430e-8977-1ea0f98fc807 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:24.378486 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-85ae0c4f-5856-430e-8977-1ea0f98fc807 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1" status: 200 len: 1306 microversion: 2.1 time: 0.093560 Sep 27 17:27:24.379243 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 199/421] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:24 2022] GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1 => generated 1306 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:27:24.432731 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-f3386384-5347-4604-80d5-bc519cb84dfa tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:24.433343 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-f3386384-5347-4604-80d5-bc519cb84dfa tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: fef20d9a-42bf-4605-bbcb-b673d215a5b9] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:24.439204 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f3386384-5347-4604-80d5-bc519cb84dfa tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:24.439688 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f3386384-5347-4604-80d5-bc519cb84dfa tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:24.440114 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f3386384-5347-4604-80d5-bc519cb84dfa tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:24.440801 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f3386384-5347-4604-80d5-bc519cb84dfa tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:24.441250 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f3386384-5347-4604-80d5-bc519cb84dfa tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:24.441669 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f3386384-5347-4604-80d5-bc519cb84dfa tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:24.578802 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-f3386384-5347-4604-80d5-bc519cb84dfa tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b02c2ba9a0a48c294a11b42cbfe28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef13103d3d8b43e1882d4820c8d9247b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:24.586657 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-f3386384-5347-4604-80d5-bc519cb84dfa tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9" status: 200 len: 1558 microversion: 2.1 time: 0.157753 Sep 27 17:27:24.587882 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 223/422] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:24 2022] GET /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9 => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:27:24.611264 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-ad434185-5056-4e84-b03f-d7265a692ac4 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:24.611757 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-ad434185-5056-4e84-b03f-d7265a692ac4 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: fef20d9a-42bf-4605-bbcb-b673d215a5b9] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:24.617593 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ad434185-5056-4e84-b03f-d7265a692ac4 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:24.618097 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ad434185-5056-4e84-b03f-d7265a692ac4 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:24.619079 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ad434185-5056-4e84-b03f-d7265a692ac4 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:24.619764 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ad434185-5056-4e84-b03f-d7265a692ac4 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:24.620221 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ad434185-5056-4e84-b03f-d7265a692ac4 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:24.620646 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ad434185-5056-4e84-b03f-d7265a692ac4 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:24.701233 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-ad434185-5056-4e84-b03f-d7265a692ac4 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094575 Sep 27 17:27:24.701817 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 200/423] 10.222.0.55 () {58 vars in 1275 bytes} [Tue Sep 27 17:27:24 2022] GET /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:27:25.042440 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-475d0db4-04a7-4386-aee4-7c16ac85b774 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:25.043617 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-475d0db4-04a7-4386-aee4-7c16ac85b774 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:25.050785 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-475d0db4-04a7-4386-aee4-7c16ac85b774 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:25.051532 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-475d0db4-04a7-4386-aee4-7c16ac85b774 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:25.052239 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-475d0db4-04a7-4386-aee4-7c16ac85b774 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:25.053464 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-475d0db4-04a7-4386-aee4-7c16ac85b774 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:25.054313 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-475d0db4-04a7-4386-aee4-7c16ac85b774 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:25.055004 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-475d0db4-04a7-4386-aee4-7c16ac85b774 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:25.199391 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-475d0db4-04a7-4386-aee4-7c16ac85b774 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acafe7ed414c87a5ca235b96047aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf4e20a59f147afb4f036fc8d04adb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:25.207785 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-475d0db4-04a7-4386-aee4-7c16ac85b774 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b" status: 200 len: 1357 microversion: 2.1 time: 0.170604 Sep 27 17:27:25.208567 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 224/424] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:25 2022] GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b => generated 1357 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:27:25.409397 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-062fdc42-015c-4578-8ba8-cf546e88274a tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:25.410202 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-062fdc42-015c-4578-8ba8-cf546e88274a tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:25.417323 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-062fdc42-015c-4578-8ba8-cf546e88274a tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:25.417966 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-062fdc42-015c-4578-8ba8-cf546e88274a tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:25.418531 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-062fdc42-015c-4578-8ba8-cf546e88274a tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:25.419516 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-062fdc42-015c-4578-8ba8-cf546e88274a tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:25.420080 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-062fdc42-015c-4578-8ba8-cf546e88274a tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:25.420606 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-062fdc42-015c-4578-8ba8-cf546e88274a tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:25.487748 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-062fdc42-015c-4578-8ba8-cf546e88274a tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:25.495831 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-062fdc42-015c-4578-8ba8-cf546e88274a tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1" status: 200 len: 1306 microversion: 2.1 time: 0.091201 Sep 27 17:27:25.496416 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 201/425] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:25 2022] GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1 => generated 1306 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:27:26.022717 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [req-5543829d-56c0-4451-a8f0-3d75420b1db9 req-5b24b665-db62-48f6-82fd-80b5df383e7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fef20d9a-42bf-4605-bbcb-b673d215a5b9", "tag": "154c5998-5a7a-4e89-abf9-12d9614c0120"}]} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:27:26.032132 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-5543829d-56c0-4451-a8f0-3d75420b1db9 req-5b24b665-db62-48f6-82fd-80b5df383e7f service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:26.032615 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-5543829d-56c0-4451-a8f0-3d75420b1db9 req-5b24b665-db62-48f6-82fd-80b5df383e7f service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:26.033048 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-5543829d-56c0-4451-a8f0-3d75420b1db9 req-5b24b665-db62-48f6-82fd-80b5df383e7f service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:26.045472 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.compute.server_external_events [req-5543829d-56c0-4451-a8f0-3d75420b1db9 req-5b24b665-db62-48f6-82fd-80b5df383e7f service nova] Creating event network-changed:154c5998-5a7a-4e89-abf9-12d9614c0120 for instance fef20d9a-42bf-4605-bbcb-b673d215a5b9 on hv-cinder-84914 Sep 27 17:27:26.050763 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [req-5543829d-56c0-4451-a8f0-3d75420b1db9 req-5b24b665-db62-48f6-82fd-80b5df383e7f service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031701 Sep 27 17:27:26.051359 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 225/426] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:27:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:27:26.233709 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-faeeb31d-2d0a-4702-b41c-6c57d911883c tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:26.234251 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-faeeb31d-2d0a-4702-b41c-6c57d911883c tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:26.240196 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-faeeb31d-2d0a-4702-b41c-6c57d911883c tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:26.240674 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-faeeb31d-2d0a-4702-b41c-6c57d911883c tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:26.241111 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-faeeb31d-2d0a-4702-b41c-6c57d911883c tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:26.241792 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-faeeb31d-2d0a-4702-b41c-6c57d911883c tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:26.242277 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-faeeb31d-2d0a-4702-b41c-6c57d911883c tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:26.242699 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-faeeb31d-2d0a-4702-b41c-6c57d911883c tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:26.383288 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-faeeb31d-2d0a-4702-b41c-6c57d911883c tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acafe7ed414c87a5ca235b96047aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf4e20a59f147afb4f036fc8d04adb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:26.392073 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-faeeb31d-2d0a-4702-b41c-6c57d911883c tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b" status: 200 len: 1357 microversion: 2.1 time: 0.162578 Sep 27 17:27:26.392658 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 202/427] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:26 2022] GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:27:26.520325 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-54922f4d-a3f3-4a8a-a909-e0a4037119dc tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:26.521200 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-54922f4d-a3f3-4a8a-a909-e0a4037119dc tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:26.527543 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-54922f4d-a3f3-4a8a-a909-e0a4037119dc tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:26.528151 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-54922f4d-a3f3-4a8a-a909-e0a4037119dc tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:26.528586 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-54922f4d-a3f3-4a8a-a909-e0a4037119dc tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:26.529279 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-54922f4d-a3f3-4a8a-a909-e0a4037119dc tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:26.529736 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-54922f4d-a3f3-4a8a-a909-e0a4037119dc tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:26.530184 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-54922f4d-a3f3-4a8a-a909-e0a4037119dc tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:26.597095 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-54922f4d-a3f3-4a8a-a909-e0a4037119dc tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:26.605943 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-54922f4d-a3f3-4a8a-a909-e0a4037119dc tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1" status: 200 len: 1306 microversion: 2.1 time: 0.089912 Sep 27 17:27:26.606546 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 226/428] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:26 2022] GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1 => generated 1306 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:27:27.416935 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-7c342576-1f63-4683-b464-5543940c4819 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:27.417535 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-7c342576-1f63-4683-b464-5543940c4819 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:27.423826 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7c342576-1f63-4683-b464-5543940c4819 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:27.424297 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7c342576-1f63-4683-b464-5543940c4819 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:27.424720 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7c342576-1f63-4683-b464-5543940c4819 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:27.425394 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7c342576-1f63-4683-b464-5543940c4819 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:27.425838 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7c342576-1f63-4683-b464-5543940c4819 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:27.426296 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7c342576-1f63-4683-b464-5543940c4819 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:27.630721 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-1101856f-52d4-4b48-b943-784a2576791a tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:27.631857 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-1101856f-52d4-4b48-b943-784a2576791a tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:27.638741 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1101856f-52d4-4b48-b943-784a2576791a tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:27.639254 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1101856f-52d4-4b48-b943-784a2576791a tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:27.639831 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1101856f-52d4-4b48-b943-784a2576791a tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:27.640710 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1101856f-52d4-4b48-b943-784a2576791a tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:27.641518 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1101856f-52d4-4b48-b943-784a2576791a tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:27.642693 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1101856f-52d4-4b48-b943-784a2576791a tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:27.790515 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-1101856f-52d4-4b48-b943-784a2576791a tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:27.798772 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-1101856f-52d4-4b48-b943-784a2576791a tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1" status: 200 len: 1304 microversion: 2.1 time: 0.173784 Sep 27 17:27:27.799465 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 227/429] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:27 2022] GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1 => generated 1304 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:27:27.818757 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-7c342576-1f63-4683-b464-5543940c4819 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acafe7ed414c87a5ca235b96047aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf4e20a59f147afb4f036fc8d04adb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:27.828321 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-7c342576-1f63-4683-b464-5543940c4819 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b" status: 200 len: 1357 microversion: 2.1 time: 0.415317 Sep 27 17:27:27.829768 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 203/430] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:27 2022] GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b => generated 1357 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:27:28.823335 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-9405a84e-347a-43ae-b9b6-ede30e9411e9 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:28.824070 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-9405a84e-347a-43ae-b9b6-ede30e9411e9 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:28.829909 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9405a84e-347a-43ae-b9b6-ede30e9411e9 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:28.830415 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9405a84e-347a-43ae-b9b6-ede30e9411e9 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:28.830844 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9405a84e-347a-43ae-b9b6-ede30e9411e9 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:28.831526 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9405a84e-347a-43ae-b9b6-ede30e9411e9 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:28.831976 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9405a84e-347a-43ae-b9b6-ede30e9411e9 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:28.832392 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9405a84e-347a-43ae-b9b6-ede30e9411e9 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:28.854596 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-f6647087-c68f-44d3-aa0c-bbddea6c1efe tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:28.856427 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-f6647087-c68f-44d3-aa0c-bbddea6c1efe tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:28.862717 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f6647087-c68f-44d3-aa0c-bbddea6c1efe tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:28.863201 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f6647087-c68f-44d3-aa0c-bbddea6c1efe tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:28.863637 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f6647087-c68f-44d3-aa0c-bbddea6c1efe tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:28.864451 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f6647087-c68f-44d3-aa0c-bbddea6c1efe tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:28.865071 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f6647087-c68f-44d3-aa0c-bbddea6c1efe tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:28.866449 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f6647087-c68f-44d3-aa0c-bbddea6c1efe tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:29.077991 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-9405a84e-347a-43ae-b9b6-ede30e9411e9 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:29.082753 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-f6647087-c68f-44d3-aa0c-bbddea6c1efe tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acafe7ed414c87a5ca235b96047aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf4e20a59f147afb4f036fc8d04adb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:29.085774 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-9405a84e-347a-43ae-b9b6-ede30e9411e9 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1" status: 200 len: 1372 microversion: 2.1 time: 0.266259 Sep 27 17:27:29.086484 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 228/431] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:28 2022] GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1 => generated 1372 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:27:29.091451 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-f6647087-c68f-44d3-aa0c-bbddea6c1efe tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b" status: 200 len: 1357 microversion: 2.1 time: 0.242626 Sep 27 17:27:29.092112 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 204/432] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:28 2022] GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b => generated 1357 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:27:30.109850 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-3eb6574f-5170-4732-94b7-eaea401912ab tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:30.110608 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-3eb6574f-5170-4732-94b7-eaea401912ab tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:30.114006 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-3b5ab65a-b890-455b-becc-66bdd0a0fc69 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:30.114654 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-3b5ab65a-b890-455b-becc-66bdd0a0fc69 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:30.116627 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3eb6574f-5170-4732-94b7-eaea401912ab tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:30.117110 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3eb6574f-5170-4732-94b7-eaea401912ab tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:30.117579 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3eb6574f-5170-4732-94b7-eaea401912ab tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:30.118308 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3eb6574f-5170-4732-94b7-eaea401912ab tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:30.118768 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3eb6574f-5170-4732-94b7-eaea401912ab tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:30.119193 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3eb6574f-5170-4732-94b7-eaea401912ab tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:30.121180 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3b5ab65a-b890-455b-becc-66bdd0a0fc69 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:30.121674 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3b5ab65a-b890-455b-becc-66bdd0a0fc69 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:30.122120 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3b5ab65a-b890-455b-becc-66bdd0a0fc69 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:30.122834 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3b5ab65a-b890-455b-becc-66bdd0a0fc69 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:30.123289 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3b5ab65a-b890-455b-becc-66bdd0a0fc69 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:30.123711 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3b5ab65a-b890-455b-becc-66bdd0a0fc69 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:30.133902 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_cell1:SELECT=100 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:27:30.307008 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-3b5ab65a-b890-455b-becc-66bdd0a0fc69 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acafe7ed414c87a5ca235b96047aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf4e20a59f147afb4f036fc8d04adb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:30.310823 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-3eb6574f-5170-4732-94b7-eaea401912ab tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:30.314941 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-3b5ab65a-b890-455b-becc-66bdd0a0fc69 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b" status: 200 len: 1357 microversion: 2.1 time: 0.204670 Sep 27 17:27:30.315513 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 205/433] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:30 2022] GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b => generated 1357 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:27:30.319025 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-3eb6574f-5170-4732-94b7-eaea401912ab tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1" status: 200 len: 1372 microversion: 2.1 time: 0.213287 Sep 27 17:27:30.319923 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 229/434] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:30 2022] GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1 => generated 1372 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:27:31.339138 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-d7006656-d2f0-4c9d-ae77-a796893e0b4b tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:31.339755 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-d7006656-d2f0-4c9d-ae77-a796893e0b4b tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:31.341629 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-61109322-5b12-45ac-9884-0b7ca2a5cd3b tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:31.342269 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-61109322-5b12-45ac-9884-0b7ca2a5cd3b tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:31.346136 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d7006656-d2f0-4c9d-ae77-a796893e0b4b tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:31.346625 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d7006656-d2f0-4c9d-ae77-a796893e0b4b tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:31.347062 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d7006656-d2f0-4c9d-ae77-a796893e0b4b tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:31.347818 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d7006656-d2f0-4c9d-ae77-a796893e0b4b tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:31.348023 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-61109322-5b12-45ac-9884-0b7ca2a5cd3b tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:31.348322 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d7006656-d2f0-4c9d-ae77-a796893e0b4b tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:31.348498 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-61109322-5b12-45ac-9884-0b7ca2a5cd3b tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:31.348730 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d7006656-d2f0-4c9d-ae77-a796893e0b4b tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:31.348922 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-61109322-5b12-45ac-9884-0b7ca2a5cd3b tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:31.349599 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-61109322-5b12-45ac-9884-0b7ca2a5cd3b tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:31.350042 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-61109322-5b12-45ac-9884-0b7ca2a5cd3b tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:31.350488 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-61109322-5b12-45ac-9884-0b7ca2a5cd3b tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:31.539879 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-61109322-5b12-45ac-9884-0b7ca2a5cd3b tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:31.543620 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-d7006656-d2f0-4c9d-ae77-a796893e0b4b tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acafe7ed414c87a5ca235b96047aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf4e20a59f147afb4f036fc8d04adb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:31.548344 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-61109322-5b12-45ac-9884-0b7ca2a5cd3b tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1" status: 200 len: 1372 microversion: 2.1 time: 0.210583 Sep 27 17:27:31.548919 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 230/435] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:31 2022] GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1 => generated 1372 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:27:31.551280 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-d7006656-d2f0-4c9d-ae77-a796893e0b4b tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b" status: 200 len: 1357 microversion: 2.1 time: 0.216657 Sep 27 17:27:31.551940 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 206/436] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:31 2022] GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b => generated 1357 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:27:32.571021 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-aa2dd9e6-5093-40e9-82c9-4a92bb76c430 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:32.571542 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-aa2dd9e6-5093-40e9-82c9-4a92bb76c430 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:32.572522 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-97c71728-2553-487d-9a3b-9f507c3ba4f1 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:32.573131 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-97c71728-2553-487d-9a3b-9f507c3ba4f1 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:32.577590 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-aa2dd9e6-5093-40e9-82c9-4a92bb76c430 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:32.578098 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-aa2dd9e6-5093-40e9-82c9-4a92bb76c430 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:32.578538 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-aa2dd9e6-5093-40e9-82c9-4a92bb76c430 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:32.579235 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-aa2dd9e6-5093-40e9-82c9-4a92bb76c430 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:32.579464 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-97c71728-2553-487d-9a3b-9f507c3ba4f1 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:32.579711 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-aa2dd9e6-5093-40e9-82c9-4a92bb76c430 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:32.579935 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-97c71728-2553-487d-9a3b-9f507c3ba4f1 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:32.580178 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-aa2dd9e6-5093-40e9-82c9-4a92bb76c430 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:32.580376 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-97c71728-2553-487d-9a3b-9f507c3ba4f1 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:32.581039 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-97c71728-2553-487d-9a3b-9f507c3ba4f1 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:32.581481 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-97c71728-2553-487d-9a3b-9f507c3ba4f1 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:32.581893 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-97c71728-2553-487d-9a3b-9f507c3ba4f1 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:32.777973 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-97c71728-2553-487d-9a3b-9f507c3ba4f1 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acafe7ed414c87a5ca235b96047aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf4e20a59f147afb4f036fc8d04adb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:32.781870 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-aa2dd9e6-5093-40e9-82c9-4a92bb76c430 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:32.785716 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-97c71728-2553-487d-9a3b-9f507c3ba4f1 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b" status: 200 len: 1357 microversion: 2.1 time: 0.217016 Sep 27 17:27:32.786324 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 207/437] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:32 2022] GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b => generated 1357 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:27:32.789625 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-aa2dd9e6-5093-40e9-82c9-4a92bb76c430 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1" status: 200 len: 1372 microversion: 2.1 time: 0.222588 Sep 27 17:27:32.790763 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 231/438] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:32 2022] GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1 => generated 1372 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:27:33.809231 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-df731119-a6be-4b4e-a7c4-bfd49028f05a tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:33.809747 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-df731119-a6be-4b4e-a7c4-bfd49028f05a tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:33.812445 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-b90a03f4-646c-4a38-a2fc-9daa994798b8 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:33.813088 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-b90a03f4-646c-4a38-a2fc-9daa994798b8 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:33.816095 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-df731119-a6be-4b4e-a7c4-bfd49028f05a tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:33.816568 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-df731119-a6be-4b4e-a7c4-bfd49028f05a tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:33.817006 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-df731119-a6be-4b4e-a7c4-bfd49028f05a tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:33.817670 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-df731119-a6be-4b4e-a7c4-bfd49028f05a tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:33.818142 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-df731119-a6be-4b4e-a7c4-bfd49028f05a tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:33.818572 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-df731119-a6be-4b4e-a7c4-bfd49028f05a tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:33.818964 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b90a03f4-646c-4a38-a2fc-9daa994798b8 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:33.819436 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b90a03f4-646c-4a38-a2fc-9daa994798b8 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:33.819867 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b90a03f4-646c-4a38-a2fc-9daa994798b8 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:33.820549 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b90a03f4-646c-4a38-a2fc-9daa994798b8 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:33.821147 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b90a03f4-646c-4a38-a2fc-9daa994798b8 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:33.822131 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b90a03f4-646c-4a38-a2fc-9daa994798b8 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:34.008008 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-b90a03f4-646c-4a38-a2fc-9daa994798b8 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:34.012000 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-df731119-a6be-4b4e-a7c4-bfd49028f05a tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acafe7ed414c87a5ca235b96047aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf4e20a59f147afb4f036fc8d04adb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:34.015739 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-b90a03f4-646c-4a38-a2fc-9daa994798b8 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1" status: 200 len: 1372 microversion: 2.1 time: 0.207064 Sep 27 17:27:34.016314 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 232/439] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:33 2022] GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1 => generated 1372 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:27:34.019603 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-df731119-a6be-4b4e-a7c4-bfd49028f05a tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b" status: 200 len: 1357 microversion: 2.1 time: 0.214799 Sep 27 17:27:34.020155 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 208/440] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:33 2022] GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b => generated 1357 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:27:35.038802 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-3ad05970-2544-4730-9c6b-721eac15d949 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:35.039433 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-3ad05970-2544-4730-9c6b-721eac15d949 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:35.042158 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-4344ac02-aad5-4434-a379-ce03305c121a tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:35.042975 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-4344ac02-aad5-4434-a379-ce03305c121a tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:35.046920 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3ad05970-2544-4730-9c6b-721eac15d949 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:35.047414 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3ad05970-2544-4730-9c6b-721eac15d949 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:35.047855 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3ad05970-2544-4730-9c6b-721eac15d949 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:35.048560 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3ad05970-2544-4730-9c6b-721eac15d949 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:35.049024 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3ad05970-2544-4730-9c6b-721eac15d949 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:35.049449 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3ad05970-2544-4730-9c6b-721eac15d949 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:35.050018 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4344ac02-aad5-4434-a379-ce03305c121a tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:35.050535 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4344ac02-aad5-4434-a379-ce03305c121a tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:35.050976 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4344ac02-aad5-4434-a379-ce03305c121a tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:35.051663 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4344ac02-aad5-4434-a379-ce03305c121a tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:35.052113 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4344ac02-aad5-4434-a379-ce03305c121a tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:35.052625 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4344ac02-aad5-4434-a379-ce03305c121a tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:35.056581 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell1:SELECT=100 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:27:35.239506 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-3ad05970-2544-4730-9c6b-721eac15d949 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:35.244087 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-4344ac02-aad5-4434-a379-ce03305c121a tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acafe7ed414c87a5ca235b96047aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf4e20a59f147afb4f036fc8d04adb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:35.247699 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-3ad05970-2544-4730-9c6b-721eac15d949 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1" status: 200 len: 1372 microversion: 2.1 time: 0.213066 Sep 27 17:27:35.248273 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 233/441] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:35 2022] GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1 => generated 1372 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:27:35.251721 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-4344ac02-aad5-4434-a379-ce03305c121a tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b" status: 200 len: 1357 microversion: 2.1 time: 0.213598 Sep 27 17:27:35.252279 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 209/442] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:35 2022] GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b => generated 1357 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:27:36.271589 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-98e13685-91f5-4b89-a525-8ea9fec62357 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:36.272240 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-98e13685-91f5-4b89-a525-8ea9fec62357 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:36.273963 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-7b5e20c6-147b-45a5-9d4a-6d0bc0600e0b tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:36.275188 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-7b5e20c6-147b-45a5-9d4a-6d0bc0600e0b tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:36.278891 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-98e13685-91f5-4b89-a525-8ea9fec62357 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:36.279371 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-98e13685-91f5-4b89-a525-8ea9fec62357 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:36.279807 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-98e13685-91f5-4b89-a525-8ea9fec62357 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:36.280529 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-98e13685-91f5-4b89-a525-8ea9fec62357 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:36.280981 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-98e13685-91f5-4b89-a525-8ea9fec62357 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:36.281281 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7b5e20c6-147b-45a5-9d4a-6d0bc0600e0b tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:36.281402 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-98e13685-91f5-4b89-a525-8ea9fec62357 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:36.281762 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7b5e20c6-147b-45a5-9d4a-6d0bc0600e0b tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:36.282226 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7b5e20c6-147b-45a5-9d4a-6d0bc0600e0b tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:36.282921 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7b5e20c6-147b-45a5-9d4a-6d0bc0600e0b tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:36.283392 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7b5e20c6-147b-45a5-9d4a-6d0bc0600e0b tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:36.283814 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7b5e20c6-147b-45a5-9d4a-6d0bc0600e0b tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:36.474763 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-98e13685-91f5-4b89-a525-8ea9fec62357 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:36.478036 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-7b5e20c6-147b-45a5-9d4a-6d0bc0600e0b tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acafe7ed414c87a5ca235b96047aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf4e20a59f147afb4f036fc8d04adb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:36.482925 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-98e13685-91f5-4b89-a525-8ea9fec62357 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1" status: 200 len: 1372 microversion: 2.1 time: 0.215231 Sep 27 17:27:36.483508 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 234/443] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:36 2022] GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1 => generated 1372 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:27:36.490011 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-7b5e20c6-147b-45a5-9d4a-6d0bc0600e0b tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b" status: 200 len: 1357 microversion: 2.1 time: 0.219773 Sep 27 17:27:36.490797 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 210/444] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:36 2022] GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b => generated 1357 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:27:37.505760 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-79ae5bf4-b9c4-4bc4-958c-5277023e8286 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:37.506345 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-79ae5bf4-b9c4-4bc4-958c-5277023e8286 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:37.512356 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-79ae5bf4-b9c4-4bc4-958c-5277023e8286 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:37.512709 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-1f1920c7-1c7b-4181-9923-a61bda4252bc tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:37.513115 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-79ae5bf4-b9c4-4bc4-958c-5277023e8286 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:37.513266 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-79ae5bf4-b9c4-4bc4-958c-5277023e8286 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:37.513380 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-1f1920c7-1c7b-4181-9923-a61bda4252bc tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:37.513957 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-79ae5bf4-b9c4-4bc4-958c-5277023e8286 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:37.514447 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-79ae5bf4-b9c4-4bc4-958c-5277023e8286 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:37.514874 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-79ae5bf4-b9c4-4bc4-958c-5277023e8286 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:37.519798 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1f1920c7-1c7b-4181-9923-a61bda4252bc tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:37.520288 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1f1920c7-1c7b-4181-9923-a61bda4252bc tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:37.520737 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1f1920c7-1c7b-4181-9923-a61bda4252bc tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:37.521417 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1f1920c7-1c7b-4181-9923-a61bda4252bc tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:37.521874 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1f1920c7-1c7b-4181-9923-a61bda4252bc tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:37.522325 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1f1920c7-1c7b-4181-9923-a61bda4252bc tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:37.713969 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-79ae5bf4-b9c4-4bc4-958c-5277023e8286 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:37.717734 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-1f1920c7-1c7b-4181-9923-a61bda4252bc tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acafe7ed414c87a5ca235b96047aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf4e20a59f147afb4f036fc8d04adb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:37.722100 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-79ae5bf4-b9c4-4bc4-958c-5277023e8286 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1" status: 200 len: 1372 microversion: 2.1 time: 0.220241 Sep 27 17:27:37.723256 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 235/445] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:37 2022] GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1 => generated 1372 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:27:37.725674 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-1f1920c7-1c7b-4181-9923-a61bda4252bc tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b" status: 200 len: 1357 microversion: 2.1 time: 0.216778 Sep 27 17:27:37.726442 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 211/446] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:37 2022] GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b => generated 1357 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:27:38.745237 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-2ab0d073-ab9d-491b-9d47-8053f78eaec7 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:38.745848 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-2ab0d073-ab9d-491b-9d47-8053f78eaec7 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:38.749425 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-485336fc-75e7-4539-ae35-ef32a3136f5a tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:38.750039 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-485336fc-75e7-4539-ae35-ef32a3136f5a tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:38.752124 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-2ab0d073-ab9d-491b-9d47-8053f78eaec7 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:38.752695 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-2ab0d073-ab9d-491b-9d47-8053f78eaec7 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:38.753025 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-2ab0d073-ab9d-491b-9d47-8053f78eaec7 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:38.753720 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-2ab0d073-ab9d-491b-9d47-8053f78eaec7 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:38.754202 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-2ab0d073-ab9d-491b-9d47-8053f78eaec7 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:38.754630 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-2ab0d073-ab9d-491b-9d47-8053f78eaec7 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:38.759706 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-485336fc-75e7-4539-ae35-ef32a3136f5a tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:38.760422 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-485336fc-75e7-4539-ae35-ef32a3136f5a tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:38.760933 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-485336fc-75e7-4539-ae35-ef32a3136f5a tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:38.761850 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-485336fc-75e7-4539-ae35-ef32a3136f5a tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:38.762412 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-485336fc-75e7-4539-ae35-ef32a3136f5a tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:38.762837 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-485336fc-75e7-4539-ae35-ef32a3136f5a tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:38.946480 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-2ab0d073-ab9d-491b-9d47-8053f78eaec7 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:38.954265 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-2ab0d073-ab9d-491b-9d47-8053f78eaec7 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1" status: 200 len: 1372 microversion: 2.1 time: 0.213337 Sep 27 17:27:38.954716 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 236/447] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:38 2022] GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1 => generated 1372 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:27:38.957844 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-485336fc-75e7-4539-ae35-ef32a3136f5a tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acafe7ed414c87a5ca235b96047aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf4e20a59f147afb4f036fc8d04adb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:38.966958 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-485336fc-75e7-4539-ae35-ef32a3136f5a tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b" status: 200 len: 1357 microversion: 2.1 time: 0.221517 Sep 27 17:27:38.967755 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 212/448] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:38 2022] GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b => generated 1357 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:27:39.976636 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-5bffa8fa-406d-4fb5-8da0-6db60fff8c0f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:39.977734 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-5bffa8fa-406d-4fb5-8da0-6db60fff8c0f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:39.984030 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5bffa8fa-406d-4fb5-8da0-6db60fff8c0f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:39.984531 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5bffa8fa-406d-4fb5-8da0-6db60fff8c0f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:39.984961 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5bffa8fa-406d-4fb5-8da0-6db60fff8c0f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:39.985640 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5bffa8fa-406d-4fb5-8da0-6db60fff8c0f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:39.986107 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5bffa8fa-406d-4fb5-8da0-6db60fff8c0f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:39.986524 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5bffa8fa-406d-4fb5-8da0-6db60fff8c0f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:39.990710 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-23d86806-ed01-43ca-9ab2-0a7e431dc3a5 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:39.991319 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-23d86806-ed01-43ca-9ab2-0a7e431dc3a5 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:39.998564 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-23d86806-ed01-43ca-9ab2-0a7e431dc3a5 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:39.999045 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-23d86806-ed01-43ca-9ab2-0a7e431dc3a5 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:39.999483 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-23d86806-ed01-43ca-9ab2-0a7e431dc3a5 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:40.000179 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-23d86806-ed01-43ca-9ab2-0a7e431dc3a5 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:40.000642 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-23d86806-ed01-43ca-9ab2-0a7e431dc3a5 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:40.001064 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-23d86806-ed01-43ca-9ab2-0a7e431dc3a5 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:40.180085 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-5bffa8fa-406d-4fb5-8da0-6db60fff8c0f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:40.184583 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-23d86806-ed01-43ca-9ab2-0a7e431dc3a5 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acafe7ed414c87a5ca235b96047aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf4e20a59f147afb4f036fc8d04adb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:40.188636 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-5bffa8fa-406d-4fb5-8da0-6db60fff8c0f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1" status: 200 len: 1372 microversion: 2.1 time: 0.215848 Sep 27 17:27:40.189288 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 237/449] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:39 2022] GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1 => generated 1372 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:27:40.192121 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-23d86806-ed01-43ca-9ab2-0a7e431dc3a5 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b" status: 200 len: 1357 microversion: 2.1 time: 0.205177 Sep 27 17:27:40.192726 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 213/450] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:39 2022] GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b => generated 1357 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:27:41.212118 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-5c9be249-b54b-4e94-bd6c-3c78dd528470 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:41.212735 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-5c9be249-b54b-4e94-bd6c-3c78dd528470 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:41.215074 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-b858e317-660f-43da-b4b6-4996d3e51153 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:41.215684 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-b858e317-660f-43da-b4b6-4996d3e51153 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:41.218737 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5c9be249-b54b-4e94-bd6c-3c78dd528470 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:41.219222 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5c9be249-b54b-4e94-bd6c-3c78dd528470 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:41.219657 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5c9be249-b54b-4e94-bd6c-3c78dd528470 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:41.220348 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5c9be249-b54b-4e94-bd6c-3c78dd528470 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:41.220800 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5c9be249-b54b-4e94-bd6c-3c78dd528470 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:41.221226 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5c9be249-b54b-4e94-bd6c-3c78dd528470 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:41.222326 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b858e317-660f-43da-b4b6-4996d3e51153 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:41.222805 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b858e317-660f-43da-b4b6-4996d3e51153 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:41.223241 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b858e317-660f-43da-b4b6-4996d3e51153 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:41.224107 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b858e317-660f-43da-b4b6-4996d3e51153 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:41.224562 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b858e317-660f-43da-b4b6-4996d3e51153 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:41.225003 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b858e317-660f-43da-b4b6-4996d3e51153 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:41.413952 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-5c9be249-b54b-4e94-bd6c-3c78dd528470 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:41.418154 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-b858e317-660f-43da-b4b6-4996d3e51153 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acafe7ed414c87a5ca235b96047aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf4e20a59f147afb4f036fc8d04adb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:41.422958 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-5c9be249-b54b-4e94-bd6c-3c78dd528470 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1" status: 200 len: 1372 microversion: 2.1 time: 0.215124 Sep 27 17:27:41.423720 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 238/451] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:41 2022] GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1 => generated 1372 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:27:41.426550 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-b858e317-660f-43da-b4b6-4996d3e51153 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b" status: 200 len: 1357 microversion: 2.1 time: 0.215674 Sep 27 17:27:41.426966 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 214/452] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:41 2022] GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b => generated 1357 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:27:42.445583 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-963586aa-9dbc-4e07-ae39-d5a60a1a5973 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:42.446229 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-963586aa-9dbc-4e07-ae39-d5a60a1a5973 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:42.448512 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-441a0100-50fd-41ff-ab96-8b910507730e tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:42.449117 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-441a0100-50fd-41ff-ab96-8b910507730e tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:42.452435 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-963586aa-9dbc-4e07-ae39-d5a60a1a5973 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:42.452651 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-963586aa-9dbc-4e07-ae39-d5a60a1a5973 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:42.453051 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-963586aa-9dbc-4e07-ae39-d5a60a1a5973 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:42.453751 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-963586aa-9dbc-4e07-ae39-d5a60a1a5973 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:42.454241 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-963586aa-9dbc-4e07-ae39-d5a60a1a5973 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:42.455032 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-963586aa-9dbc-4e07-ae39-d5a60a1a5973 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:42.456445 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-441a0100-50fd-41ff-ab96-8b910507730e tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:42.456928 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-441a0100-50fd-41ff-ab96-8b910507730e tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:42.457446 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-441a0100-50fd-41ff-ab96-8b910507730e tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:42.458033 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-441a0100-50fd-41ff-ab96-8b910507730e tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:42.458505 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-441a0100-50fd-41ff-ab96-8b910507730e tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:42.460184 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-441a0100-50fd-41ff-ab96-8b910507730e tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:42.658558 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-963586aa-9dbc-4e07-ae39-d5a60a1a5973 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:42.662399 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-441a0100-50fd-41ff-ab96-8b910507730e tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acafe7ed414c87a5ca235b96047aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf4e20a59f147afb4f036fc8d04adb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:42.667547 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-963586aa-9dbc-4e07-ae39-d5a60a1a5973 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1" status: 200 len: 1372 microversion: 2.1 time: 0.225752 Sep 27 17:27:42.668130 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 239/453] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:42 2022] GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1 => generated 1372 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:27:42.670755 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-441a0100-50fd-41ff-ab96-8b910507730e tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b" status: 200 len: 1357 microversion: 2.1 time: 0.226067 Sep 27 17:27:42.671320 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 215/454] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:42 2022] GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b => generated 1357 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:27:43.689744 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-bc995a8e-85f3-4ba9-939b-4dde43d01564 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:43.690365 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-bc995a8e-85f3-4ba9-939b-4dde43d01564 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:43.692451 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-25b4fcc3-c956-4887-b65d-4ffd54bc05ba tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:43.693052 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-25b4fcc3-c956-4887-b65d-4ffd54bc05ba tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:43.697268 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-bc995a8e-85f3-4ba9-939b-4dde43d01564 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:43.697751 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-bc995a8e-85f3-4ba9-939b-4dde43d01564 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:43.698212 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-bc995a8e-85f3-4ba9-939b-4dde43d01564 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:43.698916 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-bc995a8e-85f3-4ba9-939b-4dde43d01564 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:43.699370 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-bc995a8e-85f3-4ba9-939b-4dde43d01564 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:43.699791 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-bc995a8e-85f3-4ba9-939b-4dde43d01564 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:43.700276 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-25b4fcc3-c956-4887-b65d-4ffd54bc05ba tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:43.700995 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-25b4fcc3-c956-4887-b65d-4ffd54bc05ba tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:43.701183 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-25b4fcc3-c956-4887-b65d-4ffd54bc05ba tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:43.701916 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-25b4fcc3-c956-4887-b65d-4ffd54bc05ba tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:43.702404 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-25b4fcc3-c956-4887-b65d-4ffd54bc05ba tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:43.702830 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-25b4fcc3-c956-4887-b65d-4ffd54bc05ba tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:44.148401 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-bc995a8e-85f3-4ba9-939b-4dde43d01564 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:44.151606 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-25b4fcc3-c956-4887-b65d-4ffd54bc05ba tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acafe7ed414c87a5ca235b96047aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf4e20a59f147afb4f036fc8d04adb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:44.156183 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-bc995a8e-85f3-4ba9-939b-4dde43d01564 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1" status: 200 len: 1372 microversion: 2.1 time: 0.470514 Sep 27 17:27:44.156756 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 240/455] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:43 2022] GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1 => generated 1372 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:27:44.159313 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-25b4fcc3-c956-4887-b65d-4ffd54bc05ba tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b" status: 200 len: 1357 microversion: 2.1 time: 0.470620 Sep 27 17:27:44.159857 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 216/456] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:43 2022] GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b => generated 1357 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:27:45.180786 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-276e85ec-7a16-4edb-bf2e-d00efc2c43a7 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:45.181403 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-276e85ec-7a16-4edb-bf2e-d00efc2c43a7 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:45.183877 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_api:SELECT=60 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:27:45.198101 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-5a727077-b314-40b7-895a-c3d276bfbb91 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:45.198101 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-5a727077-b314-40b7-895a-c3d276bfbb91 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:45.198864 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-276e85ec-7a16-4edb-bf2e-d00efc2c43a7 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:45.198864 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-276e85ec-7a16-4edb-bf2e-d00efc2c43a7 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:45.198864 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-276e85ec-7a16-4edb-bf2e-d00efc2c43a7 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:45.198864 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-276e85ec-7a16-4edb-bf2e-d00efc2c43a7 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:45.199247 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-276e85ec-7a16-4edb-bf2e-d00efc2c43a7 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:45.199353 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-276e85ec-7a16-4edb-bf2e-d00efc2c43a7 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:45.208866 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5a727077-b314-40b7-895a-c3d276bfbb91 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:45.209361 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5a727077-b314-40b7-895a-c3d276bfbb91 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:45.209855 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5a727077-b314-40b7-895a-c3d276bfbb91 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:45.210586 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5a727077-b314-40b7-895a-c3d276bfbb91 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:45.211040 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5a727077-b314-40b7-895a-c3d276bfbb91 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:45.211534 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5a727077-b314-40b7-895a-c3d276bfbb91 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:45.397946 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-5a727077-b314-40b7-895a-c3d276bfbb91 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acafe7ed414c87a5ca235b96047aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf4e20a59f147afb4f036fc8d04adb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:45.405956 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-276e85ec-7a16-4edb-bf2e-d00efc2c43a7 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:45.406168 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-5a727077-b314-40b7-895a-c3d276bfbb91 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b" status: 200 len: 1357 microversion: 2.1 time: 0.219464 Sep 27 17:27:45.406823 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 217/457] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:45 2022] GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b => generated 1357 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:27:45.419001 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-276e85ec-7a16-4edb-bf2e-d00efc2c43a7 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1" status: 200 len: 1372 microversion: 2.1 time: 0.243717 Sep 27 17:27:45.419593 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 241/458] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:45 2022] GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1 => generated 1372 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:27:46.428574 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-b79bb986-debc-4f86-baa0-e57091897d3e tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:46.429304 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-b79bb986-debc-4f86-baa0-e57091897d3e tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:46.436604 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b79bb986-debc-4f86-baa0-e57091897d3e tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:46.436980 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b79bb986-debc-4f86-baa0-e57091897d3e tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:46.437412 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b79bb986-debc-4f86-baa0-e57091897d3e tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:46.438128 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b79bb986-debc-4f86-baa0-e57091897d3e tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:46.438840 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b79bb986-debc-4f86-baa0-e57091897d3e tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:46.439273 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b79bb986-debc-4f86-baa0-e57091897d3e tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:46.444007 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-11151837-9b1c-48de-b803-fba7d1ccd8e5 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:46.444656 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-11151837-9b1c-48de-b803-fba7d1ccd8e5 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:46.451323 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-11151837-9b1c-48de-b803-fba7d1ccd8e5 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:46.451808 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-11151837-9b1c-48de-b803-fba7d1ccd8e5 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:46.452245 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-11151837-9b1c-48de-b803-fba7d1ccd8e5 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:46.452944 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-11151837-9b1c-48de-b803-fba7d1ccd8e5 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:46.453402 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-11151837-9b1c-48de-b803-fba7d1ccd8e5 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:46.453829 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-11151837-9b1c-48de-b803-fba7d1ccd8e5 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:46.639532 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-b79bb986-debc-4f86-baa0-e57091897d3e tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acafe7ed414c87a5ca235b96047aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf4e20a59f147afb4f036fc8d04adb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:46.642670 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-11151837-9b1c-48de-b803-fba7d1ccd8e5 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:46.647093 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-b79bb986-debc-4f86-baa0-e57091897d3e tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b" status: 200 len: 1357 microversion: 2.1 time: 0.222296 Sep 27 17:27:46.647660 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 218/459] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:46 2022] GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b => generated 1357 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:27:46.650763 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-11151837-9b1c-48de-b803-fba7d1ccd8e5 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1" status: 200 len: 1372 microversion: 2.1 time: 0.210589 Sep 27 17:27:46.653964 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 242/460] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:46 2022] GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1 => generated 1372 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:27:47.671133 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-d24a323e-dd5e-43ef-ba7c-b4a00628f0a6 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:47.671732 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-d24a323e-dd5e-43ef-ba7c-b4a00628f0a6 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:47.673030 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-dc6be1f8-15d6-4a09-af50-14b835c7737a tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:47.673647 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-dc6be1f8-15d6-4a09-af50-14b835c7737a tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:47.674026 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_api:SELECT=58 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:27:47.679174 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d24a323e-dd5e-43ef-ba7c-b4a00628f0a6 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:47.679646 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d24a323e-dd5e-43ef-ba7c-b4a00628f0a6 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:47.680030 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-dc6be1f8-15d6-4a09-af50-14b835c7737a tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:47.680153 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d24a323e-dd5e-43ef-ba7c-b4a00628f0a6 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:47.680516 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-dc6be1f8-15d6-4a09-af50-14b835c7737a tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:47.680738 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d24a323e-dd5e-43ef-ba7c-b4a00628f0a6 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:47.680952 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-dc6be1f8-15d6-4a09-af50-14b835c7737a tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:47.681180 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d24a323e-dd5e-43ef-ba7c-b4a00628f0a6 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:47.681593 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d24a323e-dd5e-43ef-ba7c-b4a00628f0a6 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:47.681689 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-dc6be1f8-15d6-4a09-af50-14b835c7737a tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:47.682210 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-dc6be1f8-15d6-4a09-af50-14b835c7737a tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:47.682643 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-dc6be1f8-15d6-4a09-af50-14b835c7737a tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:47.905441 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-d24a323e-dd5e-43ef-ba7c-b4a00628f0a6 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acafe7ed414c87a5ca235b96047aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf4e20a59f147afb4f036fc8d04adb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:47.912989 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-d24a323e-dd5e-43ef-ba7c-b4a00628f0a6 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b" status: 200 len: 1357 microversion: 2.1 time: 0.246012 Sep 27 17:27:47.916038 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-dc6be1f8-15d6-4a09-af50-14b835c7737a tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:47.918439 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 219/461] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:47 2022] GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b => generated 1357 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:27:47.924654 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-dc6be1f8-15d6-4a09-af50-14b835c7737a tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1" status: 200 len: 1372 microversion: 2.1 time: 0.255391 Sep 27 17:27:47.925772 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 243/462] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:47 2022] GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1 => generated 1372 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:27:48.531061 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [req-2a3ca18c-e14b-4abd-8a23-71ae81b11e51 req-3a404453-1423-4d7d-a6e1-874fca86e102 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca74fda8-afd6-41f2-8c93-5e8971c645f1", "tag": "4f5f0e59-cdc1-4e3d-9aac-a193fec519cd"}]} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:27:48.540896 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-2a3ca18c-e14b-4abd-8a23-71ae81b11e51 req-3a404453-1423-4d7d-a6e1-874fca86e102 service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:48.541380 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-2a3ca18c-e14b-4abd-8a23-71ae81b11e51 req-3a404453-1423-4d7d-a6e1-874fca86e102 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:48.541813 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-2a3ca18c-e14b-4abd-8a23-71ae81b11e51 req-3a404453-1423-4d7d-a6e1-874fca86e102 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:48.552587 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.compute.server_external_events [req-2a3ca18c-e14b-4abd-8a23-71ae81b11e51 req-3a404453-1423-4d7d-a6e1-874fca86e102 service nova] Creating event network-changed:4f5f0e59-cdc1-4e3d-9aac-a193fec519cd for instance ca74fda8-afd6-41f2-8c93-5e8971c645f1 on hv-cinder-84914 Sep 27 17:27:48.560018 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [req-2a3ca18c-e14b-4abd-8a23-71ae81b11e51 req-3a404453-1423-4d7d-a6e1-874fca86e102 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031800 Sep 27 17:27:48.560840 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 220/463] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:27:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 17:27:48.937591 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-7e1fb62f-6e01-40ce-a5c3-54362a19c4a4 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:48.938308 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-7e1fb62f-6e01-40ce-a5c3-54362a19c4a4 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:48.947454 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7e1fb62f-6e01-40ce-a5c3-54362a19c4a4 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:48.949241 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7e1fb62f-6e01-40ce-a5c3-54362a19c4a4 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:48.949861 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7e1fb62f-6e01-40ce-a5c3-54362a19c4a4 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:48.950762 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7e1fb62f-6e01-40ce-a5c3-54362a19c4a4 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:48.951214 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7e1fb62f-6e01-40ce-a5c3-54362a19c4a4 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:48.951846 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7e1fb62f-6e01-40ce-a5c3-54362a19c4a4 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:48.952058 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-b4a53f76-5f93-4b5d-b0fc-f270cc378cd1 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:48.952746 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-b4a53f76-5f93-4b5d-b0fc-f270cc378cd1 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:48.960810 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b4a53f76-5f93-4b5d-b0fc-f270cc378cd1 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:48.962239 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b4a53f76-5f93-4b5d-b0fc-f270cc378cd1 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:48.962676 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b4a53f76-5f93-4b5d-b0fc-f270cc378cd1 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:48.963367 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b4a53f76-5f93-4b5d-b0fc-f270cc378cd1 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:48.963809 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b4a53f76-5f93-4b5d-b0fc-f270cc378cd1 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:48.964563 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b4a53f76-5f93-4b5d-b0fc-f270cc378cd1 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:49.166335 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-7e1fb62f-6e01-40ce-a5c3-54362a19c4a4 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acafe7ed414c87a5ca235b96047aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf4e20a59f147afb4f036fc8d04adb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:49.173520 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-b4a53f76-5f93-4b5d-b0fc-f270cc378cd1 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:49.177420 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-7e1fb62f-6e01-40ce-a5c3-54362a19c4a4 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b" status: 200 len: 1357 microversion: 2.1 time: 0.243907 Sep 27 17:27:49.178003 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 244/464] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:48 2022] GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b => generated 1357 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:27:49.196409 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-b4a53f76-5f93-4b5d-b0fc-f270cc378cd1 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1" status: 200 len: 1372 microversion: 2.1 time: 0.251438 Sep 27 17:27:49.196987 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 221/465] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:48 2022] GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1 => generated 1372 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:27:49.964911 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [req-e3ed088a-8668-49c8-8fb7-caa1fc2d40f4 req-e7196ee3-42a9-473e-8a09-ecb0bdf5a8a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7c9bb60-e05b-4527-aa2f-bc6a3c55306b", "name": "network-vif-plugged", "status": "completed", "tag": "9d1590c2-6fed-40c4-8aca-ed18ef3c13df"}]} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:27:49.975972 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-e3ed088a-8668-49c8-8fb7-caa1fc2d40f4 req-e7196ee3-42a9-473e-8a09-ecb0bdf5a8a0 service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:49.976440 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-e3ed088a-8668-49c8-8fb7-caa1fc2d40f4 req-e7196ee3-42a9-473e-8a09-ecb0bdf5a8a0 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:49.977656 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-e3ed088a-8668-49c8-8fb7-caa1fc2d40f4 req-e7196ee3-42a9-473e-8a09-ecb0bdf5a8a0 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:49.992397 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.compute.server_external_events [req-e3ed088a-8668-49c8-8fb7-caa1fc2d40f4 req-e7196ee3-42a9-473e-8a09-ecb0bdf5a8a0 service nova] Creating event network-vif-plugged:9d1590c2-6fed-40c4-8aca-ed18ef3c13df for instance d7c9bb60-e05b-4527-aa2f-bc6a3c55306b on hv-cinder-84914 Sep 27 17:27:49.998735 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [req-e3ed088a-8668-49c8-8fb7-caa1fc2d40f4 req-e7196ee3-42a9-473e-8a09-ecb0bdf5a8a0 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041677 Sep 27 17:27:49.999699 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 245/466] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:27:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:27:50.201313 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-0ae9a4ef-cac2-4390-a216-a72baa4b85d9 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:50.201843 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-0ae9a4ef-cac2-4390-a216-a72baa4b85d9 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:50.208335 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0ae9a4ef-cac2-4390-a216-a72baa4b85d9 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:50.208844 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0ae9a4ef-cac2-4390-a216-a72baa4b85d9 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:50.209292 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0ae9a4ef-cac2-4390-a216-a72baa4b85d9 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:50.209957 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0ae9a4ef-cac2-4390-a216-a72baa4b85d9 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:50.210436 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0ae9a4ef-cac2-4390-a216-a72baa4b85d9 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:50.210855 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0ae9a4ef-cac2-4390-a216-a72baa4b85d9 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:50.223774 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-8a738702-4daa-4970-9b1c-bfe45d5578c3 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:50.224472 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-8a738702-4daa-4970-9b1c-bfe45d5578c3 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:50.230840 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8a738702-4daa-4970-9b1c-bfe45d5578c3 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:50.231332 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8a738702-4daa-4970-9b1c-bfe45d5578c3 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:50.231767 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8a738702-4daa-4970-9b1c-bfe45d5578c3 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:50.232460 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8a738702-4daa-4970-9b1c-bfe45d5578c3 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:50.232913 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8a738702-4daa-4970-9b1c-bfe45d5578c3 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:50.233334 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8a738702-4daa-4970-9b1c-bfe45d5578c3 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:50.422864 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-0ae9a4ef-cac2-4390-a216-a72baa4b85d9 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acafe7ed414c87a5ca235b96047aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf4e20a59f147afb4f036fc8d04adb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:50.426774 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-8a738702-4daa-4970-9b1c-bfe45d5578c3 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:50.429241 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_cell1:SELECT=100 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:27:50.431705 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-0ae9a4ef-cac2-4390-a216-a72baa4b85d9 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b" status: 200 len: 1357 microversion: 2.1 time: 0.234248 Sep 27 17:27:50.432303 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 222/467] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:50 2022] GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b => generated 1357 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:27:50.444728 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-8a738702-4daa-4970-9b1c-bfe45d5578c3 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1" status: 200 len: 1372 microversion: 2.1 time: 0.225093 Sep 27 17:27:50.445299 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 246/468] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:50 2022] GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1 => generated 1372 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:27:51.455055 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-8318e852-a658-4820-ac7c-9da065d2e926 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:51.455693 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-8318e852-a658-4820-ac7c-9da065d2e926 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:51.463391 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8318e852-a658-4820-ac7c-9da065d2e926 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:51.463918 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8318e852-a658-4820-ac7c-9da065d2e926 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:51.464550 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8318e852-a658-4820-ac7c-9da065d2e926 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:51.465120 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8318e852-a658-4820-ac7c-9da065d2e926 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:51.465612 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8318e852-a658-4820-ac7c-9da065d2e926 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:51.466033 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8318e852-a658-4820-ac7c-9da065d2e926 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:51.468348 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-d362cfce-e9d1-4357-a3c4-7b0af6b51033 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:51.469061 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-d362cfce-e9d1-4357-a3c4-7b0af6b51033 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:51.474806 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d362cfce-e9d1-4357-a3c4-7b0af6b51033 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:51.475287 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d362cfce-e9d1-4357-a3c4-7b0af6b51033 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:51.475751 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d362cfce-e9d1-4357-a3c4-7b0af6b51033 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:51.476458 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d362cfce-e9d1-4357-a3c4-7b0af6b51033 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:51.476903 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d362cfce-e9d1-4357-a3c4-7b0af6b51033 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:51.477326 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d362cfce-e9d1-4357-a3c4-7b0af6b51033 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:51.668367 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-8318e852-a658-4820-ac7c-9da065d2e926 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acafe7ed414c87a5ca235b96047aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf4e20a59f147afb4f036fc8d04adb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:51.671499 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-d362cfce-e9d1-4357-a3c4-7b0af6b51033 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:51.676310 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-8318e852-a658-4820-ac7c-9da065d2e926 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b" status: 200 len: 1357 microversion: 2.1 time: 0.225288 Sep 27 17:27:51.677209 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 223/469] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:51 2022] GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b => generated 1357 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:27:51.682104 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-d362cfce-e9d1-4357-a3c4-7b0af6b51033 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1" status: 200 len: 1372 microversion: 2.1 time: 0.217846 Sep 27 17:27:51.682680 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 247/470] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:51 2022] GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1 => generated 1372 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:27:52.701920 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-e3061634-11ba-4cf5-8081-243a3e561efc tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:52.702584 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-e3061634-11ba-4cf5-8081-243a3e561efc tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:52.704555 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-422ded11-2bfa-4efd-ab1c-4915fda6de18 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:52.705168 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-422ded11-2bfa-4efd-ab1c-4915fda6de18 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:52.708962 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e3061634-11ba-4cf5-8081-243a3e561efc tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:52.709447 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e3061634-11ba-4cf5-8081-243a3e561efc tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:52.709887 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e3061634-11ba-4cf5-8081-243a3e561efc tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:52.710613 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e3061634-11ba-4cf5-8081-243a3e561efc tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:52.711009 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-422ded11-2bfa-4efd-ab1c-4915fda6de18 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:52.711757 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e3061634-11ba-4cf5-8081-243a3e561efc tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:52.712064 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-422ded11-2bfa-4efd-ab1c-4915fda6de18 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:52.712201 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e3061634-11ba-4cf5-8081-243a3e561efc tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:52.712497 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-422ded11-2bfa-4efd-ab1c-4915fda6de18 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:52.713189 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-422ded11-2bfa-4efd-ab1c-4915fda6de18 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:52.713644 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-422ded11-2bfa-4efd-ab1c-4915fda6de18 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:52.714083 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-422ded11-2bfa-4efd-ab1c-4915fda6de18 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:52.903547 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-e3061634-11ba-4cf5-8081-243a3e561efc tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acafe7ed414c87a5ca235b96047aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf4e20a59f147afb4f036fc8d04adb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:52.907853 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-422ded11-2bfa-4efd-ab1c-4915fda6de18 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:52.911311 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-e3061634-11ba-4cf5-8081-243a3e561efc tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b" status: 200 len: 1357 microversion: 2.1 time: 0.213448 Sep 27 17:27:52.911877 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 224/471] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:52 2022] GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b => generated 1357 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:27:52.915819 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-422ded11-2bfa-4efd-ab1c-4915fda6de18 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1" status: 200 len: 1372 microversion: 2.1 time: 0.215028 Sep 27 17:27:52.916378 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 248/472] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:52 2022] GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1 => generated 1372 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:27:53.933298 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-54602cee-bdc2-4447-a446-a81f6137d24c tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:53.933918 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-54602cee-bdc2-4447-a446-a81f6137d24c tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:53.938712 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-1709ad03-04d7-419d-9bb1-3519a602b9b7 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:53.939323 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-1709ad03-04d7-419d-9bb1-3519a602b9b7 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:53.940570 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-54602cee-bdc2-4447-a446-a81f6137d24c tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:53.941052 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-54602cee-bdc2-4447-a446-a81f6137d24c tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:53.941487 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-54602cee-bdc2-4447-a446-a81f6137d24c tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:53.942267 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-54602cee-bdc2-4447-a446-a81f6137d24c tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:53.942768 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-54602cee-bdc2-4447-a446-a81f6137d24c tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:53.943194 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-54602cee-bdc2-4447-a446-a81f6137d24c tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:53.944961 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1709ad03-04d7-419d-9bb1-3519a602b9b7 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:53.945427 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1709ad03-04d7-419d-9bb1-3519a602b9b7 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:53.945856 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1709ad03-04d7-419d-9bb1-3519a602b9b7 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:53.946554 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1709ad03-04d7-419d-9bb1-3519a602b9b7 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:53.947001 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1709ad03-04d7-419d-9bb1-3519a602b9b7 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:53.947415 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1709ad03-04d7-419d-9bb1-3519a602b9b7 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:54.134283 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-54602cee-bdc2-4447-a446-a81f6137d24c tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acafe7ed414c87a5ca235b96047aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf4e20a59f147afb4f036fc8d04adb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:54.142960 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-54602cee-bdc2-4447-a446-a81f6137d24c tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b" status: 200 len: 1357 microversion: 2.1 time: 0.213580 Sep 27 17:27:54.143119 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-1709ad03-04d7-419d-9bb1-3519a602b9b7 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:54.143550 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 225/473] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:53 2022] GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b => generated 1357 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:27:54.151419 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-1709ad03-04d7-419d-9bb1-3519a602b9b7 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1" status: 200 len: 1372 microversion: 2.1 time: 0.216573 Sep 27 17:27:54.152013 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 249/474] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:53 2022] GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1 => generated 1372 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:27:55.166319 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-44ca159e-1fd1-4f76-8a2f-91bdaf12a235 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:55.166953 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-44ca159e-1fd1-4f76-8a2f-91bdaf12a235 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:55.173222 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-44ca159e-1fd1-4f76-8a2f-91bdaf12a235 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:55.173699 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-44ca159e-1fd1-4f76-8a2f-91bdaf12a235 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:55.173819 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-bbce1cb0-db68-47c4-b185-ab9d2a2f3947 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:55.174250 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-44ca159e-1fd1-4f76-8a2f-91bdaf12a235 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:55.174355 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-bbce1cb0-db68-47c4-b185-ab9d2a2f3947 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:55.174808 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-44ca159e-1fd1-4f76-8a2f-91bdaf12a235 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:55.175246 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-44ca159e-1fd1-4f76-8a2f-91bdaf12a235 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:55.175658 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-44ca159e-1fd1-4f76-8a2f-91bdaf12a235 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:55.180912 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-bbce1cb0-db68-47c4-b185-ab9d2a2f3947 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:55.181403 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-bbce1cb0-db68-47c4-b185-ab9d2a2f3947 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:55.181839 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-bbce1cb0-db68-47c4-b185-ab9d2a2f3947 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:55.182564 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-bbce1cb0-db68-47c4-b185-ab9d2a2f3947 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:55.183021 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-bbce1cb0-db68-47c4-b185-ab9d2a2f3947 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:55.183446 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-bbce1cb0-db68-47c4-b185-ab9d2a2f3947 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:55.194301 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell1:SELECT=100 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:27:55.364965 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-44ca159e-1fd1-4f76-8a2f-91bdaf12a235 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acafe7ed414c87a5ca235b96047aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf4e20a59f147afb4f036fc8d04adb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:55.368787 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-bbce1cb0-db68-47c4-b185-ab9d2a2f3947 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:55.372825 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-44ca159e-1fd1-4f76-8a2f-91bdaf12a235 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b" status: 200 len: 1357 microversion: 2.1 time: 0.210894 Sep 27 17:27:55.373391 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 226/475] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:55 2022] GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b => generated 1357 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:27:55.376518 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-bbce1cb0-db68-47c4-b185-ab9d2a2f3947 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1" status: 200 len: 1372 microversion: 2.1 time: 0.206578 Sep 27 17:27:55.377074 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 250/476] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:55 2022] GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1 => generated 1372 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:27:56.396856 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-a9285cd7-f574-4eee-b1c8-02d3e4d45015 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:56.397675 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-a9285cd7-f574-4eee-b1c8-02d3e4d45015 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:56.399634 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-33e7e5b9-dc79-4b4d-982b-97d9cbafcf5c tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:56.400247 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-33e7e5b9-dc79-4b4d-982b-97d9cbafcf5c tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:56.405157 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a9285cd7-f574-4eee-b1c8-02d3e4d45015 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:56.405628 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a9285cd7-f574-4eee-b1c8-02d3e4d45015 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:56.406052 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a9285cd7-f574-4eee-b1c8-02d3e4d45015 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:56.406675 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-33e7e5b9-dc79-4b4d-982b-97d9cbafcf5c tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:56.406791 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a9285cd7-f574-4eee-b1c8-02d3e4d45015 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:56.407163 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-33e7e5b9-dc79-4b4d-982b-97d9cbafcf5c tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:56.407282 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a9285cd7-f574-4eee-b1c8-02d3e4d45015 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:56.407601 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-33e7e5b9-dc79-4b4d-982b-97d9cbafcf5c tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:56.407730 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a9285cd7-f574-4eee-b1c8-02d3e4d45015 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:56.408331 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-33e7e5b9-dc79-4b4d-982b-97d9cbafcf5c tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:56.408789 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-33e7e5b9-dc79-4b4d-982b-97d9cbafcf5c tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:56.409253 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-33e7e5b9-dc79-4b4d-982b-97d9cbafcf5c tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:56.601915 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-a9285cd7-f574-4eee-b1c8-02d3e4d45015 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acafe7ed414c87a5ca235b96047aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf4e20a59f147afb4f036fc8d04adb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:56.607314 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-33e7e5b9-dc79-4b4d-982b-97d9cbafcf5c tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:56.614063 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-a9285cd7-f574-4eee-b1c8-02d3e4d45015 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b" status: 200 len: 1357 microversion: 2.1 time: 0.221009 Sep 27 17:27:56.614671 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 227/477] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:56 2022] GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b => generated 1357 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:27:56.615904 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-33e7e5b9-dc79-4b4d-982b-97d9cbafcf5c tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1" status: 200 len: 1372 microversion: 2.1 time: 0.220633 Sep 27 17:27:56.616548 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 251/478] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:56 2022] GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1 => generated 1372 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:27:57.636745 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-cd4ccf99-4117-4915-9093-fcf122468f00 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:57.637343 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-cd4ccf99-4117-4915-9093-fcf122468f00 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:57.638295 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-28eea6a4-bb93-4e95-b36b-6e8b77a3c907 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:57.638918 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-28eea6a4-bb93-4e95-b36b-6e8b77a3c907 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:57.643970 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cd4ccf99-4117-4915-9093-fcf122468f00 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:57.644445 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cd4ccf99-4117-4915-9093-fcf122468f00 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:57.644930 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-28eea6a4-bb93-4e95-b36b-6e8b77a3c907 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:57.645122 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cd4ccf99-4117-4915-9093-fcf122468f00 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:57.645437 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-28eea6a4-bb93-4e95-b36b-6e8b77a3c907 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:57.645599 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cd4ccf99-4117-4915-9093-fcf122468f00 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:57.645892 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-28eea6a4-bb93-4e95-b36b-6e8b77a3c907 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:57.646114 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cd4ccf99-4117-4915-9093-fcf122468f00 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:57.646536 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cd4ccf99-4117-4915-9093-fcf122468f00 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:57.646674 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-28eea6a4-bb93-4e95-b36b-6e8b77a3c907 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:57.647079 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-28eea6a4-bb93-4e95-b36b-6e8b77a3c907 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:57.647496 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-28eea6a4-bb93-4e95-b36b-6e8b77a3c907 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:57.851432 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-cd4ccf99-4117-4915-9093-fcf122468f00 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acafe7ed414c87a5ca235b96047aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf4e20a59f147afb4f036fc8d04adb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:57.855083 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-28eea6a4-bb93-4e95-b36b-6e8b77a3c907 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:57.860206 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-cd4ccf99-4117-4915-9093-fcf122468f00 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b" status: 200 len: 1357 microversion: 2.1 time: 0.227434 Sep 27 17:27:57.860874 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 228/479] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:57 2022] GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b => generated 1357 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:27:57.863805 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-28eea6a4-bb93-4e95-b36b-6e8b77a3c907 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1" status: 200 len: 1372 microversion: 2.1 time: 0.229366 Sep 27 17:27:57.864358 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 252/480] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:57 2022] GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1 => generated 1372 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:27:58.630610 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-e66b97d3-ce19-4277-996c-d79058e5fd94 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:58.630891 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-e66b97d3-ce19-4277-996c-d79058e5fd94 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] [instance: 2e206773-221a-4857-b437-2b1a852b8277] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:58.637410 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e66b97d3-ce19-4277-996c-d79058e5fd94 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:58.637958 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e66b97d3-ce19-4277-996c-d79058e5fd94 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:58.638331 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e66b97d3-ce19-4277-996c-d79058e5fd94 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:58.639020 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e66b97d3-ce19-4277-996c-d79058e5fd94 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:58.639497 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e66b97d3-ce19-4277-996c-d79058e5fd94 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:58.639940 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e66b97d3-ce19-4277-996c-d79058e5fd94 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:58.768299 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.objects.instance [None req-e66b97d3-ce19-4277-996c-d79058e5fd94 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lazy-loading 'services' on Instance uuid 2e206773-221a-4857-b437-2b1a852b8277 {{(pid=120415) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 17:27:58.883076 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-7a5cd922-a2d9-44c2-82df-d9bf6261c65c tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:58.883717 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-7a5cd922-a2d9-44c2-82df-d9bf6261c65c tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:58.889767 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7a5cd922-a2d9-44c2-82df-d9bf6261c65c tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:58.890287 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7a5cd922-a2d9-44c2-82df-d9bf6261c65c tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:58.890726 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7a5cd922-a2d9-44c2-82df-d9bf6261c65c tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:58.891145 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-e66b97d3-ce19-4277-996c-d79058e5fd94 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] 10.222.0.55 "DELETE /compute/v2.1/servers/2e206773-221a-4857-b437-2b1a852b8277/os-volume_attachments/db1a6c4e-57c1-4b7e-97e1-b0860977d38f" status: 202 len: 0 microversion: 2.1 time: 0.264616 Sep 27 17:27:58.891418 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7a5cd922-a2d9-44c2-82df-d9bf6261c65c tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:58.891728 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 229/481] 10.222.0.55 () {58 vars in 1416 bytes} [Tue Sep 27 17:27:58 2022] DELETE /compute/v2.1/servers/2e206773-221a-4857-b437-2b1a852b8277/os-volume_attachments/db1a6c4e-57c1-4b7e-97e1-b0860977d38f => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 17:27:58.891856 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7a5cd922-a2d9-44c2-82df-d9bf6261c65c tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:58.892282 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7a5cd922-a2d9-44c2-82df-d9bf6261c65c tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:58.898317 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-570b6f03-2430-4cb9-82de-d0897e94dd83 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:27:58.899013 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-570b6f03-2430-4cb9-82de-d0897e94dd83 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:27:58.905355 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-570b6f03-2430-4cb9-82de-d0897e94dd83 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:58.905840 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-570b6f03-2430-4cb9-82de-d0897e94dd83 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:58.906312 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-570b6f03-2430-4cb9-82de-d0897e94dd83 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:58.907004 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-570b6f03-2430-4cb9-82de-d0897e94dd83 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:27:58.907452 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-570b6f03-2430-4cb9-82de-d0897e94dd83 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:27:58.907875 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-570b6f03-2430-4cb9-82de-d0897e94dd83 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:27:59.098846 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-7a5cd922-a2d9-44c2-82df-d9bf6261c65c tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acafe7ed414c87a5ca235b96047aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf4e20a59f147afb4f036fc8d04adb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:59.103756 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-570b6f03-2430-4cb9-82de-d0897e94dd83 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:27:59.108488 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-7a5cd922-a2d9-44c2-82df-d9bf6261c65c tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b" status: 200 len: 1357 microversion: 2.1 time: 0.229336 Sep 27 17:27:59.109101 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 253/482] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:58 2022] GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b => generated 1357 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:27:59.113118 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-570b6f03-2430-4cb9-82de-d0897e94dd83 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1" status: 200 len: 1372 microversion: 2.1 time: 0.219098 Sep 27 17:27:59.113118 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 230/483] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:27:58 2022] GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1 => generated 1372 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:28:00.133031 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-18aa33c2-336e-4555-bf9d-796ca14c505c tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:28:00.133031 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-18aa33c2-336e-4555-bf9d-796ca14c505c tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:28:00.136111 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-52b1e553-a215-4280-b588-7f57ee7dc049 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:28:00.136816 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-52b1e553-a215-4280-b588-7f57ee7dc049 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:28:00.140442 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-18aa33c2-336e-4555-bf9d-796ca14c505c tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:28:00.140992 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-18aa33c2-336e-4555-bf9d-796ca14c505c tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:28:00.141371 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-18aa33c2-336e-4555-bf9d-796ca14c505c tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:28:00.142295 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-18aa33c2-336e-4555-bf9d-796ca14c505c tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:28:00.142752 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-18aa33c2-336e-4555-bf9d-796ca14c505c tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:28:00.143238 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-18aa33c2-336e-4555-bf9d-796ca14c505c tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:28:00.143826 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-52b1e553-a215-4280-b588-7f57ee7dc049 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:28:00.144322 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-52b1e553-a215-4280-b588-7f57ee7dc049 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:28:00.144777 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-52b1e553-a215-4280-b588-7f57ee7dc049 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:28:00.145474 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-52b1e553-a215-4280-b588-7f57ee7dc049 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:28:00.145931 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-52b1e553-a215-4280-b588-7f57ee7dc049 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:28:00.146380 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-52b1e553-a215-4280-b588-7f57ee7dc049 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:28:00.345232 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-18aa33c2-336e-4555-bf9d-796ca14c505c tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acafe7ed414c87a5ca235b96047aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf4e20a59f147afb4f036fc8d04adb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:28:00.349224 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-52b1e553-a215-4280-b588-7f57ee7dc049 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:28:00.353411 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-18aa33c2-336e-4555-bf9d-796ca14c505c tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b" status: 200 len: 1357 microversion: 2.1 time: 0.224655 Sep 27 17:28:00.353976 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 254/484] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:28:00 2022] GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b => generated 1357 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:28:00.357670 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-52b1e553-a215-4280-b588-7f57ee7dc049 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1" status: 200 len: 1372 microversion: 2.1 time: 0.226578 Sep 27 17:28:00.358294 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 231/485] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:28:00 2022] GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1 => generated 1372 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:28:01.378249 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-5ab66488-bbbf-47d9-9412-155894645c6b tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:28:01.378791 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-5ab66488-bbbf-47d9-9412-155894645c6b tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:28:01.380826 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-9b7aa57a-767b-4daa-a56a-ef8f3d136ecb tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:28:01.381574 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-9b7aa57a-767b-4daa-a56a-ef8f3d136ecb tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:28:01.384906 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5ab66488-bbbf-47d9-9412-155894645c6b tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:28:01.385586 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5ab66488-bbbf-47d9-9412-155894645c6b tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:28:01.386013 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5ab66488-bbbf-47d9-9412-155894645c6b tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:28:01.386766 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5ab66488-bbbf-47d9-9412-155894645c6b tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:28:01.387208 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5ab66488-bbbf-47d9-9412-155894645c6b tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:28:01.387624 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5ab66488-bbbf-47d9-9412-155894645c6b tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:28:01.388195 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9b7aa57a-767b-4daa-a56a-ef8f3d136ecb tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:28:01.388679 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9b7aa57a-767b-4daa-a56a-ef8f3d136ecb tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:28:01.389144 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9b7aa57a-767b-4daa-a56a-ef8f3d136ecb tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:28:01.389899 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9b7aa57a-767b-4daa-a56a-ef8f3d136ecb tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:28:01.390410 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9b7aa57a-767b-4daa-a56a-ef8f3d136ecb tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:28:01.390837 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9b7aa57a-767b-4daa-a56a-ef8f3d136ecb tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:28:01.583383 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-5ab66488-bbbf-47d9-9412-155894645c6b tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acafe7ed414c87a5ca235b96047aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf4e20a59f147afb4f036fc8d04adb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:28:01.590140 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-9b7aa57a-767b-4daa-a56a-ef8f3d136ecb tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:28:01.591103 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-5ab66488-bbbf-47d9-9412-155894645c6b tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b" status: 200 len: 1357 microversion: 2.1 time: 0.216944 Sep 27 17:28:01.591671 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 255/486] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:28:01 2022] GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b => generated 1357 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:28:01.597854 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-9b7aa57a-767b-4daa-a56a-ef8f3d136ecb tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1" status: 200 len: 1372 microversion: 2.1 time: 0.221128 Sep 27 17:28:01.598455 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 232/487] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:28:01 2022] GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1 => generated 1372 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:28:02.614924 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-a750d742-2f3b-42b5-8819-4a32f6c8ced8 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:28:02.615513 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-a750d742-2f3b-42b5-8819-4a32f6c8ced8 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:28:02.621463 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a750d742-2f3b-42b5-8819-4a32f6c8ced8 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:28:02.622045 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a750d742-2f3b-42b5-8819-4a32f6c8ced8 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:28:02.622203 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-d4c1924a-8d24-4649-91b8-e6b82a3c00df tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:28:02.622605 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a750d742-2f3b-42b5-8819-4a32f6c8ced8 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:28:02.623077 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-d4c1924a-8d24-4649-91b8-e6b82a3c00df tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:28:02.623197 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a750d742-2f3b-42b5-8819-4a32f6c8ced8 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:28:02.623604 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a750d742-2f3b-42b5-8819-4a32f6c8ced8 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:28:02.624019 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a750d742-2f3b-42b5-8819-4a32f6c8ced8 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:28:02.631662 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d4c1924a-8d24-4649-91b8-e6b82a3c00df tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:28:02.632155 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d4c1924a-8d24-4649-91b8-e6b82a3c00df tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:28:02.632623 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d4c1924a-8d24-4649-91b8-e6b82a3c00df tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:28:02.633337 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d4c1924a-8d24-4649-91b8-e6b82a3c00df tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:28:02.634312 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d4c1924a-8d24-4649-91b8-e6b82a3c00df tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:28:02.634749 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d4c1924a-8d24-4649-91b8-e6b82a3c00df tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:28:02.825386 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-a750d742-2f3b-42b5-8819-4a32f6c8ced8 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acafe7ed414c87a5ca235b96047aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf4e20a59f147afb4f036fc8d04adb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:28:02.829500 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-d4c1924a-8d24-4649-91b8-e6b82a3c00df tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:28:02.833079 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-a750d742-2f3b-42b5-8819-4a32f6c8ced8 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b" status: 200 len: 1357 microversion: 2.1 time: 0.222022 Sep 27 17:28:02.834199 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 256/488] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:28:02 2022] GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b => generated 1357 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:28:02.837646 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-d4c1924a-8d24-4649-91b8-e6b82a3c00df tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1" status: 200 len: 1372 microversion: 2.1 time: 0.220511 Sep 27 17:28:02.846744 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 233/489] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:28:02 2022] GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1 => generated 1372 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:28:03.859915 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-029fbbde-f3b1-4624-ab2c-f20b07205f2e tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:28:03.861214 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-b5764b3e-a938-4cc9-b341-81ea51fca11c tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:28:03.861684 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-029fbbde-f3b1-4624-ab2c-f20b07205f2e tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:28:03.862094 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-b5764b3e-a938-4cc9-b341-81ea51fca11c tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:28:03.868845 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b5764b3e-a938-4cc9-b341-81ea51fca11c tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:28:03.868991 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-029fbbde-f3b1-4624-ab2c-f20b07205f2e tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:28:03.869536 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b5764b3e-a938-4cc9-b341-81ea51fca11c tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:28:03.869812 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-029fbbde-f3b1-4624-ab2c-f20b07205f2e tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:28:03.870202 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b5764b3e-a938-4cc9-b341-81ea51fca11c tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:28:03.885270 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b5764b3e-a938-4cc9-b341-81ea51fca11c tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:28:03.885270 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b5764b3e-a938-4cc9-b341-81ea51fca11c tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:28:03.885270 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b5764b3e-a938-4cc9-b341-81ea51fca11c tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:28:03.885681 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-029fbbde-f3b1-4624-ab2c-f20b07205f2e tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:28:03.885681 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-029fbbde-f3b1-4624-ab2c-f20b07205f2e tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:28:03.885681 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-029fbbde-f3b1-4624-ab2c-f20b07205f2e tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:28:03.885681 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-029fbbde-f3b1-4624-ab2c-f20b07205f2e tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:28:04.124918 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-b5764b3e-a938-4cc9-b341-81ea51fca11c tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:28:04.139459 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-b5764b3e-a938-4cc9-b341-81ea51fca11c tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1" status: 200 len: 1372 microversion: 2.1 time: 0.282692 Sep 27 17:28:04.140163 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 234/490] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:28:03 2022] GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1 => generated 1372 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:28:04.145466 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [req-be359d40-7842-4aa8-9021-1ed55c323820 req-fd0f2677-a62a-4102-a7cd-ed817512bbca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca74fda8-afd6-41f2-8c93-5e8971c645f1", "name": "network-vif-plugged", "status": "completed", "tag": "4f5f0e59-cdc1-4e3d-9aac-a193fec519cd"}]} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:28:04.155475 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-be359d40-7842-4aa8-9021-1ed55c323820 req-fd0f2677-a62a-4102-a7cd-ed817512bbca service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:28:04.156020 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-be359d40-7842-4aa8-9021-1ed55c323820 req-fd0f2677-a62a-4102-a7cd-ed817512bbca service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:28:04.156516 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-be359d40-7842-4aa8-9021-1ed55c323820 req-fd0f2677-a62a-4102-a7cd-ed817512bbca service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:28:04.167836 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.compute.server_external_events [req-be359d40-7842-4aa8-9021-1ed55c323820 req-fd0f2677-a62a-4102-a7cd-ed817512bbca service nova] Creating event network-vif-plugged:4f5f0e59-cdc1-4e3d-9aac-a193fec519cd for instance ca74fda8-afd6-41f2-8c93-5e8971c645f1 on hv-cinder-84914 Sep 27 17:28:04.172857 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [req-be359d40-7842-4aa8-9021-1ed55c323820 req-fd0f2677-a62a-4102-a7cd-ed817512bbca service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031387 Sep 27 17:28:04.173441 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 235/491] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:28:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:28:04.184089 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-029fbbde-f3b1-4624-ab2c-f20b07205f2e tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acafe7ed414c87a5ca235b96047aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf4e20a59f147afb4f036fc8d04adb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:28:04.191685 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-029fbbde-f3b1-4624-ab2c-f20b07205f2e tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b" status: 200 len: 1357 microversion: 2.1 time: 0.338899 Sep 27 17:28:04.192255 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 257/492] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:28:03 2022] GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b => generated 1357 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:28:04.264880 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-f1f11425-26f7-4c64-8b0c-14ccbd52c781 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:28:04.265361 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-f1f11425-26f7-4c64-8b0c-14ccbd52c781 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] [instance: 2e206773-221a-4857-b437-2b1a852b8277] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:28:04.271663 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f1f11425-26f7-4c64-8b0c-14ccbd52c781 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:28:04.272137 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f1f11425-26f7-4c64-8b0c-14ccbd52c781 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:28:04.272592 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f1f11425-26f7-4c64-8b0c-14ccbd52c781 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:28:04.273268 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f1f11425-26f7-4c64-8b0c-14ccbd52c781 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:28:04.273737 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f1f11425-26f7-4c64-8b0c-14ccbd52c781 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:28:04.274178 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f1f11425-26f7-4c64-8b0c-14ccbd52c781 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:28:04.302922 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-f1f11425-26f7-4c64-8b0c-14ccbd52c781 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] [instance: 2e206773-221a-4857-b437-2b1a852b8277] Going to try to terminate instance {{(pid=120415) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 17:28:04.390358 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-f1f11425-26f7-4c64-8b0c-14ccbd52c781 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] 10.222.0.55 "DELETE /compute/v2.1/servers/2e206773-221a-4857-b437-2b1a852b8277" status: 204 len: 0 microversion: 2.1 time: 0.127519 Sep 27 17:28:04.390956 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 236/493] 10.222.0.55 () {58 vars in 1239 bytes} [Tue Sep 27 17:28:04 2022] DELETE /compute/v2.1/servers/2e206773-221a-4857-b437-2b1a852b8277 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 17:28:04.399194 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-d7b0fa6f-414c-4c0d-9eaa-cc3750e20b08 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:28:04.400440 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-d7b0fa6f-414c-4c0d-9eaa-cc3750e20b08 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] [instance: 2e206773-221a-4857-b437-2b1a852b8277] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:28:04.406433 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d7b0fa6f-414c-4c0d-9eaa-cc3750e20b08 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:28:04.406994 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d7b0fa6f-414c-4c0d-9eaa-cc3750e20b08 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:28:04.407491 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d7b0fa6f-414c-4c0d-9eaa-cc3750e20b08 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:28:04.408242 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d7b0fa6f-414c-4c0d-9eaa-cc3750e20b08 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:28:04.408849 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d7b0fa6f-414c-4c0d-9eaa-cc3750e20b08 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:28:04.409400 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d7b0fa6f-414c-4c0d-9eaa-cc3750e20b08 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:28:04.534521 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-d7b0fa6f-414c-4c0d-9eaa-cc3750e20b08 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dba953d778c418abea22efac408e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36351a4bc84a45cb866e72f52e6e725a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:28:04.542763 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-d7b0fa6f-414c-4c0d-9eaa-cc3750e20b08 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] 10.222.0.55 "GET /compute/v2.1/servers/2e206773-221a-4857-b437-2b1a852b8277" status: 200 len: 1515 microversion: 2.1 time: 0.147531 Sep 27 17:28:04.543343 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 258/494] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:28:04 2022] GET /compute/v2.1/servers/2e206773-221a-4857-b437-2b1a852b8277 => generated 1515 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:28:05.161725 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-ea90abc3-f07a-49f3-802a-ed00454f898c tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:28:05.162654 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-ea90abc3-f07a-49f3-802a-ed00454f898c tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:28:05.170922 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ea90abc3-f07a-49f3-802a-ed00454f898c tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:28:05.171395 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ea90abc3-f07a-49f3-802a-ed00454f898c tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:28:05.171817 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ea90abc3-f07a-49f3-802a-ed00454f898c tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:28:05.172508 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ea90abc3-f07a-49f3-802a-ed00454f898c tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:28:05.172975 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ea90abc3-f07a-49f3-802a-ed00454f898c tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:28:05.173391 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ea90abc3-f07a-49f3-802a-ed00454f898c tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:28:05.214821 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-34f49d94-516a-4da0-b04b-5b8d81259c46 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:28:05.215467 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-34f49d94-516a-4da0-b04b-5b8d81259c46 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:28:05.221357 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-34f49d94-516a-4da0-b04b-5b8d81259c46 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:28:05.221848 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-34f49d94-516a-4da0-b04b-5b8d81259c46 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:28:05.222319 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-34f49d94-516a-4da0-b04b-5b8d81259c46 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:28:05.223018 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-34f49d94-516a-4da0-b04b-5b8d81259c46 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:28:05.223478 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-34f49d94-516a-4da0-b04b-5b8d81259c46 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:28:05.224106 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-34f49d94-516a-4da0-b04b-5b8d81259c46 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:28:05.361980 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-ea90abc3-f07a-49f3-802a-ed00454f898c tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:28:05.370123 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-ea90abc3-f07a-49f3-802a-ed00454f898c tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1" status: 200 len: 1372 microversion: 2.1 time: 0.212476 Sep 27 17:28:05.370699 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 237/495] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:28:05 2022] GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1 => generated 1372 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:28:05.389077 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-34f49d94-516a-4da0-b04b-5b8d81259c46 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acafe7ed414c87a5ca235b96047aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf4e20a59f147afb4f036fc8d04adb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:28:05.396764 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-34f49d94-516a-4da0-b04b-5b8d81259c46 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b" status: 200 len: 1547 microversion: 2.1 time: 0.185777 Sep 27 17:28:05.397330 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 259/496] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:28:05 2022] GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b => generated 1547 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:28:05.419984 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-c8609ba6-4cd5-491d-b554-3e83bb94dcaa tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:28:05.420523 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-c8609ba6-4cd5-491d-b554-3e83bb94dcaa tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:28:05.426348 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c8609ba6-4cd5-491d-b554-3e83bb94dcaa tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:28:05.426827 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c8609ba6-4cd5-491d-b554-3e83bb94dcaa tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:28:05.427259 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c8609ba6-4cd5-491d-b554-3e83bb94dcaa tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:28:05.427943 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c8609ba6-4cd5-491d-b554-3e83bb94dcaa tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:28:05.428399 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c8609ba6-4cd5-491d-b554-3e83bb94dcaa tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:28:05.428820 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c8609ba6-4cd5-491d-b554-3e83bb94dcaa tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:28:05.558359 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-c8609ba6-4cd5-491d-b554-3e83bb94dcaa tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acafe7ed414c87a5ca235b96047aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf4e20a59f147afb4f036fc8d04adb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:28:05.564567 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-a5a5feb9-5829-4d89-9fbd-996b5a572503 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:28:05.565200 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-a5a5feb9-5829-4d89-9fbd-996b5a572503 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] [instance: 2e206773-221a-4857-b437-2b1a852b8277] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:28:05.566021 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-c8609ba6-4cd5-491d-b554-3e83bb94dcaa tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b" status: 200 len: 1547 microversion: 2.1 time: 0.150053 Sep 27 17:28:05.566623 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 238/497] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:28:05 2022] GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b => generated 1547 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:28:05.571106 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a5a5feb9-5829-4d89-9fbd-996b5a572503 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:28:05.571628 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a5a5feb9-5829-4d89-9fbd-996b5a572503 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:28:05.572063 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a5a5feb9-5829-4d89-9fbd-996b5a572503 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:28:05.572755 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a5a5feb9-5829-4d89-9fbd-996b5a572503 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:28:05.573207 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a5a5feb9-5829-4d89-9fbd-996b5a572503 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:28:05.573626 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a5a5feb9-5829-4d89-9fbd-996b5a572503 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:28:05.587253 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-d06b564b-9bf2-4051-ba9f-8d7ab53050a8 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:28:05.592086 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-d06b564b-9bf2-4051-ba9f-8d7ab53050a8 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c3acafe7ed414c87a5ca235b96047aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf4e20a59f147afb4f036fc8d04adb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:28:05.592853 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-d06b564b-9bf2-4051-ba9f-8d7ab53050a8 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Searching by: {'deleted': False, 'project_id': '9bf4e20a59f147afb4f036fc8d04adb2'} {{(pid=120415) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 27 17:28:05.599252 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d06b564b-9bf2-4051-ba9f-8d7ab53050a8 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:28:05.599728 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d06b564b-9bf2-4051-ba9f-8d7ab53050a8 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:28:05.600158 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d06b564b-9bf2-4051-ba9f-8d7ab53050a8 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:28:05.600869 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d06b564b-9bf2-4051-ba9f-8d7ab53050a8 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:28:05.601317 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d06b564b-9bf2-4051-ba9f-8d7ab53050a8 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:28:05.601734 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d06b564b-9bf2-4051-ba9f-8d7ab53050a8 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:28:05.690752 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.multi_cell_list [None req-d06b564b-9bf2-4051-ba9f-8d7ab53050a8 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120415) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 27 17:28:05.703473 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-a5a5feb9-5829-4d89-9fbd-996b5a572503 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dba953d778c418abea22efac408e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36351a4bc84a45cb866e72f52e6e725a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:28:05.711199 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-a5a5feb9-5829-4d89-9fbd-996b5a572503 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] 10.222.0.55 "GET /compute/v2.1/servers/2e206773-221a-4857-b437-2b1a852b8277" status: 200 len: 1515 microversion: 2.1 time: 0.150428 Sep 27 17:28:05.711773 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 260/498] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:28:05 2022] GET /compute/v2.1/servers/2e206773-221a-4857-b437-2b1a852b8277 => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:28:05.785315 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-d06b564b-9bf2-4051-ba9f-8d7ab53050a8 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.201573 Sep 27 17:28:05.785904 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 239/499] 10.222.0.55 () {58 vars in 1125 bytes} [Tue Sep 27 17:28:05 2022] GET /compute/v2.1/servers => generated 342 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 17:28:05.798151 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-ef15f75f-b961-486d-ae7e-13e3eea79828 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:28:05.798773 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-ef15f75f-b961-486d-ae7e-13e3eea79828 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:28:05.804535 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ef15f75f-b961-486d-ae7e-13e3eea79828 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:28:05.805012 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ef15f75f-b961-486d-ae7e-13e3eea79828 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:28:05.805443 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ef15f75f-b961-486d-ae7e-13e3eea79828 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:28:05.806785 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ef15f75f-b961-486d-ae7e-13e3eea79828 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:28:05.807240 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ef15f75f-b961-486d-ae7e-13e3eea79828 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:28:05.807661 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ef15f75f-b961-486d-ae7e-13e3eea79828 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:28:05.943336 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-ef15f75f-b961-486d-ae7e-13e3eea79828 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acafe7ed414c87a5ca235b96047aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf4e20a59f147afb4f036fc8d04adb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:28:05.951012 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-ef15f75f-b961-486d-ae7e-13e3eea79828 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b" status: 200 len: 1547 microversion: 2.1 time: 0.156902 Sep 27 17:28:05.951576 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 261/500] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:28:05 2022] GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b => generated 1547 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:28:06.394160 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-dac0ac05-7f07-4886-b141-113ea46ef591 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:28:06.394774 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-dac0ac05-7f07-4886-b141-113ea46ef591 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:28:06.401254 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-dac0ac05-7f07-4886-b141-113ea46ef591 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:28:06.401737 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-dac0ac05-7f07-4886-b141-113ea46ef591 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:28:06.402208 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-dac0ac05-7f07-4886-b141-113ea46ef591 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:28:06.402900 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-dac0ac05-7f07-4886-b141-113ea46ef591 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:28:06.403357 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-dac0ac05-7f07-4886-b141-113ea46ef591 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:28:06.403780 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-dac0ac05-7f07-4886-b141-113ea46ef591 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:28:06.531913 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-dac0ac05-7f07-4886-b141-113ea46ef591 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:28:06.539387 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-dac0ac05-7f07-4886-b141-113ea46ef591 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1" status: 200 len: 1372 microversion: 2.1 time: 0.149206 Sep 27 17:28:06.540442 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 240/501] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:28:06 2022] GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1 => generated 1372 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:28:06.734748 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-568030f9-3c7f-480f-bb4e-e183c7d57692 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:28:06.735276 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-568030f9-3c7f-480f-bb4e-e183c7d57692 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] [instance: 2e206773-221a-4857-b437-2b1a852b8277] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:28:06.741144 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-568030f9-3c7f-480f-bb4e-e183c7d57692 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:28:06.741621 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-568030f9-3c7f-480f-bb4e-e183c7d57692 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:28:06.742051 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-568030f9-3c7f-480f-bb4e-e183c7d57692 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:28:06.742758 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-568030f9-3c7f-480f-bb4e-e183c7d57692 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:28:06.743251 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-568030f9-3c7f-480f-bb4e-e183c7d57692 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:28:06.743673 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-568030f9-3c7f-480f-bb4e-e183c7d57692 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:28:06.869407 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-568030f9-3c7f-480f-bb4e-e183c7d57692 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dba953d778c418abea22efac408e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36351a4bc84a45cb866e72f52e6e725a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:28:06.877166 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-568030f9-3c7f-480f-bb4e-e183c7d57692 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] 10.222.0.55 "GET /compute/v2.1/servers/2e206773-221a-4857-b437-2b1a852b8277" status: 200 len: 1515 microversion: 2.1 time: 0.146592 Sep 27 17:28:06.877724 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 262/502] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:28:06 2022] GET /compute/v2.1/servers/2e206773-221a-4857-b437-2b1a852b8277 => generated 1515 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:28:07.562208 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-41fd0fe7-c3ca-4041-8493-18622baa5518 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:28:07.562862 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-41fd0fe7-c3ca-4041-8493-18622baa5518 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:28:07.569073 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-41fd0fe7-c3ca-4041-8493-18622baa5518 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:28:07.569560 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-41fd0fe7-c3ca-4041-8493-18622baa5518 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:28:07.569996 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-41fd0fe7-c3ca-4041-8493-18622baa5518 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:28:07.570712 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-41fd0fe7-c3ca-4041-8493-18622baa5518 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:28:07.571252 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-41fd0fe7-c3ca-4041-8493-18622baa5518 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:28:07.572338 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-41fd0fe7-c3ca-4041-8493-18622baa5518 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:28:07.576426 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:28:07.774190 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-41fd0fe7-c3ca-4041-8493-18622baa5518 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:28:07.782126 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-41fd0fe7-c3ca-4041-8493-18622baa5518 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1" status: 200 len: 1372 microversion: 2.1 time: 0.223794 Sep 27 17:28:07.782919 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 241/503] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:28:07 2022] GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1 => generated 1372 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:28:07.899515 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-6a0fdc79-089a-4314-98de-7855f48a2b9f tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:28:07.900980 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-6a0fdc79-089a-4314-98de-7855f48a2b9f tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] [instance: 2e206773-221a-4857-b437-2b1a852b8277] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:28:07.908872 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6a0fdc79-089a-4314-98de-7855f48a2b9f tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:28:07.909617 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6a0fdc79-089a-4314-98de-7855f48a2b9f tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:28:07.910676 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6a0fdc79-089a-4314-98de-7855f48a2b9f tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:28:07.911400 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6a0fdc79-089a-4314-98de-7855f48a2b9f tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:28:07.912010 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6a0fdc79-089a-4314-98de-7855f48a2b9f tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:28:07.912598 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6a0fdc79-089a-4314-98de-7855f48a2b9f tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:28:07.930934 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_cell1:SELECT=100 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:28:07.942828 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [req-2ad2ee16-62ab-4c22-a58d-85d6409d7981 req-d7a8f073-6dc0-4bac-a945-89ca50737334 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e206773-221a-4857-b437-2b1a852b8277", "name": "network-vif-deleted", "tag": "e9e0231f-54fe-478f-87fb-2d95162294ff"}]} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:28:07.952698 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-2ad2ee16-62ab-4c22-a58d-85d6409d7981 req-d7a8f073-6dc0-4bac-a945-89ca50737334 service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:28:07.953173 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-2ad2ee16-62ab-4c22-a58d-85d6409d7981 req-d7a8f073-6dc0-4bac-a945-89ca50737334 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:28:07.953604 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-2ad2ee16-62ab-4c22-a58d-85d6409d7981 req-d7a8f073-6dc0-4bac-a945-89ca50737334 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:28:07.964539 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.compute.server_external_events [req-2ad2ee16-62ab-4c22-a58d-85d6409d7981 req-d7a8f073-6dc0-4bac-a945-89ca50737334 service nova] Creating event network-vif-deleted:e9e0231f-54fe-478f-87fb-2d95162294ff for instance 2e206773-221a-4857-b437-2b1a852b8277 on hv-cinder-84914 Sep 27 17:28:07.969350 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [req-2ad2ee16-62ab-4c22-a58d-85d6409d7981 req-d7a8f073-6dc0-4bac-a945-89ca50737334 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030112 Sep 27 17:28:07.969939 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 242/504] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:28:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 17:28:07.985973 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-6a0fdc79-089a-4314-98de-7855f48a2b9f tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dba953d778c418abea22efac408e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36351a4bc84a45cb866e72f52e6e725a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:28:07.994490 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-6a0fdc79-089a-4314-98de-7855f48a2b9f tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] 10.222.0.55 "GET /compute/v2.1/servers/2e206773-221a-4857-b437-2b1a852b8277" status: 200 len: 1473 microversion: 2.1 time: 0.099273 Sep 27 17:28:07.995045 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 263/505] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:28:07 2022] GET /compute/v2.1/servers/2e206773-221a-4857-b437-2b1a852b8277 => generated 1473 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:28:08.565627 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-a1d440bc-8112-49e8-8045-e41f1a4f81ae tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "620667b6-601e-4daa-8d0b-03fd03f9971b"}} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:28:08.568102 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-a1d440bc-8112-49e8-8045-e41f1a4f81ae tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:28:08.575080 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a1d440bc-8112-49e8-8045-e41f1a4f81ae tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:28:08.575563 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a1d440bc-8112-49e8-8045-e41f1a4f81ae tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:28:08.575993 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a1d440bc-8112-49e8-8045-e41f1a4f81ae tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:28:08.576671 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a1d440bc-8112-49e8-8045-e41f1a4f81ae tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:28:08.577118 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a1d440bc-8112-49e8-8045-e41f1a4f81ae tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:28:08.577536 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a1d440bc-8112-49e8-8045-e41f1a4f81ae tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:28:08.806461 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-8412bd96-eda9-4e3e-8d8b-c6fc33c645b2 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:28:08.806970 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-8412bd96-eda9-4e3e-8d8b-c6fc33c645b2 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:28:08.813028 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8412bd96-eda9-4e3e-8d8b-c6fc33c645b2 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:28:08.813516 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8412bd96-eda9-4e3e-8d8b-c6fc33c645b2 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:28:08.813950 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8412bd96-eda9-4e3e-8d8b-c6fc33c645b2 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:28:08.814669 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8412bd96-eda9-4e3e-8d8b-c6fc33c645b2 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:28:08.815124 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8412bd96-eda9-4e3e-8d8b-c6fc33c645b2 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:28:08.815547 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8412bd96-eda9-4e3e-8d8b-c6fc33c645b2 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:28:08.961049 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-8412bd96-eda9-4e3e-8d8b-c6fc33c645b2 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:28:08.970167 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-8412bd96-eda9-4e3e-8d8b-c6fc33c645b2 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1" status: 200 len: 1566 microversion: 2.1 time: 0.168157 Sep 27 17:28:08.970930 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 264/506] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:28:08 2022] GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1 => generated 1566 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:28:08.994888 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-4662789f-1811-44e2-a088-bea07f0fdbe5 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:28:08.995381 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-4662789f-1811-44e2-a088-bea07f0fdbe5 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:28:09.001212 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4662789f-1811-44e2-a088-bea07f0fdbe5 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:28:09.001702 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4662789f-1811-44e2-a088-bea07f0fdbe5 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:28:09.002283 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4662789f-1811-44e2-a088-bea07f0fdbe5 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:28:09.002861 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4662789f-1811-44e2-a088-bea07f0fdbe5 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:28:09.003319 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4662789f-1811-44e2-a088-bea07f0fdbe5 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:28:09.003739 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4662789f-1811-44e2-a088-bea07f0fdbe5 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:28:09.034105 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-a1d440bc-8112-49e8-8045-e41f1a4f81ae tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "POST /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.472561 Sep 27 17:28:09.034721 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 243/507] 10.222.0.55 () {60 vars in 1323 bytes} [Tue Sep 27 17:28:08 2022] POST /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b/os-volume_attachments => generated 194 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:28:09.044639 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-feda4ea7-f2a8-4370-97ba-c82e62ae16d2 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:28:09.046024 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-feda4ea7-f2a8-4370-97ba-c82e62ae16d2 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] [instance: 2e206773-221a-4857-b437-2b1a852b8277] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:28:09.053322 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-feda4ea7-f2a8-4370-97ba-c82e62ae16d2 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:28:09.054122 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-feda4ea7-f2a8-4370-97ba-c82e62ae16d2 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:28:09.054875 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-feda4ea7-f2a8-4370-97ba-c82e62ae16d2 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:28:09.056215 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-feda4ea7-f2a8-4370-97ba-c82e62ae16d2 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:28:09.056848 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-feda4ea7-f2a8-4370-97ba-c82e62ae16d2 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:28:09.057367 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-feda4ea7-f2a8-4370-97ba-c82e62ae16d2 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:28:09.075068 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.wsgi [None req-feda4ea7-f2a8-4370-97ba-c82e62ae16d2 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] HTTP exception thrown: Instance 2e206773-221a-4857-b437-2b1a852b8277 could not be found. Sep 27 17:28:09.076719 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-feda4ea7-f2a8-4370-97ba-c82e62ae16d2 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Request method failure captured: Sep 27 17:28:09.076719 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: request: GET /compute/v2.1/servers/2e206773-221a-4857-b437-2b1a852b8277 HTTP/1.1 Sep 27 17:28:09.076719 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Accept: application/json Sep 27 17:28:09.076719 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Accept-Encoding: identity Sep 27 17:28:09.076719 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Connection: close Sep 27 17:28:09.076719 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Content-Length: 0 Sep 27 17:28:09.076719 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Content-Type: application/json Sep 27 17:28:09.076719 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Host: 10.222.0.55 Sep 27 17:28:09.076719 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Openstack-System-Scope: None Sep 27 17:28:09.076719 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: User-Agent: python-urllib3/1.26.12 Sep 27 17:28:09.076719 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Auth-Token: gAAAAABjMzIEzpsmOrEtCzJjKCpgePzPY3xIA_i3kVdqVR1KNk69_LRz3estPjYRWlSJIxFCmVD9d3R8WNgG3gYqsAdeLqYOl9yxQ7NymBbKwI0cI21j2c0V5M1yma0b6uBA4w2N4FnuW7oyeNSTkhIO10_WfiisRN42wcdkrHED2XEjr3BcHDo Sep 27 17:28:09.076719 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Domain-Id: None Sep 27 17:28:09.076719 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Domain-Name: None Sep 27 17:28:09.076719 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Identity-Status: Confirmed Sep 27 17:28:09.076719 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Is-Admin-Project: True Sep 27 17:28:09.076719 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Domain-Id: default Sep 27 17:28:09.076719 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Domain-Name: Default Sep 27 17:28:09.076719 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Id: 36351a4bc84a45cb866e72f52e6e725a Sep 27 17:28:09.076719 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Name: tempest-VolumesSnapshotTestJSON-86261250 Sep 27 17:28:09.076719 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Role: reader,member Sep 27 17:28:09.076719 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Roles: reader,member Sep 27 17:28:09.078042 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/36351a4bc84a45cb866e72f52e6e725a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_36351a4bc84a45cb866e72f52e6e725a", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/36351a4bc84a45cb866e72f52e6e725a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/36351a4bc84a45cb866e72f52e6e725a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 27 17:28:09.078042 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Tenant: tempest-VolumesSnapshotTestJSON-86261250 Sep 27 17:28:09.078042 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Tenant-Id: 36351a4bc84a45cb866e72f52e6e725a Sep 27 17:28:09.078042 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-86261250 Sep 27 17:28:09.078042 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User: tempest-VolumesSnapshotTestJSON-86261250-project Sep 27 17:28:09.078042 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Domain-Id: default Sep 27 17:28:09.078042 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Domain-Name: Default Sep 27 17:28:09.078042 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Id: 1dba953d778c418abea22efac408e2db Sep 27 17:28:09.078042 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Name: tempest-VolumesSnapshotTestJSON-86261250-project Sep 27 17:28:09.078042 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: method: > Sep 27 17:28:09.078042 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: exception: Instance 2e206773-221a-4857-b437-2b1a852b8277 could not be found. Sep 27 17:28:09.078042 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: action_args: {'id': '2e206773-221a-4857-b437-2b1a852b8277'} Sep 27 17:28:09.079617 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 17:28:09.079617 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:28:09.079617 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 17:28:09.079617 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 17:28:09.079617 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 17:28:09.079617 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 17:28:09.079617 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 17:28:09.079617 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 17:28:09.079617 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 17:28:09.079617 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 17:28:09.079617 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e206773-221a-4857-b437-2b1a852b8277 could not be found. Sep 27 17:28:09.079617 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:28:09.079617 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:28:09.079617 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:28:09.079617 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:28:09.079617 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:28:09.079617 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:28:09.079617 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 17:28:09.079617 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 17:28:09.079617 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 17:28:09.081289 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 17:28:09.081289 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 17:28:09.081289 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 17:28:09.081289 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 17:28:09.081289 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 17:28:09.081289 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 17:28:09.081289 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 17:28:09.081289 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e206773-221a-4857-b437-2b1a852b8277 could not be found. Sep 27 17:28:09.081289 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:28:09.081289 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:28:09.081289 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:28:09.081289 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:28:09.081289 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:28:09.081289 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:28:09.081289 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 17:28:09.081289 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 17:28:09.081289 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e206773-221a-4857-b437-2b1a852b8277 could not be found. Sep 27 17:28:09.081289 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:28:09.082582 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-feda4ea7-f2a8-4370-97ba-c82e62ae16d2 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Returning 404 to user: Instance 2e206773-221a-4857-b437-2b1a852b8277 could not be found. {{(pid=120415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 17:28:09.082582 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-feda4ea7-f2a8-4370-97ba-c82e62ae16d2 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] 10.222.0.55 "GET /compute/v2.1/servers/2e206773-221a-4857-b437-2b1a852b8277" status: 404 len: 111 microversion: 2.1 time: 0.042122 Sep 27 17:28:09.082582 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 244/508] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:28:09 2022] GET /compute/v2.1/servers/2e206773-221a-4857-b437-2b1a852b8277 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 17:28:09.118804 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-4662789f-1811-44e2-a088-bea07f0fdbe5 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.127804 Sep 27 17:28:09.119636 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 265/509] 10.222.0.55 () {58 vars in 1275 bytes} [Tue Sep 27 17:28:08 2022] GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1/os-interface => generated 285 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 17:28:10.289887 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [req-f4aa8244-3a92-4a59-ba0c-fe62c2398475 req-18955bde-90a4-4bf0-b6c3-aa59bcc6f097 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca74fda8-afd6-41f2-8c93-5e8971c645f1", "tag": "4f5f0e59-cdc1-4e3d-9aac-a193fec519cd"}]} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:28:10.310028 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-f4aa8244-3a92-4a59-ba0c-fe62c2398475 req-18955bde-90a4-4bf0-b6c3-aa59bcc6f097 service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:28:10.310555 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-f4aa8244-3a92-4a59-ba0c-fe62c2398475 req-18955bde-90a4-4bf0-b6c3-aa59bcc6f097 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:28:10.311023 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-f4aa8244-3a92-4a59-ba0c-fe62c2398475 req-18955bde-90a4-4bf0-b6c3-aa59bcc6f097 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:28:10.328108 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.compute.server_external_events [req-f4aa8244-3a92-4a59-ba0c-fe62c2398475 req-18955bde-90a4-4bf0-b6c3-aa59bcc6f097 service nova] Creating event network-changed:4f5f0e59-cdc1-4e3d-9aac-a193fec519cd for instance ca74fda8-afd6-41f2-8c93-5e8971c645f1 on hv-cinder-84914 Sep 27 17:28:10.333139 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [req-f4aa8244-3a92-4a59-ba0c-fe62c2398475 req-18955bde-90a4-4bf0-b6c3-aa59bcc6f097 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047023 Sep 27 17:28:10.333839 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 245/510] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:28:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:28:23.120194 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_api:SELECT=49 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:28:23.121016 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_cell1:SELECT=13 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:28:23.125856 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-223c7b81-9b18-4bae-ae5e-90dda27af5c7 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1404056577", "imageRef": "9355bd92-0a49-42cd-b079-ff9f0d54b91b", "flavorRef": "452", "networks": [{"uuid": "ce8ed3f9-3eb7-4f41-b23c-147313bc83ed"}]}} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:28:23.178928 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.network.neutron [None req-223c7b81-9b18-4bae-ae5e-90dda27af5c7 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] validate_networks() for [('ce8ed3f9-3eb7-4f41-b23c-147313bc83ed', None, None, None, None, None)] {{(pid=120416) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 17:28:23.519081 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.virt.hardware [None req-223c7b81-9b18-4bae-ae5e-90dda27af5c7 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Flavor limits 0:0:0 {{(pid=120416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 17:28:23.519496 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.virt.hardware [None req-223c7b81-9b18-4bae-ae5e-90dda27af5c7 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Image limits 0:0:0 {{(pid=120416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 17:28:23.519989 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.virt.hardware [None req-223c7b81-9b18-4bae-ae5e-90dda27af5c7 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Flavor pref 0:0:0 {{(pid=120416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 17:28:23.520390 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.virt.hardware [None req-223c7b81-9b18-4bae-ae5e-90dda27af5c7 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Image pref 0:0:0 {{(pid=120416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 17:28:23.520795 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.virt.hardware [None req-223c7b81-9b18-4bae-ae5e-90dda27af5c7 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 17:28:23.529607 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-223c7b81-9b18-4bae-ae5e-90dda27af5c7 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:28:23.530096 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-223c7b81-9b18-4bae-ae5e-90dda27af5c7 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:28:23.530529 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-223c7b81-9b18-4bae-ae5e-90dda27af5c7 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:28:23.531240 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-223c7b81-9b18-4bae-ae5e-90dda27af5c7 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:28:23.531683 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-223c7b81-9b18-4bae-ae5e-90dda27af5c7 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:28:23.532106 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-223c7b81-9b18-4bae-ae5e-90dda27af5c7 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:28:23.551471 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.quota [None req-223c7b81-9b18-4bae-ae5e-90dda27af5c7 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Getting quotas for project 36351a4bc84a45cb866e72f52e6e725a. Resources: {'cores', 'ram', 'instances'} {{(pid=120416) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 17:28:23.555637 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.quota [None req-223c7b81-9b18-4bae-ae5e-90dda27af5c7 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Getting quotas for user 1dba953d778c418abea22efac408e2db and project 36351a4bc84a45cb866e72f52e6e725a. Resources: {'cores', 'ram', 'instances'} {{(pid=120416) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 17:28:23.572111 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-223c7b81-9b18-4bae-ae5e-90dda27af5c7 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Going to run 1 instances... {{(pid=120416) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 17:28:23.574401 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-223c7b81-9b18-4bae-ae5e-90dda27af5c7 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] [instance: 288b4bf9-edef-4f93-b368-2d2b0b9cb20f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9355bd92-0a49-42cd-b079-ff9f0d54b91b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120416) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 17:28:23.624575 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-223c7b81-9b18-4bae-ae5e-90dda27af5c7 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.506272 Sep 27 17:28:23.625444 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 266/511] 10.222.0.55 () {60 vars in 1147 bytes} [Tue Sep 27 17:28:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 508 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 17:28:23.634120 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell0:SELECT=2 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:28:23.634974 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:28:23.635629 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:28:23.640100 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-8d1138fa-a8fe-4027-8096-05ca4e97c7e4 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:28:23.640808 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-8d1138fa-a8fe-4027-8096-05ca4e97c7e4 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] [instance: 288b4bf9-edef-4f93-b368-2d2b0b9cb20f] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:28:23.698079 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-8d1138fa-a8fe-4027-8096-05ca4e97c7e4 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dba953d778c418abea22efac408e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36351a4bc84a45cb866e72f52e6e725a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:28:23.704928 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-8d1138fa-a8fe-4027-8096-05ca4e97c7e4 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] 10.222.0.55 "GET /compute/v2.1/servers/288b4bf9-edef-4f93-b368-2d2b0b9cb20f" status: 200 len: 1219 microversion: 2.1 time: 0.072412 Sep 27 17:28:23.705490 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 246/512] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:28:23 2022] GET /compute/v2.1/servers/288b4bf9-edef-4f93-b368-2d2b0b9cb20f => generated 1219 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:28:24.728101 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-2f0656ee-a913-4b7e-bb65-d363b05df1cb tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:28:24.729468 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-2f0656ee-a913-4b7e-bb65-d363b05df1cb tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] [instance: 288b4bf9-edef-4f93-b368-2d2b0b9cb20f] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:28:24.735858 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-2f0656ee-a913-4b7e-bb65-d363b05df1cb tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:28:24.736338 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-2f0656ee-a913-4b7e-bb65-d363b05df1cb tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:28:24.736771 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-2f0656ee-a913-4b7e-bb65-d363b05df1cb tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:28:24.737460 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-2f0656ee-a913-4b7e-bb65-d363b05df1cb tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:28:24.737914 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-2f0656ee-a913-4b7e-bb65-d363b05df1cb tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:28:24.738368 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-2f0656ee-a913-4b7e-bb65-d363b05df1cb tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:28:24.801585 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-2f0656ee-a913-4b7e-bb65-d363b05df1cb tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dba953d778c418abea22efac408e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36351a4bc84a45cb866e72f52e6e725a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:28:24.811097 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-2f0656ee-a913-4b7e-bb65-d363b05df1cb tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] 10.222.0.55 "GET /compute/v2.1/servers/288b4bf9-edef-4f93-b368-2d2b0b9cb20f" status: 200 len: 1271 microversion: 2.1 time: 0.086921 Sep 27 17:28:24.811656 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 267/513] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:28:24 2022] GET /compute/v2.1/servers/288b4bf9-edef-4f93-b368-2d2b0b9cb20f => generated 1271 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:28:25.115308 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-f13e2b0e-4641-4478-8e42-934a310d796e tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:28:25.115901 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-f13e2b0e-4641-4478-8e42-934a310d796e tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:28:25.122457 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f13e2b0e-4641-4478-8e42-934a310d796e tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:28:25.123954 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f13e2b0e-4641-4478-8e42-934a310d796e tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:28:25.125501 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f13e2b0e-4641-4478-8e42-934a310d796e tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:28:25.127092 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f13e2b0e-4641-4478-8e42-934a310d796e tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:28:25.127846 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f13e2b0e-4641-4478-8e42-934a310d796e tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:28:25.128298 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f13e2b0e-4641-4478-8e42-934a310d796e tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:28:25.342161 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-f13e2b0e-4641-4478-8e42-934a310d796e tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acafe7ed414c87a5ca235b96047aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf4e20a59f147afb4f036fc8d04adb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:28:25.350751 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-f13e2b0e-4641-4478-8e42-934a310d796e tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b" status: 200 len: 1593 microversion: 2.1 time: 0.239981 Sep 27 17:28:25.351587 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 247/514] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:28:25 2022] GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b => generated 1593 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:28:25.836247 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-f4208e6d-e1e3-4afe-ba78-df95b0f22638 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:28:25.837944 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-f4208e6d-e1e3-4afe-ba78-df95b0f22638 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] [instance: 288b4bf9-edef-4f93-b368-2d2b0b9cb20f] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:28:25.852550 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f4208e6d-e1e3-4afe-ba78-df95b0f22638 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:28:25.853038 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f4208e6d-e1e3-4afe-ba78-df95b0f22638 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:28:25.854374 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f4208e6d-e1e3-4afe-ba78-df95b0f22638 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:28:25.855252 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f4208e6d-e1e3-4afe-ba78-df95b0f22638 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:28:25.856220 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f4208e6d-e1e3-4afe-ba78-df95b0f22638 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:28:25.856803 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f4208e6d-e1e3-4afe-ba78-df95b0f22638 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:28:26.074538 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-f4208e6d-e1e3-4afe-ba78-df95b0f22638 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dba953d778c418abea22efac408e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36351a4bc84a45cb866e72f52e6e725a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:28:26.082625 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-f4208e6d-e1e3-4afe-ba78-df95b0f22638 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] 10.222.0.55 "GET /compute/v2.1/servers/288b4bf9-edef-4f93-b368-2d2b0b9cb20f" status: 200 len: 1319 microversion: 2.1 time: 0.252114 Sep 27 17:28:26.084250 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 268/515] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:28:25 2022] GET /compute/v2.1/servers/288b4bf9-edef-4f93-b368-2d2b0b9cb20f => generated 1319 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:28:26.614180 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [req-537cb655-ddb0-44f5-a475-2fe0cef609ff req-c1577b2d-2dd2-445e-aa73-91afe1ea15f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "288b4bf9-edef-4f93-b368-2d2b0b9cb20f", "tag": "2c8a1771-f6b3-42cb-b6ad-c7761e3b0e5f"}]} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:28:26.634142 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-537cb655-ddb0-44f5-a475-2fe0cef609ff req-c1577b2d-2dd2-445e-aa73-91afe1ea15f4 service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:28:26.635351 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-537cb655-ddb0-44f5-a475-2fe0cef609ff req-c1577b2d-2dd2-445e-aa73-91afe1ea15f4 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:28:26.636139 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-537cb655-ddb0-44f5-a475-2fe0cef609ff req-c1577b2d-2dd2-445e-aa73-91afe1ea15f4 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:28:26.648395 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.compute.server_external_events [req-537cb655-ddb0-44f5-a475-2fe0cef609ff req-c1577b2d-2dd2-445e-aa73-91afe1ea15f4 service nova] Creating event network-changed:2c8a1771-f6b3-42cb-b6ad-c7761e3b0e5f for instance 288b4bf9-edef-4f93-b368-2d2b0b9cb20f on hv-cinder-84914 Sep 27 17:28:26.654277 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [req-537cb655-ddb0-44f5-a475-2fe0cef609ff req-c1577b2d-2dd2-445e-aa73-91afe1ea15f4 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043821 Sep 27 17:28:26.654875 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 248/516] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:28:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 17:28:27.107276 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-63c7f5b0-00f3-4318-914f-9e6aaa04c499 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:28:27.108080 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-63c7f5b0-00f3-4318-914f-9e6aaa04c499 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] [instance: 288b4bf9-edef-4f93-b368-2d2b0b9cb20f] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:28:27.114125 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-63c7f5b0-00f3-4318-914f-9e6aaa04c499 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:28:27.114609 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-63c7f5b0-00f3-4318-914f-9e6aaa04c499 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:28:27.115087 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-63c7f5b0-00f3-4318-914f-9e6aaa04c499 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:28:27.115776 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-63c7f5b0-00f3-4318-914f-9e6aaa04c499 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:28:27.116224 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-63c7f5b0-00f3-4318-914f-9e6aaa04c499 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:28:27.117247 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-63c7f5b0-00f3-4318-914f-9e6aaa04c499 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:28:27.254863 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-63c7f5b0-00f3-4318-914f-9e6aaa04c499 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dba953d778c418abea22efac408e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36351a4bc84a45cb866e72f52e6e725a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:28:27.262555 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-63c7f5b0-00f3-4318-914f-9e6aaa04c499 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] 10.222.0.55 "GET /compute/v2.1/servers/288b4bf9-edef-4f93-b368-2d2b0b9cb20f" status: 200 len: 1319 microversion: 2.1 time: 0.159315 Sep 27 17:28:27.263301 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 269/517] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:28:27 2022] GET /compute/v2.1/servers/288b4bf9-edef-4f93-b368-2d2b0b9cb20f => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:28:27.461215 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [req-82fdea76-c951-4543-aa65-2564c17b57ab req-fb6f6205-a3c8-4e40-9131-788ed9144f86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7c9bb60-e05b-4527-aa2f-bc6a3c55306b", "tag": "9d1590c2-6fed-40c4-8aca-ed18ef3c13df"}]} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:28:27.470648 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-82fdea76-c951-4543-aa65-2564c17b57ab req-fb6f6205-a3c8-4e40-9131-788ed9144f86 service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:28:27.471127 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-82fdea76-c951-4543-aa65-2564c17b57ab req-fb6f6205-a3c8-4e40-9131-788ed9144f86 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:28:27.471819 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-82fdea76-c951-4543-aa65-2564c17b57ab req-fb6f6205-a3c8-4e40-9131-788ed9144f86 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:28:27.484335 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.compute.server_external_events [req-82fdea76-c951-4543-aa65-2564c17b57ab req-fb6f6205-a3c8-4e40-9131-788ed9144f86 service nova] Creating event network-changed:9d1590c2-6fed-40c4-8aca-ed18ef3c13df for instance d7c9bb60-e05b-4527-aa2f-bc6a3c55306b on hv-cinder-84914 Sep 27 17:28:27.489212 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [req-82fdea76-c951-4543-aa65-2564c17b57ab req-fb6f6205-a3c8-4e40-9131-788ed9144f86 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031977 Sep 27 17:28:27.490100 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 249/518] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:28:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:28:28.284883 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-42ac66ca-52fa-4788-9a0d-df59ecb4c595 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:28:28.285721 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-42ac66ca-52fa-4788-9a0d-df59ecb4c595 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] [instance: 288b4bf9-edef-4f93-b368-2d2b0b9cb20f] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:28:28.293025 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-42ac66ca-52fa-4788-9a0d-df59ecb4c595 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:28:28.293605 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-42ac66ca-52fa-4788-9a0d-df59ecb4c595 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:28:28.294180 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-42ac66ca-52fa-4788-9a0d-df59ecb4c595 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:28:28.295089 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-42ac66ca-52fa-4788-9a0d-df59ecb4c595 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:28:28.295717 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-42ac66ca-52fa-4788-9a0d-df59ecb4c595 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:28:28.296217 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-42ac66ca-52fa-4788-9a0d-df59ecb4c595 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:28:28.426149 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-c43967c6-e204-4ac0-a6d7-270ddcea05d1 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2145868438"}} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:28:28.426807 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-c43967c6-e204-4ac0-a6d7-270ddcea05d1 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:28:28.433670 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c43967c6-e204-4ac0-a6d7-270ddcea05d1 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:28:28.434171 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c43967c6-e204-4ac0-a6d7-270ddcea05d1 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:28:28.434826 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c43967c6-e204-4ac0-a6d7-270ddcea05d1 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:28:28.435696 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c43967c6-e204-4ac0-a6d7-270ddcea05d1 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:28:28.436326 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c43967c6-e204-4ac0-a6d7-270ddcea05d1 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:28:28.437503 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c43967c6-e204-4ac0-a6d7-270ddcea05d1 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:28:28.463395 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-42ac66ca-52fa-4788-9a0d-df59ecb4c595 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dba953d778c418abea22efac408e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36351a4bc84a45cb866e72f52e6e725a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:28:28.472233 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-42ac66ca-52fa-4788-9a0d-df59ecb4c595 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] 10.222.0.55 "GET /compute/v2.1/servers/288b4bf9-edef-4f93-b368-2d2b0b9cb20f" status: 200 len: 1319 microversion: 2.1 time: 0.191230 Sep 27 17:28:28.479788 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 270/519] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:28:28 2022] GET /compute/v2.1/servers/288b4bf9-edef-4f93-b368-2d2b0b9cb20f => generated 1319 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:28:28.584700 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.network.security_group_api [None req-c43967c6-e204-4ac0-a6d7-270ddcea05d1 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Adding security group e90abd20-a7d9-4a96-ad13-61546a82ff29 to port 9d1590c2-6fed-40c4-8aca-ed18ef3c13df Sep 27 17:28:28.906855 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-c43967c6-e204-4ac0-a6d7-270ddcea05d1 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "POST /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b/action" status: 202 len: 0 microversion: 2.1 time: 0.485610 Sep 27 17:28:28.907469 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 250/520] 10.222.0.55 () {60 vars in 1278 bytes} [Tue Sep 27 17:28:28 2022] POST /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b/action => generated 0 bytes in 487 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 27 17:28:28.916209 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-8a2da3cf-b24e-47a6-9dcb-c2d8282d4dd3 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:28:28.916855 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-8a2da3cf-b24e-47a6-9dcb-c2d8282d4dd3 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:28:28.922948 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [req-f9478d31-8e12-40cf-8fd2-ffe8b67b66bb req-9ecca32b-8d7a-4daa-8eb9-e74ff953282f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7c9bb60-e05b-4527-aa2f-bc6a3c55306b", "tag": "9d1590c2-6fed-40c4-8aca-ed18ef3c13df"}]} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:28:28.933069 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8a2da3cf-b24e-47a6-9dcb-c2d8282d4dd3 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:28:28.933560 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8a2da3cf-b24e-47a6-9dcb-c2d8282d4dd3 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:28:28.933989 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8a2da3cf-b24e-47a6-9dcb-c2d8282d4dd3 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:28:28.934716 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8a2da3cf-b24e-47a6-9dcb-c2d8282d4dd3 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:28:28.936190 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8a2da3cf-b24e-47a6-9dcb-c2d8282d4dd3 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:28:28.936631 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8a2da3cf-b24e-47a6-9dcb-c2d8282d4dd3 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:28:28.953732 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-f9478d31-8e12-40cf-8fd2-ffe8b67b66bb req-9ecca32b-8d7a-4daa-8eb9-e74ff953282f service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:28:28.954243 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-f9478d31-8e12-40cf-8fd2-ffe8b67b66bb req-9ecca32b-8d7a-4daa-8eb9-e74ff953282f service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:28:28.954673 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-f9478d31-8e12-40cf-8fd2-ffe8b67b66bb req-9ecca32b-8d7a-4daa-8eb9-e74ff953282f service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:28:28.967200 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.compute.server_external_events [req-f9478d31-8e12-40cf-8fd2-ffe8b67b66bb req-9ecca32b-8d7a-4daa-8eb9-e74ff953282f service nova] Creating event network-changed:9d1590c2-6fed-40c4-8aca-ed18ef3c13df for instance d7c9bb60-e05b-4527-aa2f-bc6a3c55306b on hv-cinder-84914 Sep 27 17:28:28.973940 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [req-f9478d31-8e12-40cf-8fd2-ffe8b67b66bb req-9ecca32b-8d7a-4daa-8eb9-e74ff953282f service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054493 Sep 27 17:28:28.974722 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 251/521] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:28:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:28:29.098029 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-8a2da3cf-b24e-47a6-9dcb-c2d8282d4dd3 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acafe7ed414c87a5ca235b96047aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf4e20a59f147afb4f036fc8d04adb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:28:29.107360 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-8a2da3cf-b24e-47a6-9dcb-c2d8282d4dd3 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b" status: 200 len: 1640 microversion: 2.1 time: 0.195462 Sep 27 17:28:29.107940 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 271/522] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:28:28 2022] GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b => generated 1640 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:28:29.497458 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-cae19972-373e-4e64-b8ad-887b6cb990c3 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:28:29.498085 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-cae19972-373e-4e64-b8ad-887b6cb990c3 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] [instance: 288b4bf9-edef-4f93-b368-2d2b0b9cb20f] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:28:29.504567 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cae19972-373e-4e64-b8ad-887b6cb990c3 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:28:29.505047 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cae19972-373e-4e64-b8ad-887b6cb990c3 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:28:29.505477 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cae19972-373e-4e64-b8ad-887b6cb990c3 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:28:29.506259 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cae19972-373e-4e64-b8ad-887b6cb990c3 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:28:29.506710 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cae19972-373e-4e64-b8ad-887b6cb990c3 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:28:29.507127 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cae19972-373e-4e64-b8ad-887b6cb990c3 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:28:29.638174 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-cae19972-373e-4e64-b8ad-887b6cb990c3 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dba953d778c418abea22efac408e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36351a4bc84a45cb866e72f52e6e725a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:28:29.645761 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-cae19972-373e-4e64-b8ad-887b6cb990c3 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] 10.222.0.55 "GET /compute/v2.1/servers/288b4bf9-edef-4f93-b368-2d2b0b9cb20f" status: 200 len: 1319 microversion: 2.1 time: 0.152757 Sep 27 17:28:29.646369 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 252/523] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:28:29 2022] GET /compute/v2.1/servers/288b4bf9-edef-4f93-b368-2d2b0b9cb20f => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:28:30.669560 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-5c304aa9-23f3-4819-8ac1-ec07951bbe16 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:28:30.670393 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-5c304aa9-23f3-4819-8ac1-ec07951bbe16 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] [instance: 288b4bf9-edef-4f93-b368-2d2b0b9cb20f] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:28:30.676746 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5c304aa9-23f3-4819-8ac1-ec07951bbe16 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:28:30.677227 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5c304aa9-23f3-4819-8ac1-ec07951bbe16 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:28:30.677656 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5c304aa9-23f3-4819-8ac1-ec07951bbe16 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:28:30.678375 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5c304aa9-23f3-4819-8ac1-ec07951bbe16 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:28:30.678824 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5c304aa9-23f3-4819-8ac1-ec07951bbe16 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:28:30.679245 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5c304aa9-23f3-4819-8ac1-ec07951bbe16 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:28:30.851030 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-5c304aa9-23f3-4819-8ac1-ec07951bbe16 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dba953d778c418abea22efac408e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36351a4bc84a45cb866e72f52e6e725a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:28:30.859793 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-5c304aa9-23f3-4819-8ac1-ec07951bbe16 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] 10.222.0.55 "GET /compute/v2.1/servers/288b4bf9-edef-4f93-b368-2d2b0b9cb20f" status: 200 len: 1319 microversion: 2.1 time: 0.194912 Sep 27 17:28:30.860598 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 272/524] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:28:30 2022] GET /compute/v2.1/servers/288b4bf9-edef-4f93-b368-2d2b0b9cb20f => generated 1319 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:28:31.882337 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-ec306fd7-ee2b-40ac-8068-a02a6209ed67 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:28:31.883029 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-ec306fd7-ee2b-40ac-8068-a02a6209ed67 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] [instance: 288b4bf9-edef-4f93-b368-2d2b0b9cb20f] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:28:31.890667 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ec306fd7-ee2b-40ac-8068-a02a6209ed67 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:28:31.891240 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ec306fd7-ee2b-40ac-8068-a02a6209ed67 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:28:31.891804 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ec306fd7-ee2b-40ac-8068-a02a6209ed67 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:28:31.892566 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ec306fd7-ee2b-40ac-8068-a02a6209ed67 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:28:31.893089 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ec306fd7-ee2b-40ac-8068-a02a6209ed67 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:28:31.893575 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ec306fd7-ee2b-40ac-8068-a02a6209ed67 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:28:32.125074 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-ec306fd7-ee2b-40ac-8068-a02a6209ed67 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dba953d778c418abea22efac408e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36351a4bc84a45cb866e72f52e6e725a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:28:32.134314 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-ec306fd7-ee2b-40ac-8068-a02a6209ed67 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] 10.222.0.55 "GET /compute/v2.1/servers/288b4bf9-edef-4f93-b368-2d2b0b9cb20f" status: 200 len: 1319 microversion: 2.1 time: 0.255755 Sep 27 17:28:32.135877 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 253/525] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:28:31 2022] GET /compute/v2.1/servers/288b4bf9-edef-4f93-b368-2d2b0b9cb20f => generated 1319 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:28:33.163143 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-0c6da9a0-c953-4acf-b42b-616b8c8e0f2d tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:28:33.164301 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-0c6da9a0-c953-4acf-b42b-616b8c8e0f2d tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] [instance: 288b4bf9-edef-4f93-b368-2d2b0b9cb20f] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:28:33.171100 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-0c6da9a0-c953-4acf-b42b-616b8c8e0f2d tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:28:33.171814 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-0c6da9a0-c953-4acf-b42b-616b8c8e0f2d tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:28:33.172396 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-0c6da9a0-c953-4acf-b42b-616b8c8e0f2d tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:28:33.173241 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-0c6da9a0-c953-4acf-b42b-616b8c8e0f2d tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:28:33.173842 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-0c6da9a0-c953-4acf-b42b-616b8c8e0f2d tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:28:33.174445 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-0c6da9a0-c953-4acf-b42b-616b8c8e0f2d tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:28:33.325944 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-0c6da9a0-c953-4acf-b42b-616b8c8e0f2d tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dba953d778c418abea22efac408e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36351a4bc84a45cb866e72f52e6e725a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:28:33.334128 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-0c6da9a0-c953-4acf-b42b-616b8c8e0f2d tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] 10.222.0.55 "GET /compute/v2.1/servers/288b4bf9-edef-4f93-b368-2d2b0b9cb20f" status: 200 len: 1319 microversion: 2.1 time: 0.174691 Sep 27 17:28:33.334814 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 273/526] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:28:33 2022] GET /compute/v2.1/servers/288b4bf9-edef-4f93-b368-2d2b0b9cb20f => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:28:34.357016 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-b0c9e101-c3d6-4ebd-96e9-c3e437b02856 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:28:34.358306 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-b0c9e101-c3d6-4ebd-96e9-c3e437b02856 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] [instance: 288b4bf9-edef-4f93-b368-2d2b0b9cb20f] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:28:34.360792 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell0:SELECT=2 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:28:34.366266 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b0c9e101-c3d6-4ebd-96e9-c3e437b02856 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:28:34.368622 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b0c9e101-c3d6-4ebd-96e9-c3e437b02856 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:28:34.369607 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b0c9e101-c3d6-4ebd-96e9-c3e437b02856 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:28:34.371763 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b0c9e101-c3d6-4ebd-96e9-c3e437b02856 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:28:34.372680 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b0c9e101-c3d6-4ebd-96e9-c3e437b02856 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:28:34.373114 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b0c9e101-c3d6-4ebd-96e9-c3e437b02856 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:28:34.630979 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-b0c9e101-c3d6-4ebd-96e9-c3e437b02856 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dba953d778c418abea22efac408e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36351a4bc84a45cb866e72f52e6e725a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:28:34.641603 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-b0c9e101-c3d6-4ebd-96e9-c3e437b02856 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] 10.222.0.55 "GET /compute/v2.1/servers/288b4bf9-edef-4f93-b368-2d2b0b9cb20f" status: 200 len: 1319 microversion: 2.1 time: 0.288594 Sep 27 17:28:34.642771 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 254/527] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:28:34 2022] GET /compute/v2.1/servers/288b4bf9-edef-4f93-b368-2d2b0b9cb20f => generated 1319 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:28:35.667376 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-357d0719-f8e7-42cb-9242-4842e51376ad tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:28:35.668545 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-357d0719-f8e7-42cb-9242-4842e51376ad tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] [instance: 288b4bf9-edef-4f93-b368-2d2b0b9cb20f] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:28:35.671714 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_cell0:SELECT=2 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:28:35.672977 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_cell0:SELECT=6 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:28:35.677233 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-357d0719-f8e7-42cb-9242-4842e51376ad tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:28:35.677872 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-357d0719-f8e7-42cb-9242-4842e51376ad tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:28:35.678334 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-357d0719-f8e7-42cb-9242-4842e51376ad tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:28:35.679039 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-357d0719-f8e7-42cb-9242-4842e51376ad tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:28:35.679495 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-357d0719-f8e7-42cb-9242-4842e51376ad tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:28:35.679918 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-357d0719-f8e7-42cb-9242-4842e51376ad tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:28:35.900596 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-357d0719-f8e7-42cb-9242-4842e51376ad tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dba953d778c418abea22efac408e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36351a4bc84a45cb866e72f52e6e725a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:28:35.914017 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-357d0719-f8e7-42cb-9242-4842e51376ad tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] 10.222.0.55 "GET /compute/v2.1/servers/288b4bf9-edef-4f93-b368-2d2b0b9cb20f" status: 200 len: 1319 microversion: 2.1 time: 0.251102 Sep 27 17:28:35.915711 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 274/528] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:28:35 2022] GET /compute/v2.1/servers/288b4bf9-edef-4f93-b368-2d2b0b9cb20f => generated 1319 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:28:36.125703 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [req-722b70db-8f79-4875-b012-3581e5bd0520 req-1fc32a80-cbd9-40d0-b34a-79435f2b07cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "288b4bf9-edef-4f93-b368-2d2b0b9cb20f", "name": "network-vif-plugged", "status": "completed", "tag": "2c8a1771-f6b3-42cb-b6ad-c7761e3b0e5f"}]} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:28:36.136452 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-722b70db-8f79-4875-b012-3581e5bd0520 req-1fc32a80-cbd9-40d0-b34a-79435f2b07cd service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:28:36.136928 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-722b70db-8f79-4875-b012-3581e5bd0520 req-1fc32a80-cbd9-40d0-b34a-79435f2b07cd service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:28:36.137524 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-722b70db-8f79-4875-b012-3581e5bd0520 req-1fc32a80-cbd9-40d0-b34a-79435f2b07cd service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:28:36.155079 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.compute.server_external_events [req-722b70db-8f79-4875-b012-3581e5bd0520 req-1fc32a80-cbd9-40d0-b34a-79435f2b07cd service nova] Creating event network-vif-plugged:2c8a1771-f6b3-42cb-b6ad-c7761e3b0e5f for instance 288b4bf9-edef-4f93-b368-2d2b0b9cb20f on hv-cinder-84914 Sep 27 17:28:36.160356 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [req-722b70db-8f79-4875-b012-3581e5bd0520 req-1fc32a80-cbd9-40d0-b34a-79435f2b07cd service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038293 Sep 27 17:28:36.161164 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 255/529] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:28:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:28:36.940694 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-e574e18a-e45d-4596-9712-e7a4791805b7 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:28:36.942240 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-e574e18a-e45d-4596-9712-e7a4791805b7 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] [instance: 288b4bf9-edef-4f93-b368-2d2b0b9cb20f] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:28:36.949858 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e574e18a-e45d-4596-9712-e7a4791805b7 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:28:36.950592 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e574e18a-e45d-4596-9712-e7a4791805b7 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:28:36.951243 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e574e18a-e45d-4596-9712-e7a4791805b7 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:28:36.952196 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e574e18a-e45d-4596-9712-e7a4791805b7 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:28:36.952644 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e574e18a-e45d-4596-9712-e7a4791805b7 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:28:36.953382 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e574e18a-e45d-4596-9712-e7a4791805b7 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:28:37.171901 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-e574e18a-e45d-4596-9712-e7a4791805b7 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dba953d778c418abea22efac408e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36351a4bc84a45cb866e72f52e6e725a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:28:37.179815 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-e574e18a-e45d-4596-9712-e7a4791805b7 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] 10.222.0.55 "GET /compute/v2.1/servers/288b4bf9-edef-4f93-b368-2d2b0b9cb20f" status: 200 len: 1319 microversion: 2.1 time: 0.244001 Sep 27 17:28:37.217989 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 275/530] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:28:36 2022] GET /compute/v2.1/servers/288b4bf9-edef-4f93-b368-2d2b0b9cb20f => generated 1319 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:28:38.205532 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-baffa5b1-1d2e-40b5-b664-57616d587c03 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:28:38.206201 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-baffa5b1-1d2e-40b5-b664-57616d587c03 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] [instance: 288b4bf9-edef-4f93-b368-2d2b0b9cb20f] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:28:38.213240 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-baffa5b1-1d2e-40b5-b664-57616d587c03 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:28:38.213965 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-baffa5b1-1d2e-40b5-b664-57616d587c03 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:28:38.214425 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-baffa5b1-1d2e-40b5-b664-57616d587c03 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:28:38.215141 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-baffa5b1-1d2e-40b5-b664-57616d587c03 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:28:38.215639 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-baffa5b1-1d2e-40b5-b664-57616d587c03 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:28:38.216058 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-baffa5b1-1d2e-40b5-b664-57616d587c03 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:28:38.413814 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-baffa5b1-1d2e-40b5-b664-57616d587c03 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dba953d778c418abea22efac408e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36351a4bc84a45cb866e72f52e6e725a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:28:38.423927 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-baffa5b1-1d2e-40b5-b664-57616d587c03 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] 10.222.0.55 "GET /compute/v2.1/servers/288b4bf9-edef-4f93-b368-2d2b0b9cb20f" status: 200 len: 1319 microversion: 2.1 time: 0.222784 Sep 27 17:28:38.433052 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 256/531] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:28:38 2022] GET /compute/v2.1/servers/288b4bf9-edef-4f93-b368-2d2b0b9cb20f => generated 1319 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:28:39.453387 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-d6d78f4c-9a9f-4ddc-97ca-13bcfabd6824 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:28:39.454622 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-d6d78f4c-9a9f-4ddc-97ca-13bcfabd6824 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] [instance: 288b4bf9-edef-4f93-b368-2d2b0b9cb20f] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:28:39.461621 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d6d78f4c-9a9f-4ddc-97ca-13bcfabd6824 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:28:39.462531 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d6d78f4c-9a9f-4ddc-97ca-13bcfabd6824 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:28:39.463197 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d6d78f4c-9a9f-4ddc-97ca-13bcfabd6824 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:28:39.464122 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d6d78f4c-9a9f-4ddc-97ca-13bcfabd6824 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:28:39.464788 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d6d78f4c-9a9f-4ddc-97ca-13bcfabd6824 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:28:39.465647 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d6d78f4c-9a9f-4ddc-97ca-13bcfabd6824 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:28:40.074932 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-d6d78f4c-9a9f-4ddc-97ca-13bcfabd6824 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dba953d778c418abea22efac408e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36351a4bc84a45cb866e72f52e6e725a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:28:40.090019 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-d6d78f4c-9a9f-4ddc-97ca-13bcfabd6824 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] 10.222.0.55 "GET /compute/v2.1/servers/288b4bf9-edef-4f93-b368-2d2b0b9cb20f" status: 200 len: 1508 microversion: 2.1 time: 0.644829 Sep 27 17:28:40.094370 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 276/532] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:28:39 2022] GET /compute/v2.1/servers/288b4bf9-edef-4f93-b368-2d2b0b9cb20f => generated 1508 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:28:40.116002 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-29bc9366-46d4-4db7-8dd7-dfc94a1c1821 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e07bcdb8-8b8e-4b24-a8ef-7b366e0a43f8", "device": "/dev/sdb"}} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:28:40.119049 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-29bc9366-46d4-4db7-8dd7-dfc94a1c1821 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] [instance: 288b4bf9-edef-4f93-b368-2d2b0b9cb20f] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:28:40.126516 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-29bc9366-46d4-4db7-8dd7-dfc94a1c1821 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:28:40.127219 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-29bc9366-46d4-4db7-8dd7-dfc94a1c1821 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:28:40.127792 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-29bc9366-46d4-4db7-8dd7-dfc94a1c1821 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:28:40.128658 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-29bc9366-46d4-4db7-8dd7-dfc94a1c1821 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:28:40.129253 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-29bc9366-46d4-4db7-8dd7-dfc94a1c1821 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:28:40.129818 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-29bc9366-46d4-4db7-8dd7-dfc94a1c1821 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:28:40.539076 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-29bc9366-46d4-4db7-8dd7-dfc94a1c1821 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] 10.222.0.55 "POST /compute/v2.1/servers/288b4bf9-edef-4f93-b368-2d2b0b9cb20f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.426999 Sep 27 17:28:40.540650 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 257/533] 10.222.0.55 () {60 vars in 1323 bytes} [Tue Sep 27 17:28:40 2022] POST /compute/v2.1/servers/288b4bf9-edef-4f93-b368-2d2b0b9cb20f/os-volume_attachments => generated 194 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:28:42.330867 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-0869422d-247d-4e36-913d-1a97b2e7fd02 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Action: 'create', calling method: .version_select at 0x7fe724db2310>, body: {"keypair": {"name": "tempest-TestShelveInstance-627906043", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKmHIDI7umY+auUMJ7822jWDzr1lG5iryA0q9KxTWtEZoQMzJL9kk96hS2BHephnlgkXd9R8Vvfe/91wapU/kx6tq9rMOMI73ugocIIHf/gY32/VXno4loEjUXOf/UYpzg=="}} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:28:42.348493 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.quota [None req-0869422d-247d-4e36-913d-1a97b2e7fd02 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Getting quotas for project 890469995c02465eb9b9ad2d1fb9ab6f. Resources: {'key_pairs'} {{(pid=120416) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 17:28:42.352433 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.quota [None req-0869422d-247d-4e36-913d-1a97b2e7fd02 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Getting quotas for user fa5bf070765946168f7e5937f2b076c1 and project 890469995c02465eb9b9ad2d1fb9ab6f. Resources: {'key_pairs'} {{(pid=120416) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 17:28:42.376131 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-0869422d-247d-4e36-913d-1a97b2e7fd02 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.250874 Sep 27 17:28:42.376664 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 277/534] 10.222.0.55 () {60 vars in 1159 bytes} [Tue Sep 27 17:28:42 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:28:55.726046 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-22fed1d9-cd59-4cce-9ea0-fb96e349b5b9 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:28:55.726675 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-22fed1d9-cd59-4cce-9ea0-fb96e349b5b9 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:28:55.729241 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_api:SELECT=26 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:28:55.729930 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:28:55.736505 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-22fed1d9-cd59-4cce-9ea0-fb96e349b5b9 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:28:55.737038 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-22fed1d9-cd59-4cce-9ea0-fb96e349b5b9 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:28:55.737431 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-22fed1d9-cd59-4cce-9ea0-fb96e349b5b9 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:28:55.738290 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-22fed1d9-cd59-4cce-9ea0-fb96e349b5b9 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:28:55.738854 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-22fed1d9-cd59-4cce-9ea0-fb96e349b5b9 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:28:55.739285 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-22fed1d9-cd59-4cce-9ea0-fb96e349b5b9 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:28:55.765224 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-22fed1d9-cd59-4cce-9ea0-fb96e349b5b9 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee/ips" status: 200 len: 151 microversion: 2.20 time: 0.043459 Sep 27 17:28:55.765788 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 258/535] 10.222.0.55 () {60 vars in 1289 bytes} [Tue Sep 27 17:28:55 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee/ips => generated 151 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 17:29:00.086057 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_cell1:SELECT=62 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:00.086764 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_cell0:SELECT=4 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:00.087403 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=4 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:00.091989 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-bc5b0824-58bb-4f80-819e-6a6fe9735efe tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:29:00.092512 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-bc5b0824-58bb-4f80-819e-6a6fe9735efe tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:29:00.099992 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-bc5b0824-58bb-4f80-819e-6a6fe9735efe tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:00.100466 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-bc5b0824-58bb-4f80-819e-6a6fe9735efe tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:00.100889 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-bc5b0824-58bb-4f80-819e-6a6fe9735efe tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:00.101561 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-bc5b0824-58bb-4f80-819e-6a6fe9735efe tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:00.102009 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-bc5b0824-58bb-4f80-819e-6a6fe9735efe tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:00.102444 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-bc5b0824-58bb-4f80-819e-6a6fe9735efe tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:00.126496 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.objects.instance [None req-bc5b0824-58bb-4f80-819e-6a6fe9735efe tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lazy-loading 'flavor' on Instance uuid d209f2ce-43c8-422a-a703-cdc9a9fb5cee {{(pid=120416) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 17:29:00.313914 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-bc5b0824-58bb-4f80-819e-6a6fe9735efe tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "POST /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee/action" status: 202 len: 0 microversion: 2.20 time: 0.228501 Sep 27 17:29:00.314521 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 278/536] 10.222.0.55 () {62 vars in 1319 bytes} [Tue Sep 27 17:29:00 2022] POST /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 27 17:29:00.324102 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-9c1ddf87-b6d8-44d0-8b3f-80924c6c6a32 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:29:00.324743 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-9c1ddf87-b6d8-44d0-8b3f-80924c6c6a32 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:29:00.331284 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9c1ddf87-b6d8-44d0-8b3f-80924c6c6a32 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:00.331876 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9c1ddf87-b6d8-44d0-8b3f-80924c6c6a32 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:00.332388 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9c1ddf87-b6d8-44d0-8b3f-80924c6c6a32 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:00.333190 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9c1ddf87-b6d8-44d0-8b3f-80924c6c6a32 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:00.333643 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9c1ddf87-b6d8-44d0-8b3f-80924c6c6a32 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:00.334064 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9c1ddf87-b6d8-44d0-8b3f-80924c6c6a32 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:00.465607 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-9c1ddf87-b6d8-44d0-8b3f-80924c6c6a32 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:00.473908 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-9c1ddf87-b6d8-44d0-8b3f-80924c6c6a32 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:00.475409 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-9c1ddf87-b6d8-44d0-8b3f-80924c6c6a32 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:00.476565 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-9c1ddf87-b6d8-44d0-8b3f-80924c6c6a32 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1722 microversion: 2.20 time: 0.157790 Sep 27 17:29:00.477122 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 259/537] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:29:00 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 17:29:01.502292 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-eac8e575-473b-458c-958a-5c2f5912d874 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:29:01.502983 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-eac8e575-473b-458c-958a-5c2f5912d874 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:29:01.509075 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-eac8e575-473b-458c-958a-5c2f5912d874 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:01.509546 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-eac8e575-473b-458c-958a-5c2f5912d874 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:01.509970 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-eac8e575-473b-458c-958a-5c2f5912d874 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:01.510845 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-eac8e575-473b-458c-958a-5c2f5912d874 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:01.511294 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-eac8e575-473b-458c-958a-5c2f5912d874 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:01.511708 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-eac8e575-473b-458c-958a-5c2f5912d874 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:01.641244 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-eac8e575-473b-458c-958a-5c2f5912d874 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:01.649421 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-eac8e575-473b-458c-958a-5c2f5912d874 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:01.650936 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-eac8e575-473b-458c-958a-5c2f5912d874 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:01.652124 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-eac8e575-473b-458c-958a-5c2f5912d874 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1722 microversion: 2.20 time: 0.154144 Sep 27 17:29:01.652671 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 279/538] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:29:01 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:29:02.677346 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-0abab0c8-98df-4b5e-8d3c-a3a99f0a75a6 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:29:02.677916 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-0abab0c8-98df-4b5e-8d3c-a3a99f0a75a6 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:29:02.684228 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0abab0c8-98df-4b5e-8d3c-a3a99f0a75a6 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:02.684694 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0abab0c8-98df-4b5e-8d3c-a3a99f0a75a6 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:02.685120 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0abab0c8-98df-4b5e-8d3c-a3a99f0a75a6 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:02.685790 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0abab0c8-98df-4b5e-8d3c-a3a99f0a75a6 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:02.686262 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0abab0c8-98df-4b5e-8d3c-a3a99f0a75a6 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:02.686676 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0abab0c8-98df-4b5e-8d3c-a3a99f0a75a6 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:02.825090 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-0abab0c8-98df-4b5e-8d3c-a3a99f0a75a6 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:02.833142 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-0abab0c8-98df-4b5e-8d3c-a3a99f0a75a6 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:02.834550 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-0abab0c8-98df-4b5e-8d3c-a3a99f0a75a6 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:02.835692 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-0abab0c8-98df-4b5e-8d3c-a3a99f0a75a6 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1722 microversion: 2.20 time: 0.162289 Sep 27 17:29:02.836235 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 260/539] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:29:02 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:29:03.861066 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-8fc6238f-20b3-4ee9-8b04-a72493acc1d7 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:29:03.861667 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-8fc6238f-20b3-4ee9-8b04-a72493acc1d7 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:29:03.867522 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8fc6238f-20b3-4ee9-8b04-a72493acc1d7 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:03.867990 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8fc6238f-20b3-4ee9-8b04-a72493acc1d7 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:03.868411 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8fc6238f-20b3-4ee9-8b04-a72493acc1d7 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:03.869100 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8fc6238f-20b3-4ee9-8b04-a72493acc1d7 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:03.869548 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8fc6238f-20b3-4ee9-8b04-a72493acc1d7 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:03.870619 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8fc6238f-20b3-4ee9-8b04-a72493acc1d7 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:04.097955 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-8fc6238f-20b3-4ee9-8b04-a72493acc1d7 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:04.106410 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-8fc6238f-20b3-4ee9-8b04-a72493acc1d7 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:04.107872 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-8fc6238f-20b3-4ee9-8b04-a72493acc1d7 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:04.109022 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-8fc6238f-20b3-4ee9-8b04-a72493acc1d7 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1722 microversion: 2.20 time: 0.251830 Sep 27 17:29:04.109575 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 280/540] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:29:03 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1722 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:29:05.134772 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-336cbd02-47fe-4342-ad25-aa5622cdc448 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:29:05.135372 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-336cbd02-47fe-4342-ad25-aa5622cdc448 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:29:05.141774 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-336cbd02-47fe-4342-ad25-aa5622cdc448 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:05.142282 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-336cbd02-47fe-4342-ad25-aa5622cdc448 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:05.142716 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-336cbd02-47fe-4342-ad25-aa5622cdc448 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:05.143421 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-336cbd02-47fe-4342-ad25-aa5622cdc448 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:05.143869 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-336cbd02-47fe-4342-ad25-aa5622cdc448 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:05.144322 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-336cbd02-47fe-4342-ad25-aa5622cdc448 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:05.321182 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-336cbd02-47fe-4342-ad25-aa5622cdc448 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:05.329192 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-336cbd02-47fe-4342-ad25-aa5622cdc448 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:05.330669 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-336cbd02-47fe-4342-ad25-aa5622cdc448 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:05.331820 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-336cbd02-47fe-4342-ad25-aa5622cdc448 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1722 microversion: 2.20 time: 0.201096 Sep 27 17:29:05.332373 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 261/541] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:29:05 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1722 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:29:06.357784 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-457373a5-92e8-48a2-8b10-d06f5c5f606f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:29:06.358467 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-457373a5-92e8-48a2-8b10-d06f5c5f606f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:29:06.364326 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-457373a5-92e8-48a2-8b10-d06f5c5f606f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:06.364795 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-457373a5-92e8-48a2-8b10-d06f5c5f606f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:06.365216 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-457373a5-92e8-48a2-8b10-d06f5c5f606f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:06.365895 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-457373a5-92e8-48a2-8b10-d06f5c5f606f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:06.366366 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-457373a5-92e8-48a2-8b10-d06f5c5f606f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:06.366785 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-457373a5-92e8-48a2-8b10-d06f5c5f606f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:06.494282 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-457373a5-92e8-48a2-8b10-d06f5c5f606f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:06.502761 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-457373a5-92e8-48a2-8b10-d06f5c5f606f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:06.504198 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-457373a5-92e8-48a2-8b10-d06f5c5f606f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:06.505335 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-457373a5-92e8-48a2-8b10-d06f5c5f606f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1722 microversion: 2.20 time: 0.151874 Sep 27 17:29:06.505886 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 281/542] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:29:06 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:29:07.531747 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-7d8a0148-743c-4bf6-a6e4-1a77001c12c5 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:29:07.532444 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-7d8a0148-743c-4bf6-a6e4-1a77001c12c5 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:29:07.539324 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7d8a0148-743c-4bf6-a6e4-1a77001c12c5 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:07.539937 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7d8a0148-743c-4bf6-a6e4-1a77001c12c5 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:07.540431 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7d8a0148-743c-4bf6-a6e4-1a77001c12c5 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:07.541319 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7d8a0148-743c-4bf6-a6e4-1a77001c12c5 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:07.541775 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7d8a0148-743c-4bf6-a6e4-1a77001c12c5 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:07.542276 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7d8a0148-743c-4bf6-a6e4-1a77001c12c5 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:07.671145 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-7d8a0148-743c-4bf6-a6e4-1a77001c12c5 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:07.679234 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-7d8a0148-743c-4bf6-a6e4-1a77001c12c5 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:07.680696 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-7d8a0148-743c-4bf6-a6e4-1a77001c12c5 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:07.681967 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-7d8a0148-743c-4bf6-a6e4-1a77001c12c5 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1722 microversion: 2.20 time: 0.154284 Sep 27 17:29:07.683207 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 262/543] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:29:07 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:29:08.708491 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-eac9d8db-969a-443d-be84-41e25d4f4996 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:29:08.709101 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-eac9d8db-969a-443d-be84-41e25d4f4996 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:29:08.715571 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-eac9d8db-969a-443d-be84-41e25d4f4996 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:08.716039 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-eac9d8db-969a-443d-be84-41e25d4f4996 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:08.716465 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-eac9d8db-969a-443d-be84-41e25d4f4996 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:08.717137 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-eac9d8db-969a-443d-be84-41e25d4f4996 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:08.717583 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-eac9d8db-969a-443d-be84-41e25d4f4996 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:08.717996 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-eac9d8db-969a-443d-be84-41e25d4f4996 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:08.849314 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-eac9d8db-969a-443d-be84-41e25d4f4996 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:08.857808 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-eac9d8db-969a-443d-be84-41e25d4f4996 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:08.859276 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-eac9d8db-969a-443d-be84-41e25d4f4996 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:08.860415 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-eac9d8db-969a-443d-be84-41e25d4f4996 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1722 microversion: 2.20 time: 0.155846 Sep 27 17:29:08.860973 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 282/544] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:29:08 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:29:09.309681 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-0b7465bf-5700-46d6-9e02-09e68d8a2336 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:29:09.310205 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-0b7465bf-5700-46d6-9e02-09e68d8a2336 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] [instance: 288b4bf9-edef-4f93-b368-2d2b0b9cb20f] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:29:09.316639 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0b7465bf-5700-46d6-9e02-09e68d8a2336 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:09.317123 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0b7465bf-5700-46d6-9e02-09e68d8a2336 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:09.317555 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0b7465bf-5700-46d6-9e02-09e68d8a2336 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:09.318266 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0b7465bf-5700-46d6-9e02-09e68d8a2336 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:09.318717 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0b7465bf-5700-46d6-9e02-09e68d8a2336 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:09.319333 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0b7465bf-5700-46d6-9e02-09e68d8a2336 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:09.397319 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.objects.instance [None req-0b7465bf-5700-46d6-9e02-09e68d8a2336 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lazy-loading 'services' on Instance uuid 288b4bf9-edef-4f93-b368-2d2b0b9cb20f {{(pid=120415) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 17:29:09.469007 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-0b7465bf-5700-46d6-9e02-09e68d8a2336 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] 10.222.0.55 "DELETE /compute/v2.1/servers/288b4bf9-edef-4f93-b368-2d2b0b9cb20f/os-volume_attachments/e07bcdb8-8b8e-4b24-a8ef-7b366e0a43f8" status: 202 len: 0 microversion: 2.1 time: 0.163740 Sep 27 17:29:09.469624 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 263/545] 10.222.0.55 () {58 vars in 1416 bytes} [Tue Sep 27 17:29:09 2022] DELETE /compute/v2.1/servers/288b4bf9-edef-4f93-b368-2d2b0b9cb20f/os-volume_attachments/e07bcdb8-8b8e-4b24-a8ef-7b366e0a43f8 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 17:29:09.886261 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-a402dcdc-989e-4f50-9010-8855ac7c2d09 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:29:09.886879 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-a402dcdc-989e-4f50-9010-8855ac7c2d09 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:29:09.892864 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a402dcdc-989e-4f50-9010-8855ac7c2d09 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:09.893345 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a402dcdc-989e-4f50-9010-8855ac7c2d09 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:09.893780 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a402dcdc-989e-4f50-9010-8855ac7c2d09 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:09.894495 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a402dcdc-989e-4f50-9010-8855ac7c2d09 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:09.894955 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a402dcdc-989e-4f50-9010-8855ac7c2d09 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:09.895378 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a402dcdc-989e-4f50-9010-8855ac7c2d09 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:10.019325 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-a402dcdc-989e-4f50-9010-8855ac7c2d09 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:10.027960 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-a402dcdc-989e-4f50-9010-8855ac7c2d09 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:10.029411 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-a402dcdc-989e-4f50-9010-8855ac7c2d09 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:10.030593 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-a402dcdc-989e-4f50-9010-8855ac7c2d09 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1722 microversion: 2.20 time: 0.148815 Sep 27 17:29:10.031160 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 283/546] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:29:09 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:29:10.596486 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-b06d3c8f-92e5-4f4f-ae32-9c2c7ba4f760 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:29:10.597139 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-b06d3c8f-92e5-4f4f-ae32-9c2c7ba4f760 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] [instance: 288b4bf9-edef-4f93-b368-2d2b0b9cb20f] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:29:10.603291 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b06d3c8f-92e5-4f4f-ae32-9c2c7ba4f760 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:10.604267 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b06d3c8f-92e5-4f4f-ae32-9c2c7ba4f760 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:10.604692 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b06d3c8f-92e5-4f4f-ae32-9c2c7ba4f760 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:10.605368 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b06d3c8f-92e5-4f4f-ae32-9c2c7ba4f760 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:10.606062 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b06d3c8f-92e5-4f4f-ae32-9c2c7ba4f760 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:10.606507 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b06d3c8f-92e5-4f4f-ae32-9c2c7ba4f760 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:10.632354 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-b06d3c8f-92e5-4f4f-ae32-9c2c7ba4f760 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] [instance: 288b4bf9-edef-4f93-b368-2d2b0b9cb20f] Going to try to terminate instance {{(pid=120415) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 17:29:10.703600 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-b06d3c8f-92e5-4f4f-ae32-9c2c7ba4f760 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] 10.222.0.55 "DELETE /compute/v2.1/servers/288b4bf9-edef-4f93-b368-2d2b0b9cb20f" status: 204 len: 0 microversion: 2.1 time: 0.111730 Sep 27 17:29:10.704180 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 264/547] 10.222.0.55 () {58 vars in 1239 bytes} [Tue Sep 27 17:29:10 2022] DELETE /compute/v2.1/servers/288b4bf9-edef-4f93-b368-2d2b0b9cb20f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 17:29:10.712357 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-9432079d-3d07-4481-9d69-88e30183ccf3 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:29:10.713052 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-9432079d-3d07-4481-9d69-88e30183ccf3 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] [instance: 288b4bf9-edef-4f93-b368-2d2b0b9cb20f] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:29:10.719173 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9432079d-3d07-4481-9d69-88e30183ccf3 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:10.719644 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9432079d-3d07-4481-9d69-88e30183ccf3 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:10.720068 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9432079d-3d07-4481-9d69-88e30183ccf3 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:10.720775 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9432079d-3d07-4481-9d69-88e30183ccf3 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:10.721223 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9432079d-3d07-4481-9d69-88e30183ccf3 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:10.721639 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9432079d-3d07-4481-9d69-88e30183ccf3 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:10.851005 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-9432079d-3d07-4481-9d69-88e30183ccf3 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dba953d778c418abea22efac408e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36351a4bc84a45cb866e72f52e6e725a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:10.859304 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-9432079d-3d07-4481-9d69-88e30183ccf3 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] 10.222.0.55 "GET /compute/v2.1/servers/288b4bf9-edef-4f93-b368-2d2b0b9cb20f" status: 200 len: 1514 microversion: 2.1 time: 0.150797 Sep 27 17:29:10.859863 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 284/548] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:29:10 2022] GET /compute/v2.1/servers/288b4bf9-edef-4f93-b368-2d2b0b9cb20f => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:29:11.056338 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-2761764a-f1ea-422a-aeea-7e81e88d006c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:29:11.057037 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-2761764a-f1ea-422a-aeea-7e81e88d006c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:29:11.063004 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2761764a-f1ea-422a-aeea-7e81e88d006c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:11.063483 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2761764a-f1ea-422a-aeea-7e81e88d006c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:11.063912 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2761764a-f1ea-422a-aeea-7e81e88d006c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:11.064605 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2761764a-f1ea-422a-aeea-7e81e88d006c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:11.065051 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2761764a-f1ea-422a-aeea-7e81e88d006c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:11.065464 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2761764a-f1ea-422a-aeea-7e81e88d006c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:11.196473 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-2761764a-f1ea-422a-aeea-7e81e88d006c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:11.204476 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-2761764a-f1ea-422a-aeea-7e81e88d006c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:11.205909 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-2761764a-f1ea-422a-aeea-7e81e88d006c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:11.207112 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-2761764a-f1ea-422a-aeea-7e81e88d006c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1722 microversion: 2.20 time: 0.155200 Sep 27 17:29:11.207651 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 265/549] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:29:11 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:29:11.882716 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-6a8dd76e-f215-4431-bf8e-0e0b0544ca5c tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:29:11.883331 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-6a8dd76e-f215-4431-bf8e-0e0b0544ca5c tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] [instance: 288b4bf9-edef-4f93-b368-2d2b0b9cb20f] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:29:11.890045 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6a8dd76e-f215-4431-bf8e-0e0b0544ca5c tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:11.890561 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6a8dd76e-f215-4431-bf8e-0e0b0544ca5c tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:11.890994 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6a8dd76e-f215-4431-bf8e-0e0b0544ca5c tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:11.891686 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6a8dd76e-f215-4431-bf8e-0e0b0544ca5c tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:11.892139 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6a8dd76e-f215-4431-bf8e-0e0b0544ca5c tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:11.892561 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6a8dd76e-f215-4431-bf8e-0e0b0544ca5c tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:12.017033 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-6a8dd76e-f215-4431-bf8e-0e0b0544ca5c tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dba953d778c418abea22efac408e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36351a4bc84a45cb866e72f52e6e725a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:12.024562 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-6a8dd76e-f215-4431-bf8e-0e0b0544ca5c tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] 10.222.0.55 "GET /compute/v2.1/servers/288b4bf9-edef-4f93-b368-2d2b0b9cb20f" status: 200 len: 1514 microversion: 2.1 time: 0.145890 Sep 27 17:29:12.025115 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 285/550] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:29:11 2022] GET /compute/v2.1/servers/288b4bf9-edef-4f93-b368-2d2b0b9cb20f => generated 1514 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:29:12.233727 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-f086290f-7dfa-4b6a-9c6e-bc530cf0b02b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:29:12.234308 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-f086290f-7dfa-4b6a-9c6e-bc530cf0b02b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:29:12.240594 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f086290f-7dfa-4b6a-9c6e-bc530cf0b02b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:12.241080 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f086290f-7dfa-4b6a-9c6e-bc530cf0b02b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:12.241518 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f086290f-7dfa-4b6a-9c6e-bc530cf0b02b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:12.242237 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f086290f-7dfa-4b6a-9c6e-bc530cf0b02b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:12.242691 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f086290f-7dfa-4b6a-9c6e-bc530cf0b02b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:12.243114 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f086290f-7dfa-4b6a-9c6e-bc530cf0b02b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:12.374628 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-f086290f-7dfa-4b6a-9c6e-bc530cf0b02b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:12.383286 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-f086290f-7dfa-4b6a-9c6e-bc530cf0b02b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:12.384721 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-f086290f-7dfa-4b6a-9c6e-bc530cf0b02b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:12.385931 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-f086290f-7dfa-4b6a-9c6e-bc530cf0b02b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1722 microversion: 2.20 time: 0.157016 Sep 27 17:29:12.386517 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 266/551] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:29:12 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 17:29:13.047934 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-a6249437-d9c0-4cfa-8e41-d8ff78013b5c tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:29:13.048538 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-a6249437-d9c0-4cfa-8e41-d8ff78013b5c tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] [instance: 288b4bf9-edef-4f93-b368-2d2b0b9cb20f] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:29:13.054373 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a6249437-d9c0-4cfa-8e41-d8ff78013b5c tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:13.054985 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a6249437-d9c0-4cfa-8e41-d8ff78013b5c tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:13.055272 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a6249437-d9c0-4cfa-8e41-d8ff78013b5c tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:13.055949 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a6249437-d9c0-4cfa-8e41-d8ff78013b5c tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:13.056391 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a6249437-d9c0-4cfa-8e41-d8ff78013b5c tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:13.056806 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a6249437-d9c0-4cfa-8e41-d8ff78013b5c tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:13.180362 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-a6249437-d9c0-4cfa-8e41-d8ff78013b5c tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dba953d778c418abea22efac408e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36351a4bc84a45cb866e72f52e6e725a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:13.188081 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-a6249437-d9c0-4cfa-8e41-d8ff78013b5c tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] 10.222.0.55 "GET /compute/v2.1/servers/288b4bf9-edef-4f93-b368-2d2b0b9cb20f" status: 200 len: 1514 microversion: 2.1 time: 0.144108 Sep 27 17:29:13.188630 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 286/552] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:29:13 2022] GET /compute/v2.1/servers/288b4bf9-edef-4f93-b368-2d2b0b9cb20f => generated 1514 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:29:13.413123 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-6cdd1c44-4d4e-46c7-952f-f0d1a0016602 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:29:13.413728 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-6cdd1c44-4d4e-46c7-952f-f0d1a0016602 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:29:13.420068 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6cdd1c44-4d4e-46c7-952f-f0d1a0016602 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:13.420544 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6cdd1c44-4d4e-46c7-952f-f0d1a0016602 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:13.420980 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6cdd1c44-4d4e-46c7-952f-f0d1a0016602 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:13.421661 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6cdd1c44-4d4e-46c7-952f-f0d1a0016602 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:13.422131 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6cdd1c44-4d4e-46c7-952f-f0d1a0016602 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:13.422559 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6cdd1c44-4d4e-46c7-952f-f0d1a0016602 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:13.648599 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-6cdd1c44-4d4e-46c7-952f-f0d1a0016602 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:13.656594 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-6cdd1c44-4d4e-46c7-952f-f0d1a0016602 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:13.658274 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-6cdd1c44-4d4e-46c7-952f-f0d1a0016602 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:13.659316 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-6cdd1c44-4d4e-46c7-952f-f0d1a0016602 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1722 microversion: 2.20 time: 0.250144 Sep 27 17:29:13.659863 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 267/553] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:29:13 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1722 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:29:13.970514 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [req-59b47bff-cf48-40ad-a7f5-23ffe6695901 req-da15abb3-f239-4cc5-94f1-a7c3cb4639e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "288b4bf9-edef-4f93-b368-2d2b0b9cb20f", "name": "network-vif-deleted", "tag": "2c8a1771-f6b3-42cb-b6ad-c7761e3b0e5f"}]} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:29:13.980551 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-59b47bff-cf48-40ad-a7f5-23ffe6695901 req-da15abb3-f239-4cc5-94f1-a7c3cb4639e1 service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:13.981278 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-59b47bff-cf48-40ad-a7f5-23ffe6695901 req-da15abb3-f239-4cc5-94f1-a7c3cb4639e1 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:13.981705 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-59b47bff-cf48-40ad-a7f5-23ffe6695901 req-da15abb3-f239-4cc5-94f1-a7c3cb4639e1 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:13.993509 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.compute.server_external_events [req-59b47bff-cf48-40ad-a7f5-23ffe6695901 req-da15abb3-f239-4cc5-94f1-a7c3cb4639e1 service nova] Creating event network-vif-deleted:2c8a1771-f6b3-42cb-b6ad-c7761e3b0e5f for instance 288b4bf9-edef-4f93-b368-2d2b0b9cb20f on hv-cinder-84914 Sep 27 17:29:13.998576 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [req-59b47bff-cf48-40ad-a7f5-23ffe6695901 req-da15abb3-f239-4cc5-94f1-a7c3cb4639e1 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031777 Sep 27 17:29:13.999152 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 287/554] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:29:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:29:14.211397 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-e4f7929a-a393-4593-9cfb-048048af3996 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:29:14.211928 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-e4f7929a-a393-4593-9cfb-048048af3996 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] [instance: 288b4bf9-edef-4f93-b368-2d2b0b9cb20f] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:29:14.218743 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e4f7929a-a393-4593-9cfb-048048af3996 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:14.219424 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e4f7929a-a393-4593-9cfb-048048af3996 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:14.219868 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e4f7929a-a393-4593-9cfb-048048af3996 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:14.220566 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e4f7929a-a393-4593-9cfb-048048af3996 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:14.221022 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e4f7929a-a393-4593-9cfb-048048af3996 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:14.221448 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e4f7929a-a393-4593-9cfb-048048af3996 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:14.255298 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e4f7929a-a393-4593-9cfb-048048af3996 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:14.255867 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e4f7929a-a393-4593-9cfb-048048af3996 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:14.256305 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e4f7929a-a393-4593-9cfb-048048af3996 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:14.256742 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.objects.instance [None req-e4f7929a-a393-4593-9cfb-048048af3996 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lazy-loading 'fault' on Instance uuid 288b4bf9-edef-4f93-b368-2d2b0b9cb20f {{(pid=120415) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 17:29:14.305783 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-e4f7929a-a393-4593-9cfb-048048af3996 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dba953d778c418abea22efac408e2db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36351a4bc84a45cb866e72f52e6e725a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:14.312872 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-e4f7929a-a393-4593-9cfb-048048af3996 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] 10.222.0.55 "GET /compute/v2.1/servers/288b4bf9-edef-4f93-b368-2d2b0b9cb20f" status: 200 len: 1309 microversion: 2.1 time: 0.106108 Sep 27 17:29:14.313587 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 268/555] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:29:14 2022] GET /compute/v2.1/servers/288b4bf9-edef-4f93-b368-2d2b0b9cb20f => generated 1309 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:29:14.685155 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-e5cc247f-07e6-40d3-af48-e7930b8ed93f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:29:14.685845 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-e5cc247f-07e6-40d3-af48-e7930b8ed93f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:29:14.691851 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e5cc247f-07e6-40d3-af48-e7930b8ed93f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:14.692330 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e5cc247f-07e6-40d3-af48-e7930b8ed93f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:14.692760 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e5cc247f-07e6-40d3-af48-e7930b8ed93f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:14.693439 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e5cc247f-07e6-40d3-af48-e7930b8ed93f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:14.693891 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e5cc247f-07e6-40d3-af48-e7930b8ed93f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:14.694341 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e5cc247f-07e6-40d3-af48-e7930b8ed93f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:14.833726 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-e5cc247f-07e6-40d3-af48-e7930b8ed93f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:14.842020 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-e5cc247f-07e6-40d3-af48-e7930b8ed93f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:14.843513 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-e5cc247f-07e6-40d3-af48-e7930b8ed93f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:14.844703 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-e5cc247f-07e6-40d3-af48-e7930b8ed93f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1722 microversion: 2.20 time: 0.163801 Sep 27 17:29:14.845395 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 288/556] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:29:14 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:29:15.335888 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-7a0dc204-008c-4784-9333-9676e1d5b0b2 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:29:15.336505 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-7a0dc204-008c-4784-9333-9676e1d5b0b2 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] [instance: 288b4bf9-edef-4f93-b368-2d2b0b9cb20f] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:29:15.343551 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7a0dc204-008c-4784-9333-9676e1d5b0b2 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:15.344032 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7a0dc204-008c-4784-9333-9676e1d5b0b2 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:15.344468 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7a0dc204-008c-4784-9333-9676e1d5b0b2 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:15.345152 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7a0dc204-008c-4784-9333-9676e1d5b0b2 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:15.345606 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7a0dc204-008c-4784-9333-9676e1d5b0b2 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:15.346029 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7a0dc204-008c-4784-9333-9676e1d5b0b2 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:15.360059 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.wsgi [None req-7a0dc204-008c-4784-9333-9676e1d5b0b2 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] HTTP exception thrown: Instance 288b4bf9-edef-4f93-b368-2d2b0b9cb20f could not be found. Sep 27 17:29:15.361696 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-7a0dc204-008c-4784-9333-9676e1d5b0b2 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Request method failure captured: Sep 27 17:29:15.361696 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: request: GET /compute/v2.1/servers/288b4bf9-edef-4f93-b368-2d2b0b9cb20f HTTP/1.1 Sep 27 17:29:15.361696 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Accept: application/json Sep 27 17:29:15.361696 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Accept-Encoding: identity Sep 27 17:29:15.361696 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Connection: close Sep 27 17:29:15.361696 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Content-Length: 0 Sep 27 17:29:15.361696 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Content-Type: application/json Sep 27 17:29:15.361696 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Host: 10.222.0.55 Sep 27 17:29:15.361696 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Openstack-System-Scope: None Sep 27 17:29:15.361696 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: User-Agent: python-urllib3/1.26.12 Sep 27 17:29:15.361696 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Auth-Token: gAAAAABjMzIEzpsmOrEtCzJjKCpgePzPY3xIA_i3kVdqVR1KNk69_LRz3estPjYRWlSJIxFCmVD9d3R8WNgG3gYqsAdeLqYOl9yxQ7NymBbKwI0cI21j2c0V5M1yma0b6uBA4w2N4FnuW7oyeNSTkhIO10_WfiisRN42wcdkrHED2XEjr3BcHDo Sep 27 17:29:15.361696 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Domain-Id: None Sep 27 17:29:15.361696 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Domain-Name: None Sep 27 17:29:15.361696 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Identity-Status: Confirmed Sep 27 17:29:15.361696 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Is-Admin-Project: True Sep 27 17:29:15.361696 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Domain-Id: default Sep 27 17:29:15.361696 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Domain-Name: Default Sep 27 17:29:15.361696 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Id: 36351a4bc84a45cb866e72f52e6e725a Sep 27 17:29:15.361696 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Name: tempest-VolumesSnapshotTestJSON-86261250 Sep 27 17:29:15.361696 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Role: reader,member Sep 27 17:29:15.361696 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Roles: reader,member Sep 27 17:29:15.363479 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/36351a4bc84a45cb866e72f52e6e725a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_36351a4bc84a45cb866e72f52e6e725a", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/36351a4bc84a45cb866e72f52e6e725a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/36351a4bc84a45cb866e72f52e6e725a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 27 17:29:15.363479 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Tenant: tempest-VolumesSnapshotTestJSON-86261250 Sep 27 17:29:15.363479 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Tenant-Id: 36351a4bc84a45cb866e72f52e6e725a Sep 27 17:29:15.363479 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-86261250 Sep 27 17:29:15.363479 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User: tempest-VolumesSnapshotTestJSON-86261250-project Sep 27 17:29:15.363479 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Domain-Id: default Sep 27 17:29:15.363479 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Domain-Name: Default Sep 27 17:29:15.363479 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Id: 1dba953d778c418abea22efac408e2db Sep 27 17:29:15.363479 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Name: tempest-VolumesSnapshotTestJSON-86261250-project Sep 27 17:29:15.363479 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: method: > Sep 27 17:29:15.363479 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: exception: Instance 288b4bf9-edef-4f93-b368-2d2b0b9cb20f could not be found. Sep 27 17:29:15.363479 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: action_args: {'id': '288b4bf9-edef-4f93-b368-2d2b0b9cb20f'} Sep 27 17:29:15.364255 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 17:29:15.364255 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:29:15.364255 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 17:29:15.364255 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 17:29:15.364255 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 17:29:15.364255 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 17:29:15.364255 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 17:29:15.364255 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 17:29:15.364255 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 17:29:15.364255 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 17:29:15.364255 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 288b4bf9-edef-4f93-b368-2d2b0b9cb20f could not be found. Sep 27 17:29:15.364255 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:29:15.364255 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:29:15.364255 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:29:15.364255 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:29:15.364255 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:29:15.364255 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:29:15.364255 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 17:29:15.364255 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 17:29:15.364255 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 17:29:15.365560 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 17:29:15.365560 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 17:29:15.365560 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 17:29:15.365560 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 17:29:15.365560 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 17:29:15.365560 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 17:29:15.365560 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 17:29:15.365560 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 288b4bf9-edef-4f93-b368-2d2b0b9cb20f could not be found. Sep 27 17:29:15.365560 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:29:15.365560 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:29:15.365560 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:29:15.365560 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:29:15.365560 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:29:15.365560 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:29:15.365560 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 17:29:15.365560 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 17:29:15.365560 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 288b4bf9-edef-4f93-b368-2d2b0b9cb20f could not be found. Sep 27 17:29:15.365560 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:29:15.366728 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-7a0dc204-008c-4784-9333-9676e1d5b0b2 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] Returning 404 to user: Instance 288b4bf9-edef-4f93-b368-2d2b0b9cb20f could not be found. {{(pid=120415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 17:29:15.366728 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-7a0dc204-008c-4784-9333-9676e1d5b0b2 tempest-VolumesSnapshotTestJSON-86261250 tempest-VolumesSnapshotTestJSON-86261250-project] 10.222.0.55 "GET /compute/v2.1/servers/288b4bf9-edef-4f93-b368-2d2b0b9cb20f" status: 404 len: 111 microversion: 2.1 time: 0.031102 Sep 27 17:29:15.366728 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 269/557] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:29:15 2022] GET /compute/v2.1/servers/288b4bf9-edef-4f93-b368-2d2b0b9cb20f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 27 17:29:15.968822 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-7fe89b3c-e9cf-4d7b-bb4e-9dc7addce1c9 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:29:15.969440 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-7fe89b3c-e9cf-4d7b-bb4e-9dc7addce1c9 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:29:15.975314 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7fe89b3c-e9cf-4d7b-bb4e-9dc7addce1c9 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:15.975792 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7fe89b3c-e9cf-4d7b-bb4e-9dc7addce1c9 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:15.976223 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7fe89b3c-e9cf-4d7b-bb4e-9dc7addce1c9 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:15.976915 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7fe89b3c-e9cf-4d7b-bb4e-9dc7addce1c9 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:15.977372 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7fe89b3c-e9cf-4d7b-bb4e-9dc7addce1c9 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:15.977795 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7fe89b3c-e9cf-4d7b-bb4e-9dc7addce1c9 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:16.106343 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-7fe89b3c-e9cf-4d7b-bb4e-9dc7addce1c9 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:16.114358 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-7fe89b3c-e9cf-4d7b-bb4e-9dc7addce1c9 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:16.115819 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-7fe89b3c-e9cf-4d7b-bb4e-9dc7addce1c9 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:16.116977 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-7fe89b3c-e9cf-4d7b-bb4e-9dc7addce1c9 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1722 microversion: 2.20 time: 0.249373 Sep 27 17:29:16.117541 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 289/558] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:29:15 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1722 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:29:17.142243 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-aa2abea6-9ab4-45be-b7bb-3a1db2c4689c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:29:17.143158 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-aa2abea6-9ab4-45be-b7bb-3a1db2c4689c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:29:17.149346 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-aa2abea6-9ab4-45be-b7bb-3a1db2c4689c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:17.149904 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-aa2abea6-9ab4-45be-b7bb-3a1db2c4689c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:17.150878 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-aa2abea6-9ab4-45be-b7bb-3a1db2c4689c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:17.151583 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-aa2abea6-9ab4-45be-b7bb-3a1db2c4689c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:17.152037 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-aa2abea6-9ab4-45be-b7bb-3a1db2c4689c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:17.152462 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-aa2abea6-9ab4-45be-b7bb-3a1db2c4689c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:17.289419 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-aa2abea6-9ab4-45be-b7bb-3a1db2c4689c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:17.296669 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-aa2abea6-9ab4-45be-b7bb-3a1db2c4689c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:17.298182 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-aa2abea6-9ab4-45be-b7bb-3a1db2c4689c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:17.299346 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-aa2abea6-9ab4-45be-b7bb-3a1db2c4689c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1722 microversion: 2.20 time: 0.161049 Sep 27 17:29:17.299910 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 270/559] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:29:17 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:29:17.753773 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-ed73bd2c-1b32-4f12-b22c-2550940077db tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-958423474", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-627906043", "security_groups": [{"name": "tempest-secgroup-smoke-1203935763"}], "networks": [{"uuid": "e6883946-abcd-4f9b-9769-763b58bec55e"}], "block_device_mapping_v2": [{"uuid": "6b555aa0-eb72-4676-a4c0-2b65eec930f6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:29:17.887775 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.network.neutron [None req-ed73bd2c-1b32-4f12-b22c-2550940077db tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] validate_networks() for [('e6883946-abcd-4f9b-9769-763b58bec55e', None, None, None, None, None)] {{(pid=120416) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 17:29:18.301870 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.virt.hardware [None req-ed73bd2c-1b32-4f12-b22c-2550940077db tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Flavor limits 0:0:0 {{(pid=120416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 17:29:18.302334 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.virt.hardware [None req-ed73bd2c-1b32-4f12-b22c-2550940077db tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Image limits 0:0:0 {{(pid=120416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 17:29:18.302815 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.virt.hardware [None req-ed73bd2c-1b32-4f12-b22c-2550940077db tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Flavor pref 0:0:0 {{(pid=120416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 17:29:18.303225 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.virt.hardware [None req-ed73bd2c-1b32-4f12-b22c-2550940077db tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Image pref 0:0:0 {{(pid=120416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 17:29:18.303641 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.virt.hardware [None req-ed73bd2c-1b32-4f12-b22c-2550940077db tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 17:29:18.312601 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ed73bd2c-1b32-4f12-b22c-2550940077db tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:18.313083 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ed73bd2c-1b32-4f12-b22c-2550940077db tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:18.313514 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ed73bd2c-1b32-4f12-b22c-2550940077db tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:18.314311 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ed73bd2c-1b32-4f12-b22c-2550940077db tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:18.314765 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ed73bd2c-1b32-4f12-b22c-2550940077db tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:18.315196 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ed73bd2c-1b32-4f12-b22c-2550940077db tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:18.324557 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-5003829c-0e2d-482a-b11a-c7e08ce2ba20 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:29:18.325095 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-5003829c-0e2d-482a-b11a-c7e08ce2ba20 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:29:18.327472 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 27 17:29:18.327604 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Tue Sep 27 17:29:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee (ip 10.222.0.55) !!! Sep 27 17:29:18.332440 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.quota [None req-ed73bd2c-1b32-4f12-b22c-2550940077db tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Getting quotas for project 890469995c02465eb9b9ad2d1fb9ab6f. Resources: {'cores', 'ram', 'instances'} {{(pid=120416) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 17:29:18.336331 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.quota [None req-ed73bd2c-1b32-4f12-b22c-2550940077db tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Getting quotas for user fa5bf070765946168f7e5937f2b076c1 and project 890469995c02465eb9b9ad2d1fb9ab6f. Resources: {'cores', 'ram', 'instances'} {{(pid=120416) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 17:29:18.339816 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5003829c-0e2d-482a-b11a-c7e08ce2ba20 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:18.340299 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5003829c-0e2d-482a-b11a-c7e08ce2ba20 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:18.340727 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5003829c-0e2d-482a-b11a-c7e08ce2ba20 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:18.341416 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5003829c-0e2d-482a-b11a-c7e08ce2ba20 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:18.341865 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5003829c-0e2d-482a-b11a-c7e08ce2ba20 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:18.342316 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5003829c-0e2d-482a-b11a-c7e08ce2ba20 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:18.395393 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-ed73bd2c-1b32-4f12-b22c-2550940077db tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Going to run 1 instances... {{(pid=120416) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 17:29:18.397721 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-ed73bd2c-1b32-4f12-b22c-2550940077db tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] [instance: 8b3855b6-18b1-46de-a1cc-f7a2941a42b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6b555aa0-eb72-4676-a4c0-2b65eec930f6',volume_size=None,volume_type=None)] {{(pid=120416) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 17:29:18.473201 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-5003829c-0e2d-482a-b11a-c7e08ce2ba20 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:18.482383 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-5003829c-0e2d-482a-b11a-c7e08ce2ba20 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:18.483939 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-5003829c-0e2d-482a-b11a-c7e08ce2ba20 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:18.485108 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-5003829c-0e2d-482a-b11a-c7e08ce2ba20 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1722 microversion: 2.20 time: 0.165054 Sep 27 17:29:18.485655 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 271/560] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:29:18 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 17:29:18.532581 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-ed73bd2c-1b32-4f12-b22c-2550940077db tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.782360 Sep 27 17:29:18.533227 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 290/561] 10.222.0.55 () {60 vars in 1147 bytes} [Tue Sep 27 17:29:17 2022] POST /compute/v2.1/servers => generated 406 bytes in 784 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 17:29:18.544230 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-01811129-dcee-455e-9aec-76ab373d155d tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:29:18.544836 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-01811129-dcee-455e-9aec-76ab373d155d tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] [instance: 8b3855b6-18b1-46de-a1cc-f7a2941a42b9] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:29:18.606412 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-01811129-dcee-455e-9aec-76ab373d155d tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5bf070765946168f7e5937f2b076c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890469995c02465eb9b9ad2d1fb9ab6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:18.613543 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-01811129-dcee-455e-9aec-76ab373d155d tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] 10.222.0.55 "GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9" status: 200 len: 1087 microversion: 2.1 time: 0.073093 Sep 27 17:29:18.614171 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 272/562] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:29:18 2022] GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9 => generated 1087 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:29:19.510747 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-6bbae9a9-8178-4ffe-85f6-df0a93f22160 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:29:19.511351 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-6bbae9a9-8178-4ffe-85f6-df0a93f22160 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:29:19.517308 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6bbae9a9-8178-4ffe-85f6-df0a93f22160 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:19.517778 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6bbae9a9-8178-4ffe-85f6-df0a93f22160 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:19.518235 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6bbae9a9-8178-4ffe-85f6-df0a93f22160 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:19.518919 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6bbae9a9-8178-4ffe-85f6-df0a93f22160 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:19.519364 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6bbae9a9-8178-4ffe-85f6-df0a93f22160 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:19.519779 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6bbae9a9-8178-4ffe-85f6-df0a93f22160 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:19.637076 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-cc72fee7-209c-4610-8907-35d3c52ac73e tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:29:19.637732 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-cc72fee7-209c-4610-8907-35d3c52ac73e tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] [instance: 8b3855b6-18b1-46de-a1cc-f7a2941a42b9] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:29:19.645277 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cc72fee7-209c-4610-8907-35d3c52ac73e tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:19.645809 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cc72fee7-209c-4610-8907-35d3c52ac73e tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:19.646301 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cc72fee7-209c-4610-8907-35d3c52ac73e tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:19.646419 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-6bbae9a9-8178-4ffe-85f6-df0a93f22160 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:19.647062 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cc72fee7-209c-4610-8907-35d3c52ac73e tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:19.647544 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cc72fee7-209c-4610-8907-35d3c52ac73e tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:19.648020 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cc72fee7-209c-4610-8907-35d3c52ac73e tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:19.656576 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-6bbae9a9-8178-4ffe-85f6-df0a93f22160 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:19.658242 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-6bbae9a9-8178-4ffe-85f6-df0a93f22160 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:19.659549 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-6bbae9a9-8178-4ffe-85f6-df0a93f22160 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1722 microversion: 2.20 time: 0.152826 Sep 27 17:29:19.660457 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 291/563] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:29:19 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:29:19.709981 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-cc72fee7-209c-4610-8907-35d3c52ac73e tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5bf070765946168f7e5937f2b076c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890469995c02465eb9b9ad2d1fb9ab6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:19.713879 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:19.719302 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-cc72fee7-209c-4610-8907-35d3c52ac73e tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] 10.222.0.55 "GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9" status: 200 len: 1137 microversion: 2.1 time: 0.086838 Sep 27 17:29:19.719910 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 273/564] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:29:19 2022] GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9 => generated 1137 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:29:20.684737 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-c3fe53e2-c7f3-40fa-a233-7755734a11e5 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:29:20.685349 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-c3fe53e2-c7f3-40fa-a233-7755734a11e5 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:29:20.691573 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c3fe53e2-c7f3-40fa-a233-7755734a11e5 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:20.692053 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c3fe53e2-c7f3-40fa-a233-7755734a11e5 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:20.692494 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c3fe53e2-c7f3-40fa-a233-7755734a11e5 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:20.693180 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c3fe53e2-c7f3-40fa-a233-7755734a11e5 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:20.693637 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c3fe53e2-c7f3-40fa-a233-7755734a11e5 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:20.694064 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c3fe53e2-c7f3-40fa-a233-7755734a11e5 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:20.745253 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-4acb6b3f-5aea-4428-8054-91f7ac5d3d78 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:29:20.745861 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-4acb6b3f-5aea-4428-8054-91f7ac5d3d78 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] [instance: 8b3855b6-18b1-46de-a1cc-f7a2941a42b9] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:29:20.754427 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4acb6b3f-5aea-4428-8054-91f7ac5d3d78 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:20.754941 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4acb6b3f-5aea-4428-8054-91f7ac5d3d78 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:20.755378 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4acb6b3f-5aea-4428-8054-91f7ac5d3d78 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:20.756110 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4acb6b3f-5aea-4428-8054-91f7ac5d3d78 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:20.756565 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4acb6b3f-5aea-4428-8054-91f7ac5d3d78 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:20.756994 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4acb6b3f-5aea-4428-8054-91f7ac5d3d78 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:20.831153 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-4acb6b3f-5aea-4428-8054-91f7ac5d3d78 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5bf070765946168f7e5937f2b076c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890469995c02465eb9b9ad2d1fb9ab6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:20.841419 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-4acb6b3f-5aea-4428-8054-91f7ac5d3d78 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] 10.222.0.55 "GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9" status: 200 len: 1129 microversion: 2.1 time: 0.100453 Sep 27 17:29:20.842004 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 274/565] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:29:20 2022] GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9 => generated 1129 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:29:20.854183 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-c3fe53e2-c7f3-40fa-a233-7755734a11e5 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:20.863035 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-c3fe53e2-c7f3-40fa-a233-7755734a11e5 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:20.864515 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-c3fe53e2-c7f3-40fa-a233-7755734a11e5 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:20.865676 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-c3fe53e2-c7f3-40fa-a233-7755734a11e5 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1722 microversion: 2.20 time: 0.184921 Sep 27 17:29:20.866280 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 292/566] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:29:20 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:29:21.866013 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-4c645505-8e09-49cb-a599-91eeb699b971 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:29:21.866640 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-4c645505-8e09-49cb-a599-91eeb699b971 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] [instance: 8b3855b6-18b1-46de-a1cc-f7a2941a42b9] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:29:21.868623 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 27 17:29:21.868765 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Tue Sep 27 17:29:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9 (ip 10.222.0.55) !!! Sep 27 17:29:21.875190 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4c645505-8e09-49cb-a599-91eeb699b971 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:21.875665 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4c645505-8e09-49cb-a599-91eeb699b971 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:21.876091 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4c645505-8e09-49cb-a599-91eeb699b971 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:21.876759 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4c645505-8e09-49cb-a599-91eeb699b971 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:21.877203 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4c645505-8e09-49cb-a599-91eeb699b971 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:21.877616 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4c645505-8e09-49cb-a599-91eeb699b971 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:21.892931 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-5732c5a7-e46d-4b58-b06b-4b3cb0207f56 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:29:21.893680 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-5732c5a7-e46d-4b58-b06b-4b3cb0207f56 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:29:21.899920 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5732c5a7-e46d-4b58-b06b-4b3cb0207f56 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:21.900981 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5732c5a7-e46d-4b58-b06b-4b3cb0207f56 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:21.901450 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5732c5a7-e46d-4b58-b06b-4b3cb0207f56 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:21.902208 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5732c5a7-e46d-4b58-b06b-4b3cb0207f56 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:21.902698 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5732c5a7-e46d-4b58-b06b-4b3cb0207f56 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:21.903144 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5732c5a7-e46d-4b58-b06b-4b3cb0207f56 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:21.942360 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-4c645505-8e09-49cb-a599-91eeb699b971 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5bf070765946168f7e5937f2b076c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890469995c02465eb9b9ad2d1fb9ab6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:21.950657 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-4c645505-8e09-49cb-a599-91eeb699b971 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] 10.222.0.55 "GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9" status: 200 len: 1129 microversion: 2.1 time: 0.088428 Sep 27 17:29:21.951226 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 275/567] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:29:21 2022] GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9 => generated 1129 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:29:22.038952 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-5732c5a7-e46d-4b58-b06b-4b3cb0207f56 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:22.042428 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:22.048011 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-5732c5a7-e46d-4b58-b06b-4b3cb0207f56 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:22.049480 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-5732c5a7-e46d-4b58-b06b-4b3cb0207f56 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:22.050670 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-5732c5a7-e46d-4b58-b06b-4b3cb0207f56 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1722 microversion: 2.20 time: 0.161724 Sep 27 17:29:22.051403 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 293/568] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:29:21 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 17:29:22.974666 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-f4fc2cad-4683-4f6b-91b8-a793cb0a2b57 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:29:22.975275 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-f4fc2cad-4683-4f6b-91b8-a793cb0a2b57 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] [instance: 8b3855b6-18b1-46de-a1cc-f7a2941a42b9] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:29:22.982456 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f4fc2cad-4683-4f6b-91b8-a793cb0a2b57 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:22.982947 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f4fc2cad-4683-4f6b-91b8-a793cb0a2b57 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:22.983375 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f4fc2cad-4683-4f6b-91b8-a793cb0a2b57 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:22.984058 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f4fc2cad-4683-4f6b-91b8-a793cb0a2b57 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:22.984511 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f4fc2cad-4683-4f6b-91b8-a793cb0a2b57 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:22.984934 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f4fc2cad-4683-4f6b-91b8-a793cb0a2b57 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:23.054200 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-f4fc2cad-4683-4f6b-91b8-a793cb0a2b57 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5bf070765946168f7e5937f2b076c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890469995c02465eb9b9ad2d1fb9ab6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:23.064547 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-f4fc2cad-4683-4f6b-91b8-a793cb0a2b57 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] 10.222.0.55 "GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9" status: 200 len: 1185 microversion: 2.1 time: 0.093343 Sep 27 17:29:23.065132 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 276/569] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:29:22 2022] GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9 => generated 1185 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:29:23.078687 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-29da955e-9a28-449b-8095-50d94c1901ab tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:29:23.079775 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-29da955e-9a28-449b-8095-50d94c1901ab tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:29:23.087550 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-29da955e-9a28-449b-8095-50d94c1901ab tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:23.088536 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-29da955e-9a28-449b-8095-50d94c1901ab tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:23.088963 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-29da955e-9a28-449b-8095-50d94c1901ab tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:23.089646 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-29da955e-9a28-449b-8095-50d94c1901ab tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:23.090137 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-29da955e-9a28-449b-8095-50d94c1901ab tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:23.090603 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-29da955e-9a28-449b-8095-50d94c1901ab tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:23.229978 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-29da955e-9a28-449b-8095-50d94c1901ab tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:23.238517 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-29da955e-9a28-449b-8095-50d94c1901ab tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:23.239997 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-29da955e-9a28-449b-8095-50d94c1901ab tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:23.241271 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-29da955e-9a28-449b-8095-50d94c1901ab tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1722 microversion: 2.20 time: 0.166449 Sep 27 17:29:23.241829 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 294/570] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:29:23 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:29:24.086830 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-f19a50f7-e4e2-4373-9293-4fd2c98bf66f tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:29:24.088077 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-f19a50f7-e4e2-4373-9293-4fd2c98bf66f tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] [instance: 8b3855b6-18b1-46de-a1cc-f7a2941a42b9] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:29:24.094626 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f19a50f7-e4e2-4373-9293-4fd2c98bf66f tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:24.095328 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f19a50f7-e4e2-4373-9293-4fd2c98bf66f tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:24.095760 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f19a50f7-e4e2-4373-9293-4fd2c98bf66f tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:24.096457 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f19a50f7-e4e2-4373-9293-4fd2c98bf66f tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:24.096898 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f19a50f7-e4e2-4373-9293-4fd2c98bf66f tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:24.097314 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f19a50f7-e4e2-4373-9293-4fd2c98bf66f tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:24.170597 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-f19a50f7-e4e2-4373-9293-4fd2c98bf66f tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5bf070765946168f7e5937f2b076c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890469995c02465eb9b9ad2d1fb9ab6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:24.178218 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-f19a50f7-e4e2-4373-9293-4fd2c98bf66f tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] 10.222.0.55 "GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9" status: 200 len: 1203 microversion: 2.1 time: 0.095249 Sep 27 17:29:24.178767 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 277/571] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:29:24 2022] GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9 => generated 1203 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:29:24.267820 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-f15e4121-e80d-4aba-91a2-0599d1c14150 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:29:24.268662 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-f15e4121-e80d-4aba-91a2-0599d1c14150 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:29:24.274611 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f15e4121-e80d-4aba-91a2-0599d1c14150 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:24.275145 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f15e4121-e80d-4aba-91a2-0599d1c14150 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:24.276077 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f15e4121-e80d-4aba-91a2-0599d1c14150 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:24.276775 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f15e4121-e80d-4aba-91a2-0599d1c14150 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:24.277222 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f15e4121-e80d-4aba-91a2-0599d1c14150 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:24.277644 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f15e4121-e80d-4aba-91a2-0599d1c14150 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:24.470726 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-f15e4121-e80d-4aba-91a2-0599d1c14150 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:24.482240 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-f15e4121-e80d-4aba-91a2-0599d1c14150 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:24.483852 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-f15e4121-e80d-4aba-91a2-0599d1c14150 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:24.485135 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-f15e4121-e80d-4aba-91a2-0599d1c14150 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1722 microversion: 2.20 time: 0.221253 Sep 27 17:29:24.486202 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 295/572] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:29:24 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1722 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:29:25.203034 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-b5a3a8e7-e585-42a8-8f03-4ae549094ecc tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:29:25.203742 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-b5a3a8e7-e585-42a8-8f03-4ae549094ecc tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] [instance: 8b3855b6-18b1-46de-a1cc-f7a2941a42b9] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:29:25.210194 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b5a3a8e7-e585-42a8-8f03-4ae549094ecc tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:25.210735 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b5a3a8e7-e585-42a8-8f03-4ae549094ecc tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:25.211267 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b5a3a8e7-e585-42a8-8f03-4ae549094ecc tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:25.211951 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b5a3a8e7-e585-42a8-8f03-4ae549094ecc tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:25.212395 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b5a3a8e7-e585-42a8-8f03-4ae549094ecc tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:25.213471 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b5a3a8e7-e585-42a8-8f03-4ae549094ecc tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:25.360549 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [req-28663411-db69-469d-8d65-718c86938963 req-f00ef185-c4b0-4c57-9c3c-66d183ae444b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b3855b6-18b1-46de-a1cc-f7a2941a42b9", "tag": "c0932507-0f02-4d95-8195-002c756fdef5"}]} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:29:25.371449 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-28663411-db69-469d-8d65-718c86938963 req-f00ef185-c4b0-4c57-9c3c-66d183ae444b service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:25.371996 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-28663411-db69-469d-8d65-718c86938963 req-f00ef185-c4b0-4c57-9c3c-66d183ae444b service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:25.372430 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-28663411-db69-469d-8d65-718c86938963 req-f00ef185-c4b0-4c57-9c3c-66d183ae444b service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:25.383319 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.compute.server_external_events [req-28663411-db69-469d-8d65-718c86938963 req-f00ef185-c4b0-4c57-9c3c-66d183ae444b service nova] Creating event network-changed:c0932507-0f02-4d95-8195-002c756fdef5 for instance 8b3855b6-18b1-46de-a1cc-f7a2941a42b9 on hv-cinder-84914 Sep 27 17:29:25.388488 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [req-28663411-db69-469d-8d65-718c86938963 req-f00ef185-c4b0-4c57-9c3c-66d183ae444b service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031776 Sep 27 17:29:25.389077 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 296/573] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:29:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 17:29:25.417957 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-b5a3a8e7-e585-42a8-8f03-4ae549094ecc tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5bf070765946168f7e5937f2b076c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890469995c02465eb9b9ad2d1fb9ab6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:25.426759 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-b5a3a8e7-e585-42a8-8f03-4ae549094ecc tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] 10.222.0.55 "GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9" status: 200 len: 1259 microversion: 2.1 time: 0.227591 Sep 27 17:29:25.427916 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 278/574] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:29:25 2022] GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9 => generated 1259 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:29:25.512999 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-0bf6c526-ca45-4316-93df-7d068b23803e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:29:25.513670 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-0bf6c526-ca45-4316-93df-7d068b23803e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:29:25.520040 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-0bf6c526-ca45-4316-93df-7d068b23803e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:25.520516 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-0bf6c526-ca45-4316-93df-7d068b23803e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:25.520939 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-0bf6c526-ca45-4316-93df-7d068b23803e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:25.521625 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-0bf6c526-ca45-4316-93df-7d068b23803e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:25.522083 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-0bf6c526-ca45-4316-93df-7d068b23803e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:25.522507 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-0bf6c526-ca45-4316-93df-7d068b23803e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:25.738245 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-0bf6c526-ca45-4316-93df-7d068b23803e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:25.748991 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-0bf6c526-ca45-4316-93df-7d068b23803e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:25.750388 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-0bf6c526-ca45-4316-93df-7d068b23803e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:25.751553 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-0bf6c526-ca45-4316-93df-7d068b23803e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1743 microversion: 2.20 time: 0.243361 Sep 27 17:29:25.752302 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 297/575] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:29:25 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1743 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:29:26.450667 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-9961701e-105f-405f-bf04-4715115ffbc3 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:29:26.451273 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-9961701e-105f-405f-bf04-4715115ffbc3 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] [instance: 8b3855b6-18b1-46de-a1cc-f7a2941a42b9] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:29:26.453531 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:26.458871 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9961701e-105f-405f-bf04-4715115ffbc3 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:26.459358 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9961701e-105f-405f-bf04-4715115ffbc3 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:26.459792 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9961701e-105f-405f-bf04-4715115ffbc3 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:26.460473 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9961701e-105f-405f-bf04-4715115ffbc3 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:26.460926 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9961701e-105f-405f-bf04-4715115ffbc3 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:26.461351 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9961701e-105f-405f-bf04-4715115ffbc3 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:26.590935 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-9961701e-105f-405f-bf04-4715115ffbc3 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5bf070765946168f7e5937f2b076c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890469995c02465eb9b9ad2d1fb9ab6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:26.598498 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-9961701e-105f-405f-bf04-4715115ffbc3 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] 10.222.0.55 "GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9" status: 200 len: 1259 microversion: 2.1 time: 0.151726 Sep 27 17:29:26.599064 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 279/576] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:29:26 2022] GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:29:26.777163 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-cd3e3f11-dd4a-46e1-a03c-3a08b0d2053b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:29:26.777779 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-cd3e3f11-dd4a-46e1-a03c-3a08b0d2053b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:29:26.784120 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-cd3e3f11-dd4a-46e1-a03c-3a08b0d2053b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:26.784637 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-cd3e3f11-dd4a-46e1-a03c-3a08b0d2053b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:26.785073 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-cd3e3f11-dd4a-46e1-a03c-3a08b0d2053b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:26.785760 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-cd3e3f11-dd4a-46e1-a03c-3a08b0d2053b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:26.786245 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-cd3e3f11-dd4a-46e1-a03c-3a08b0d2053b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:26.786672 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-cd3e3f11-dd4a-46e1-a03c-3a08b0d2053b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:26.913450 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-cd3e3f11-dd4a-46e1-a03c-3a08b0d2053b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:26.922100 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-cd3e3f11-dd4a-46e1-a03c-3a08b0d2053b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:26.923558 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-cd3e3f11-dd4a-46e1-a03c-3a08b0d2053b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:26.924720 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-cd3e3f11-dd4a-46e1-a03c-3a08b0d2053b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1743 microversion: 2.20 time: 0.151978 Sep 27 17:29:26.925273 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 298/577] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:29:26 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1743 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:29:27.621524 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-9b9e52eb-6176-4885-953f-8e9790279656 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:29:27.622164 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-9b9e52eb-6176-4885-953f-8e9790279656 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] [instance: 8b3855b6-18b1-46de-a1cc-f7a2941a42b9] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:29:27.628603 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9b9e52eb-6176-4885-953f-8e9790279656 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:27.629086 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9b9e52eb-6176-4885-953f-8e9790279656 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:27.629522 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9b9e52eb-6176-4885-953f-8e9790279656 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:27.630245 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9b9e52eb-6176-4885-953f-8e9790279656 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:27.630703 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9b9e52eb-6176-4885-953f-8e9790279656 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:27.631129 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9b9e52eb-6176-4885-953f-8e9790279656 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:27.757523 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-9b9e52eb-6176-4885-953f-8e9790279656 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5bf070765946168f7e5937f2b076c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890469995c02465eb9b9ad2d1fb9ab6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:27.765336 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-9b9e52eb-6176-4885-953f-8e9790279656 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] 10.222.0.55 "GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9" status: 200 len: 1259 microversion: 2.1 time: 0.148160 Sep 27 17:29:27.765903 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 280/578] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:29:27 2022] GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9 => generated 1259 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:29:27.951278 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-706989e9-8365-4aca-9104-4fa316c30a68 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:29:27.952029 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-706989e9-8365-4aca-9104-4fa316c30a68 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:29:27.958266 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-706989e9-8365-4aca-9104-4fa316c30a68 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:27.958767 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-706989e9-8365-4aca-9104-4fa316c30a68 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:27.959359 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-706989e9-8365-4aca-9104-4fa316c30a68 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:27.960841 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-706989e9-8365-4aca-9104-4fa316c30a68 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:27.961340 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-706989e9-8365-4aca-9104-4fa316c30a68 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:27.961774 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-706989e9-8365-4aca-9104-4fa316c30a68 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:28.180379 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-706989e9-8365-4aca-9104-4fa316c30a68 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:28.189338 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-706989e9-8365-4aca-9104-4fa316c30a68 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:28.190967 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-706989e9-8365-4aca-9104-4fa316c30a68 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:28.192242 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-706989e9-8365-4aca-9104-4fa316c30a68 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1743 microversion: 2.20 time: 0.245675 Sep 27 17:29:28.192986 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 299/579] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:29:27 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1743 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:29:28.788447 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-fcaff21f-9e06-4023-955a-4fb41b758ca4 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:29:28.789055 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-fcaff21f-9e06-4023-955a-4fb41b758ca4 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] [instance: 8b3855b6-18b1-46de-a1cc-f7a2941a42b9] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:29:28.791029 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell0:SELECT=2 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:28.796796 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fcaff21f-9e06-4023-955a-4fb41b758ca4 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:28.797277 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fcaff21f-9e06-4023-955a-4fb41b758ca4 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:28.797713 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fcaff21f-9e06-4023-955a-4fb41b758ca4 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:28.798437 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fcaff21f-9e06-4023-955a-4fb41b758ca4 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:28.798891 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fcaff21f-9e06-4023-955a-4fb41b758ca4 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:28.799320 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fcaff21f-9e06-4023-955a-4fb41b758ca4 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:28.932982 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-fcaff21f-9e06-4023-955a-4fb41b758ca4 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5bf070765946168f7e5937f2b076c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890469995c02465eb9b9ad2d1fb9ab6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:28.940590 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-fcaff21f-9e06-4023-955a-4fb41b758ca4 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] 10.222.0.55 "GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9" status: 200 len: 1259 microversion: 2.1 time: 0.156061 Sep 27 17:29:28.941158 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 281/580] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:29:28 2022] GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:29:29.219558 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-8929a160-b7ad-4fbb-b645-3bbb9a593226 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:29:29.220105 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-8929a160-b7ad-4fbb-b645-3bbb9a593226 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:29:29.222018 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_cell0:SELECT=2 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:29.222697 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_cell0:SELECT=6 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:29.229302 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8929a160-b7ad-4fbb-b645-3bbb9a593226 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:29.229783 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8929a160-b7ad-4fbb-b645-3bbb9a593226 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:29.230249 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8929a160-b7ad-4fbb-b645-3bbb9a593226 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:29.231202 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8929a160-b7ad-4fbb-b645-3bbb9a593226 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:29.231653 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8929a160-b7ad-4fbb-b645-3bbb9a593226 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:29.232071 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8929a160-b7ad-4fbb-b645-3bbb9a593226 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:29.365859 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-8929a160-b7ad-4fbb-b645-3bbb9a593226 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:29.373856 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-8929a160-b7ad-4fbb-b645-3bbb9a593226 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:29.375327 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-8929a160-b7ad-4fbb-b645-3bbb9a593226 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:29.376468 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-8929a160-b7ad-4fbb-b645-3bbb9a593226 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1743 microversion: 2.20 time: 0.161005 Sep 27 17:29:29.377006 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 300/581] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:29:29 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1743 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:29:29.963545 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-8790bd70-6157-476f-83f5-2eb63c6b82a1 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:29:29.964149 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-8790bd70-6157-476f-83f5-2eb63c6b82a1 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] [instance: 8b3855b6-18b1-46de-a1cc-f7a2941a42b9] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:29:29.970483 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8790bd70-6157-476f-83f5-2eb63c6b82a1 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:29.970964 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8790bd70-6157-476f-83f5-2eb63c6b82a1 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:29.971395 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8790bd70-6157-476f-83f5-2eb63c6b82a1 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:29.972070 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8790bd70-6157-476f-83f5-2eb63c6b82a1 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:29.972530 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8790bd70-6157-476f-83f5-2eb63c6b82a1 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:29.972947 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8790bd70-6157-476f-83f5-2eb63c6b82a1 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:30.103539 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-8790bd70-6157-476f-83f5-2eb63c6b82a1 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5bf070765946168f7e5937f2b076c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890469995c02465eb9b9ad2d1fb9ab6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:30.111373 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-8790bd70-6157-476f-83f5-2eb63c6b82a1 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] 10.222.0.55 "GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9" status: 200 len: 1259 microversion: 2.1 time: 0.151690 Sep 27 17:29:30.111937 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 282/582] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:29:29 2022] GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:29:30.402499 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-8213e751-578e-48f3-9bc4-aae420e673ab tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:29:30.403111 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-8213e751-578e-48f3-9bc4-aae420e673ab tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:29:30.404935 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:30.410463 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8213e751-578e-48f3-9bc4-aae420e673ab tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:30.410946 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8213e751-578e-48f3-9bc4-aae420e673ab tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:30.411409 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8213e751-578e-48f3-9bc4-aae420e673ab tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:30.412142 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8213e751-578e-48f3-9bc4-aae420e673ab tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:30.412627 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8213e751-578e-48f3-9bc4-aae420e673ab tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:30.413063 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8213e751-578e-48f3-9bc4-aae420e673ab tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:30.546897 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-8213e751-578e-48f3-9bc4-aae420e673ab tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:30.554894 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-8213e751-578e-48f3-9bc4-aae420e673ab tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:30.556885 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-8213e751-578e-48f3-9bc4-aae420e673ab tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:30.558032 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-8213e751-578e-48f3-9bc4-aae420e673ab tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1743 microversion: 2.20 time: 0.159523 Sep 27 17:29:30.558617 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 301/583] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:29:30 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1743 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:29:31.134766 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-4bf661fd-5351-4d73-8323-3f1e55354c37 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:29:31.135400 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-4bf661fd-5351-4d73-8323-3f1e55354c37 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] [instance: 8b3855b6-18b1-46de-a1cc-f7a2941a42b9] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:29:31.141981 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4bf661fd-5351-4d73-8323-3f1e55354c37 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:31.142487 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4bf661fd-5351-4d73-8323-3f1e55354c37 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:31.142913 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4bf661fd-5351-4d73-8323-3f1e55354c37 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:31.143587 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4bf661fd-5351-4d73-8323-3f1e55354c37 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:31.144033 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4bf661fd-5351-4d73-8323-3f1e55354c37 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:31.144446 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4bf661fd-5351-4d73-8323-3f1e55354c37 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:31.272341 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-4bf661fd-5351-4d73-8323-3f1e55354c37 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5bf070765946168f7e5937f2b076c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890469995c02465eb9b9ad2d1fb9ab6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:31.280540 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-4bf661fd-5351-4d73-8323-3f1e55354c37 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] 10.222.0.55 "GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9" status: 200 len: 1259 microversion: 2.1 time: 0.149659 Sep 27 17:29:31.281118 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 283/584] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:29:31 2022] GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9 => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:29:31.583411 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-52e2bda1-a589-48fa-a68f-76ab80737a1f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:29:31.584023 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-52e2bda1-a589-48fa-a68f-76ab80737a1f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:29:31.590451 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-52e2bda1-a589-48fa-a68f-76ab80737a1f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:31.590929 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-52e2bda1-a589-48fa-a68f-76ab80737a1f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:31.591362 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-52e2bda1-a589-48fa-a68f-76ab80737a1f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:31.592042 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-52e2bda1-a589-48fa-a68f-76ab80737a1f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:31.592496 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-52e2bda1-a589-48fa-a68f-76ab80737a1f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:31.592925 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-52e2bda1-a589-48fa-a68f-76ab80737a1f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:31.720301 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-52e2bda1-a589-48fa-a68f-76ab80737a1f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:31.728224 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-52e2bda1-a589-48fa-a68f-76ab80737a1f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:31.729678 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-52e2bda1-a589-48fa-a68f-76ab80737a1f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:31.731106 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-52e2bda1-a589-48fa-a68f-76ab80737a1f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1743 microversion: 2.20 time: 0.151365 Sep 27 17:29:31.731658 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 302/585] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:29:31 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1743 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:29:32.304756 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-c5210492-302c-4252-ba8f-860ba7c98f0a tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:29:32.305457 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-c5210492-302c-4252-ba8f-860ba7c98f0a tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] [instance: 8b3855b6-18b1-46de-a1cc-f7a2941a42b9] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:29:32.312668 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c5210492-302c-4252-ba8f-860ba7c98f0a tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:32.313223 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c5210492-302c-4252-ba8f-860ba7c98f0a tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:32.313667 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c5210492-302c-4252-ba8f-860ba7c98f0a tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:32.314393 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c5210492-302c-4252-ba8f-860ba7c98f0a tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:32.314851 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c5210492-302c-4252-ba8f-860ba7c98f0a tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:32.315272 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c5210492-302c-4252-ba8f-860ba7c98f0a tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:32.445651 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-c5210492-302c-4252-ba8f-860ba7c98f0a tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5bf070765946168f7e5937f2b076c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890469995c02465eb9b9ad2d1fb9ab6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:32.454030 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-c5210492-302c-4252-ba8f-860ba7c98f0a tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] 10.222.0.55 "GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9" status: 200 len: 1259 microversion: 2.1 time: 0.153752 Sep 27 17:29:32.454624 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 284/586] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:29:32 2022] GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:29:32.717613 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [req-788b0e6c-7f10-48b1-9a99-a4a96bbb1cfa req-db4b2600-8329-4218-8a85-5e34a44294f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d209f2ce-43c8-422a-a703-cdc9a9fb5cee", "name": "network-vif-plugged", "status": "completed", "tag": "5a5276d6-632d-4adb-a46b-8471fb0bf332"}]} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:29:32.729052 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-788b0e6c-7f10-48b1-9a99-a4a96bbb1cfa req-db4b2600-8329-4218-8a85-5e34a44294f1 service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:32.729527 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-788b0e6c-7f10-48b1-9a99-a4a96bbb1cfa req-db4b2600-8329-4218-8a85-5e34a44294f1 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:32.729950 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-788b0e6c-7f10-48b1-9a99-a4a96bbb1cfa req-db4b2600-8329-4218-8a85-5e34a44294f1 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:32.741567 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.compute.server_external_events [req-788b0e6c-7f10-48b1-9a99-a4a96bbb1cfa req-db4b2600-8329-4218-8a85-5e34a44294f1 service nova] Creating event network-vif-plugged:5a5276d6-632d-4adb-a46b-8471fb0bf332 for instance d209f2ce-43c8-422a-a703-cdc9a9fb5cee on hv-cinder-84914 Sep 27 17:29:32.747017 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [req-788b0e6c-7f10-48b1-9a99-a4a96bbb1cfa req-db4b2600-8329-4218-8a85-5e34a44294f1 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033080 Sep 27 17:29:32.747601 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 303/587] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:29:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:29:32.757900 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-4aa87c1f-2d60-48ad-8ac4-5438ffcb7a47 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:29:32.758623 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-4aa87c1f-2d60-48ad-8ac4-5438ffcb7a47 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:29:32.765081 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4aa87c1f-2d60-48ad-8ac4-5438ffcb7a47 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:32.765637 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4aa87c1f-2d60-48ad-8ac4-5438ffcb7a47 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:32.766200 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4aa87c1f-2d60-48ad-8ac4-5438ffcb7a47 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:32.766958 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4aa87c1f-2d60-48ad-8ac4-5438ffcb7a47 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:32.767417 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4aa87c1f-2d60-48ad-8ac4-5438ffcb7a47 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:32.767834 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4aa87c1f-2d60-48ad-8ac4-5438ffcb7a47 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:32.902405 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-4aa87c1f-2d60-48ad-8ac4-5438ffcb7a47 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:32.910458 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-4aa87c1f-2d60-48ad-8ac4-5438ffcb7a47 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:32.911975 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-4aa87c1f-2d60-48ad-8ac4-5438ffcb7a47 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:32.913131 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-4aa87c1f-2d60-48ad-8ac4-5438ffcb7a47 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1743 microversion: 2.20 time: 0.159207 Sep 27 17:29:32.913691 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 285/588] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:29:32 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1743 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:29:33.478629 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-ea8f11aa-5b99-4bb3-abdc-2b3473f3838c tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:29:33.479419 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-ea8f11aa-5b99-4bb3-abdc-2b3473f3838c tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] [instance: 8b3855b6-18b1-46de-a1cc-f7a2941a42b9] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:29:33.485773 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ea8f11aa-5b99-4bb3-abdc-2b3473f3838c tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:33.486286 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ea8f11aa-5b99-4bb3-abdc-2b3473f3838c tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:33.486717 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ea8f11aa-5b99-4bb3-abdc-2b3473f3838c tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:33.487399 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ea8f11aa-5b99-4bb3-abdc-2b3473f3838c tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:33.487849 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ea8f11aa-5b99-4bb3-abdc-2b3473f3838c tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:33.488270 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ea8f11aa-5b99-4bb3-abdc-2b3473f3838c tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:33.617619 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-ea8f11aa-5b99-4bb3-abdc-2b3473f3838c tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5bf070765946168f7e5937f2b076c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890469995c02465eb9b9ad2d1fb9ab6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:33.625320 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-ea8f11aa-5b99-4bb3-abdc-2b3473f3838c tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] 10.222.0.55 "GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9" status: 200 len: 1259 microversion: 2.1 time: 0.151621 Sep 27 17:29:33.625986 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 304/589] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:29:33 2022] GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:29:33.938423 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-6111558e-c184-43f0-a41c-490db2050cc3 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:29:33.939019 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-6111558e-c184-43f0-a41c-490db2050cc3 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:29:33.945365 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6111558e-c184-43f0-a41c-490db2050cc3 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:33.945835 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6111558e-c184-43f0-a41c-490db2050cc3 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:33.946335 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6111558e-c184-43f0-a41c-490db2050cc3 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:33.947559 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6111558e-c184-43f0-a41c-490db2050cc3 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:33.948008 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6111558e-c184-43f0-a41c-490db2050cc3 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:33.948454 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6111558e-c184-43f0-a41c-490db2050cc3 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:34.073162 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-6111558e-c184-43f0-a41c-490db2050cc3 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:34.081043 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-6111558e-c184-43f0-a41c-490db2050cc3 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:34.082512 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-6111558e-c184-43f0-a41c-490db2050cc3 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:34.083649 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-6111558e-c184-43f0-a41c-490db2050cc3 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1743 microversion: 2.20 time: 0.149185 Sep 27 17:29:34.084234 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 286/590] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:29:33 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1743 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:29:34.647914 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-2a85e78f-7412-41b9-9b07-e5c9d9724d66 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:29:34.648529 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-2a85e78f-7412-41b9-9b07-e5c9d9724d66 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] [instance: 8b3855b6-18b1-46de-a1cc-f7a2941a42b9] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:29:34.655066 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-2a85e78f-7412-41b9-9b07-e5c9d9724d66 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:34.655548 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-2a85e78f-7412-41b9-9b07-e5c9d9724d66 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:34.655984 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-2a85e78f-7412-41b9-9b07-e5c9d9724d66 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:34.656674 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-2a85e78f-7412-41b9-9b07-e5c9d9724d66 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:34.657157 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-2a85e78f-7412-41b9-9b07-e5c9d9724d66 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:34.657585 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-2a85e78f-7412-41b9-9b07-e5c9d9724d66 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:34.787951 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-2a85e78f-7412-41b9-9b07-e5c9d9724d66 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5bf070765946168f7e5937f2b076c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890469995c02465eb9b9ad2d1fb9ab6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:34.795535 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-2a85e78f-7412-41b9-9b07-e5c9d9724d66 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] 10.222.0.55 "GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9" status: 200 len: 1259 microversion: 2.1 time: 0.151577 Sep 27 17:29:34.796098 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 305/591] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:29:34 2022] GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:29:35.109947 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-e13d100c-e2fa-4e10-b79d-1f2be4c07f03 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:29:35.110579 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-e13d100c-e2fa-4e10-b79d-1f2be4c07f03 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:29:35.116883 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e13d100c-e2fa-4e10-b79d-1f2be4c07f03 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:35.117361 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e13d100c-e2fa-4e10-b79d-1f2be4c07f03 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:35.117795 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e13d100c-e2fa-4e10-b79d-1f2be4c07f03 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:35.119032 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e13d100c-e2fa-4e10-b79d-1f2be4c07f03 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:35.119486 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e13d100c-e2fa-4e10-b79d-1f2be4c07f03 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:35.119904 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e13d100c-e2fa-4e10-b79d-1f2be4c07f03 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:35.245819 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-e13d100c-e2fa-4e10-b79d-1f2be4c07f03 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:35.253820 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-e13d100c-e2fa-4e10-b79d-1f2be4c07f03 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:35.255285 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-e13d100c-e2fa-4e10-b79d-1f2be4c07f03 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:35.256422 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-e13d100c-e2fa-4e10-b79d-1f2be4c07f03 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1743 microversion: 2.20 time: 0.150665 Sep 27 17:29:35.256972 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 287/592] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:29:35 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1743 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:29:35.818029 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-6b13fb98-75bb-4c7c-96d6-fd945f02b0f5 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:29:35.818669 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-6b13fb98-75bb-4c7c-96d6-fd945f02b0f5 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] [instance: 8b3855b6-18b1-46de-a1cc-f7a2941a42b9] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:29:35.824595 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6b13fb98-75bb-4c7c-96d6-fd945f02b0f5 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:35.825077 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6b13fb98-75bb-4c7c-96d6-fd945f02b0f5 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:35.825512 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6b13fb98-75bb-4c7c-96d6-fd945f02b0f5 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:35.826277 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6b13fb98-75bb-4c7c-96d6-fd945f02b0f5 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:35.826744 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6b13fb98-75bb-4c7c-96d6-fd945f02b0f5 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:35.827173 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6b13fb98-75bb-4c7c-96d6-fd945f02b0f5 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:35.963266 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-6b13fb98-75bb-4c7c-96d6-fd945f02b0f5 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5bf070765946168f7e5937f2b076c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890469995c02465eb9b9ad2d1fb9ab6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:35.971710 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-6b13fb98-75bb-4c7c-96d6-fd945f02b0f5 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] 10.222.0.55 "GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9" status: 200 len: 1259 microversion: 2.1 time: 0.157566 Sep 27 17:29:35.972280 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 306/593] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:29:35 2022] GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:29:36.282131 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-266813c5-1208-496a-98e0-f3087db80c32 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:29:36.282647 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-266813c5-1208-496a-98e0-f3087db80c32 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:29:36.288959 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-266813c5-1208-496a-98e0-f3087db80c32 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:36.289431 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-266813c5-1208-496a-98e0-f3087db80c32 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:36.289858 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-266813c5-1208-496a-98e0-f3087db80c32 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:36.290557 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-266813c5-1208-496a-98e0-f3087db80c32 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:36.291008 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-266813c5-1208-496a-98e0-f3087db80c32 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:36.291426 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-266813c5-1208-496a-98e0-f3087db80c32 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:36.417303 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-266813c5-1208-496a-98e0-f3087db80c32 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:36.425197 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-266813c5-1208-496a-98e0-f3087db80c32 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:36.426700 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-266813c5-1208-496a-98e0-f3087db80c32 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:36.427841 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-266813c5-1208-496a-98e0-f3087db80c32 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1743 microversion: 2.20 time: 0.149766 Sep 27 17:29:36.428390 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 288/594] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:29:36 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1743 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:29:36.995779 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-01222ef4-bc51-4c51-a890-85b3f8f329eb tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:29:36.996391 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-01222ef4-bc51-4c51-a890-85b3f8f329eb tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] [instance: 8b3855b6-18b1-46de-a1cc-f7a2941a42b9] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:29:37.002273 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-01222ef4-bc51-4c51-a890-85b3f8f329eb tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:37.002788 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-01222ef4-bc51-4c51-a890-85b3f8f329eb tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:37.003226 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-01222ef4-bc51-4c51-a890-85b3f8f329eb tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:37.003912 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-01222ef4-bc51-4c51-a890-85b3f8f329eb tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:37.004367 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-01222ef4-bc51-4c51-a890-85b3f8f329eb tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:37.004793 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-01222ef4-bc51-4c51-a890-85b3f8f329eb tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:37.136685 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-01222ef4-bc51-4c51-a890-85b3f8f329eb tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5bf070765946168f7e5937f2b076c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890469995c02465eb9b9ad2d1fb9ab6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:37.144384 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-01222ef4-bc51-4c51-a890-85b3f8f329eb tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] 10.222.0.55 "GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9" status: 200 len: 1259 microversion: 2.1 time: 0.153244 Sep 27 17:29:37.144942 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 307/595] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:29:36 2022] GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:29:37.453026 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-f67f6ef5-b2c7-4d80-9498-b8805e2530c6 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:29:37.453635 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-f67f6ef5-b2c7-4d80-9498-b8805e2530c6 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:29:37.459933 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f67f6ef5-b2c7-4d80-9498-b8805e2530c6 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:37.460414 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f67f6ef5-b2c7-4d80-9498-b8805e2530c6 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:37.460849 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f67f6ef5-b2c7-4d80-9498-b8805e2530c6 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:37.461544 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f67f6ef5-b2c7-4d80-9498-b8805e2530c6 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:37.461997 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f67f6ef5-b2c7-4d80-9498-b8805e2530c6 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:37.463147 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f67f6ef5-b2c7-4d80-9498-b8805e2530c6 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:37.590017 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-f67f6ef5-b2c7-4d80-9498-b8805e2530c6 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:37.598257 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-f67f6ef5-b2c7-4d80-9498-b8805e2530c6 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:37.599728 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-f67f6ef5-b2c7-4d80-9498-b8805e2530c6 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:37.600906 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-f67f6ef5-b2c7-4d80-9498-b8805e2530c6 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1743 microversion: 2.20 time: 0.151843 Sep 27 17:29:37.601437 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 289/596] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:29:37 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1743 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:29:38.167010 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-6a5ea747-57bd-42de-ad16-8f4f7ba08a24 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:29:38.167551 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-6a5ea747-57bd-42de-ad16-8f4f7ba08a24 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] [instance: 8b3855b6-18b1-46de-a1cc-f7a2941a42b9] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:29:38.173453 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6a5ea747-57bd-42de-ad16-8f4f7ba08a24 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:38.173932 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6a5ea747-57bd-42de-ad16-8f4f7ba08a24 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:38.174395 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6a5ea747-57bd-42de-ad16-8f4f7ba08a24 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:38.175119 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6a5ea747-57bd-42de-ad16-8f4f7ba08a24 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:38.175570 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6a5ea747-57bd-42de-ad16-8f4f7ba08a24 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:38.175993 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6a5ea747-57bd-42de-ad16-8f4f7ba08a24 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:38.307849 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-6a5ea747-57bd-42de-ad16-8f4f7ba08a24 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5bf070765946168f7e5937f2b076c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890469995c02465eb9b9ad2d1fb9ab6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:38.316069 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-6a5ea747-57bd-42de-ad16-8f4f7ba08a24 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] 10.222.0.55 "GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9" status: 200 len: 1259 microversion: 2.1 time: 0.152995 Sep 27 17:29:38.316641 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 308/597] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:29:38 2022] GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:29:38.626568 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-da482da0-1685-4d23-8de3-377432ad0048 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:29:38.627213 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-da482da0-1685-4d23-8de3-377432ad0048 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:29:38.633493 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-da482da0-1685-4d23-8de3-377432ad0048 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:38.633966 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-da482da0-1685-4d23-8de3-377432ad0048 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:38.634456 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-da482da0-1685-4d23-8de3-377432ad0048 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:38.635135 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-da482da0-1685-4d23-8de3-377432ad0048 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:38.635578 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-da482da0-1685-4d23-8de3-377432ad0048 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:38.635996 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-da482da0-1685-4d23-8de3-377432ad0048 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:38.653397 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell1:SELECT=100 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:38.766273 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-da482da0-1685-4d23-8de3-377432ad0048 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:38.774270 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-da482da0-1685-4d23-8de3-377432ad0048 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:38.776222 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-da482da0-1685-4d23-8de3-377432ad0048 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:38.777361 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-da482da0-1685-4d23-8de3-377432ad0048 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1743 microversion: 2.20 time: 0.154775 Sep 27 17:29:38.777909 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 290/598] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:29:38 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1743 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:29:39.340671 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-66385693-7aaf-4c14-8fdb-72f644cb052c tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:29:39.341293 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-66385693-7aaf-4c14-8fdb-72f644cb052c tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] [instance: 8b3855b6-18b1-46de-a1cc-f7a2941a42b9] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:29:39.347542 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-66385693-7aaf-4c14-8fdb-72f644cb052c tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:39.348024 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-66385693-7aaf-4c14-8fdb-72f644cb052c tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:39.348460 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-66385693-7aaf-4c14-8fdb-72f644cb052c tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:39.349184 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-66385693-7aaf-4c14-8fdb-72f644cb052c tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:39.349641 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-66385693-7aaf-4c14-8fdb-72f644cb052c tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:39.350084 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-66385693-7aaf-4c14-8fdb-72f644cb052c tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:39.487863 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-66385693-7aaf-4c14-8fdb-72f644cb052c tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5bf070765946168f7e5937f2b076c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890469995c02465eb9b9ad2d1fb9ab6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:39.496923 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-66385693-7aaf-4c14-8fdb-72f644cb052c tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] 10.222.0.55 "GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9" status: 200 len: 1259 microversion: 2.1 time: 0.161180 Sep 27 17:29:39.497497 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 309/599] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:29:39 2022] GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9 => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:29:39.803971 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-e88dc126-ac7a-4e72-bef9-87889e4c712d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:29:39.805230 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-e88dc126-ac7a-4e72-bef9-87889e4c712d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:29:39.814355 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e88dc126-ac7a-4e72-bef9-87889e4c712d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:39.815095 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e88dc126-ac7a-4e72-bef9-87889e4c712d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:39.815709 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e88dc126-ac7a-4e72-bef9-87889e4c712d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:39.816684 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e88dc126-ac7a-4e72-bef9-87889e4c712d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:39.817065 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e88dc126-ac7a-4e72-bef9-87889e4c712d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:39.817483 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e88dc126-ac7a-4e72-bef9-87889e4c712d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:40.001597 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-e88dc126-ac7a-4e72-bef9-87889e4c712d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:40.010003 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-e88dc126-ac7a-4e72-bef9-87889e4c712d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:40.016912 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-e88dc126-ac7a-4e72-bef9-87889e4c712d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:40.018438 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-e88dc126-ac7a-4e72-bef9-87889e4c712d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1738 microversion: 2.20 time: 0.219146 Sep 27 17:29:40.019547 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 291/600] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:29:39 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1738 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:29:40.522704 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-e1402ea0-cf5f-42ce-8a0d-eb1c4acff080 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:29:40.524098 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-e1402ea0-cf5f-42ce-8a0d-eb1c4acff080 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] [instance: 8b3855b6-18b1-46de-a1cc-f7a2941a42b9] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:29:40.531452 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e1402ea0-cf5f-42ce-8a0d-eb1c4acff080 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:40.532183 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e1402ea0-cf5f-42ce-8a0d-eb1c4acff080 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:40.532623 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e1402ea0-cf5f-42ce-8a0d-eb1c4acff080 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:40.533327 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e1402ea0-cf5f-42ce-8a0d-eb1c4acff080 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:40.533781 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e1402ea0-cf5f-42ce-8a0d-eb1c4acff080 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:40.534746 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e1402ea0-cf5f-42ce-8a0d-eb1c4acff080 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:40.693705 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-e1402ea0-cf5f-42ce-8a0d-eb1c4acff080 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5bf070765946168f7e5937f2b076c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890469995c02465eb9b9ad2d1fb9ab6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:40.705199 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-e1402ea0-cf5f-42ce-8a0d-eb1c4acff080 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] 10.222.0.55 "GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9" status: 200 len: 1259 microversion: 2.1 time: 0.186342 Sep 27 17:29:40.706538 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 310/601] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:29:40 2022] GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9 => generated 1259 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:29:41.046109 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-58938d26-e7a6-4a40-b14e-55f50364ba27 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:29:41.046721 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-58938d26-e7a6-4a40-b14e-55f50364ba27 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:29:41.053368 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-58938d26-e7a6-4a40-b14e-55f50364ba27 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:41.053902 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-58938d26-e7a6-4a40-b14e-55f50364ba27 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:41.054630 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-58938d26-e7a6-4a40-b14e-55f50364ba27 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:41.055504 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-58938d26-e7a6-4a40-b14e-55f50364ba27 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:41.056631 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-58938d26-e7a6-4a40-b14e-55f50364ba27 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:41.057212 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-58938d26-e7a6-4a40-b14e-55f50364ba27 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:41.190123 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-58938d26-e7a6-4a40-b14e-55f50364ba27 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:41.198969 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-58938d26-e7a6-4a40-b14e-55f50364ba27 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:41.210098 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-58938d26-e7a6-4a40-b14e-55f50364ba27 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:41.210098 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-58938d26-e7a6-4a40-b14e-55f50364ba27 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1738 microversion: 2.20 time: 0.160510 Sep 27 17:29:41.218501 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 292/602] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:29:41 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1738 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:29:41.573523 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [req-b8c609e7-ed8d-4c52-aa54-bc624d4a3d82 req-8bb9701c-3798-4cc6-ba50-df59b3fe86d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b3855b6-18b1-46de-a1cc-f7a2941a42b9", "name": "network-vif-plugged", "status": "completed", "tag": "c0932507-0f02-4d95-8195-002c756fdef5"}]} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:29:41.584320 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-b8c609e7-ed8d-4c52-aa54-bc624d4a3d82 req-8bb9701c-3798-4cc6-ba50-df59b3fe86d2 service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:41.584885 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-b8c609e7-ed8d-4c52-aa54-bc624d4a3d82 req-8bb9701c-3798-4cc6-ba50-df59b3fe86d2 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:41.585384 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-b8c609e7-ed8d-4c52-aa54-bc624d4a3d82 req-8bb9701c-3798-4cc6-ba50-df59b3fe86d2 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:41.598169 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.compute.server_external_events [req-b8c609e7-ed8d-4c52-aa54-bc624d4a3d82 req-8bb9701c-3798-4cc6-ba50-df59b3fe86d2 service nova] Creating event network-vif-plugged:c0932507-0f02-4d95-8195-002c756fdef5 for instance 8b3855b6-18b1-46de-a1cc-f7a2941a42b9 on hv-cinder-84914 Sep 27 17:29:41.604324 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [req-b8c609e7-ed8d-4c52-aa54-bc624d4a3d82 req-8bb9701c-3798-4cc6-ba50-df59b3fe86d2 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034338 Sep 27 17:29:41.604933 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 311/603] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:29:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:29:41.731391 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-e2574ac7-9c89-44c0-b6e4-a1f4321353ce tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:29:41.732043 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-e2574ac7-9c89-44c0-b6e4-a1f4321353ce tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] [instance: 8b3855b6-18b1-46de-a1cc-f7a2941a42b9] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:29:41.739947 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e2574ac7-9c89-44c0-b6e4-a1f4321353ce tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:41.740718 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e2574ac7-9c89-44c0-b6e4-a1f4321353ce tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:41.741563 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e2574ac7-9c89-44c0-b6e4-a1f4321353ce tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:41.742301 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e2574ac7-9c89-44c0-b6e4-a1f4321353ce tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:41.742805 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e2574ac7-9c89-44c0-b6e4-a1f4321353ce tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:41.743321 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e2574ac7-9c89-44c0-b6e4-a1f4321353ce tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:41.991209 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-e2574ac7-9c89-44c0-b6e4-a1f4321353ce tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5bf070765946168f7e5937f2b076c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890469995c02465eb9b9ad2d1fb9ab6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:42.002381 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-e2574ac7-9c89-44c0-b6e4-a1f4321353ce tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] 10.222.0.55 "GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9" status: 200 len: 1259 microversion: 2.1 time: 0.274615 Sep 27 17:29:42.003321 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 293/604] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:29:41 2022] GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9 => generated 1259 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:29:42.229330 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-8c564f76-4a25-4302-88a9-e7ade6770341 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:29:42.230052 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-8c564f76-4a25-4302-88a9-e7ade6770341 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:29:42.236816 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8c564f76-4a25-4302-88a9-e7ade6770341 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:42.237608 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8c564f76-4a25-4302-88a9-e7ade6770341 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:42.238137 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8c564f76-4a25-4302-88a9-e7ade6770341 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:42.239070 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8c564f76-4a25-4302-88a9-e7ade6770341 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:42.239593 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8c564f76-4a25-4302-88a9-e7ade6770341 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:42.240091 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8c564f76-4a25-4302-88a9-e7ade6770341 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:42.259051 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_cell1:SELECT=100 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:42.386856 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-8c564f76-4a25-4302-88a9-e7ade6770341 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:42.407294 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-8c564f76-4a25-4302-88a9-e7ade6770341 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:42.409145 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-8c564f76-4a25-4302-88a9-e7ade6770341 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:42.410576 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-8c564f76-4a25-4302-88a9-e7ade6770341 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1738 microversion: 2.20 time: 0.186258 Sep 27 17:29:42.411436 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 312/605] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:29:42 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1738 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:29:43.029844 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-067d6c4b-a671-47c4-b331-d8a9abbf1bb9 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:29:43.031420 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-067d6c4b-a671-47c4-b331-d8a9abbf1bb9 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] [instance: 8b3855b6-18b1-46de-a1cc-f7a2941a42b9] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:29:43.038253 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-067d6c4b-a671-47c4-b331-d8a9abbf1bb9 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:43.038993 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-067d6c4b-a671-47c4-b331-d8a9abbf1bb9 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:43.039789 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-067d6c4b-a671-47c4-b331-d8a9abbf1bb9 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:43.041046 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-067d6c4b-a671-47c4-b331-d8a9abbf1bb9 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:43.041599 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-067d6c4b-a671-47c4-b331-d8a9abbf1bb9 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:43.042169 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-067d6c4b-a671-47c4-b331-d8a9abbf1bb9 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:43.184263 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-067d6c4b-a671-47c4-b331-d8a9abbf1bb9 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5bf070765946168f7e5937f2b076c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890469995c02465eb9b9ad2d1fb9ab6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:43.192613 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-067d6c4b-a671-47c4-b331-d8a9abbf1bb9 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] 10.222.0.55 "GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9" status: 200 len: 1259 microversion: 2.1 time: 0.167632 Sep 27 17:29:43.193723 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 294/606] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:29:43 2022] GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9 => generated 1259 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:29:43.437448 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-ae985ee3-54bd-441d-87fe-5693b8bdb45e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:29:43.438392 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-ae985ee3-54bd-441d-87fe-5693b8bdb45e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:29:43.444631 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ae985ee3-54bd-441d-87fe-5693b8bdb45e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:43.445190 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ae985ee3-54bd-441d-87fe-5693b8bdb45e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:43.445689 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ae985ee3-54bd-441d-87fe-5693b8bdb45e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:43.446468 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ae985ee3-54bd-441d-87fe-5693b8bdb45e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:43.447082 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ae985ee3-54bd-441d-87fe-5693b8bdb45e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:43.447501 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ae985ee3-54bd-441d-87fe-5693b8bdb45e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:43.585245 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-ae985ee3-54bd-441d-87fe-5693b8bdb45e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:43.595581 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-ae985ee3-54bd-441d-87fe-5693b8bdb45e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:43.597080 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-ae985ee3-54bd-441d-87fe-5693b8bdb45e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:43.598303 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-ae985ee3-54bd-441d-87fe-5693b8bdb45e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1738 microversion: 2.20 time: 0.164723 Sep 27 17:29:43.598852 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 313/607] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:29:43 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1738 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:29:44.216386 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-81ed6130-c716-4203-acf8-3f57f2428e40 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:29:44.226931 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-81ed6130-c716-4203-acf8-3f57f2428e40 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] [instance: 8b3855b6-18b1-46de-a1cc-f7a2941a42b9] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:29:44.233942 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-81ed6130-c716-4203-acf8-3f57f2428e40 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:44.234678 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-81ed6130-c716-4203-acf8-3f57f2428e40 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:44.235281 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-81ed6130-c716-4203-acf8-3f57f2428e40 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:44.236179 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-81ed6130-c716-4203-acf8-3f57f2428e40 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:44.236870 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-81ed6130-c716-4203-acf8-3f57f2428e40 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:44.237521 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-81ed6130-c716-4203-acf8-3f57f2428e40 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:44.402423 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-81ed6130-c716-4203-acf8-3f57f2428e40 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5bf070765946168f7e5937f2b076c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890469995c02465eb9b9ad2d1fb9ab6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:44.410767 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-81ed6130-c716-4203-acf8-3f57f2428e40 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] 10.222.0.55 "GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9" status: 200 len: 1259 microversion: 2.1 time: 0.198278 Sep 27 17:29:44.411333 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 295/608] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:29:44 2022] GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9 => generated 1259 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:29:44.625834 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-095fd334-2979-432d-87e1-f886a588ce76 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:29:44.626475 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-095fd334-2979-432d-87e1-f886a588ce76 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:29:44.636671 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-095fd334-2979-432d-87e1-f886a588ce76 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:44.637276 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-095fd334-2979-432d-87e1-f886a588ce76 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:44.637810 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-095fd334-2979-432d-87e1-f886a588ce76 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:44.638624 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-095fd334-2979-432d-87e1-f886a588ce76 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:44.639072 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-095fd334-2979-432d-87e1-f886a588ce76 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:44.639490 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-095fd334-2979-432d-87e1-f886a588ce76 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:44.775052 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-095fd334-2979-432d-87e1-f886a588ce76 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:44.784317 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-095fd334-2979-432d-87e1-f886a588ce76 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:44.785780 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-095fd334-2979-432d-87e1-f886a588ce76 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:44.787006 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-095fd334-2979-432d-87e1-f886a588ce76 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1738 microversion: 2.20 time: 0.165826 Sep 27 17:29:44.802958 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 314/609] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:29:44 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1738 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:29:45.433760 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-0cee9034-a09c-499d-90b5-37c2d9717e3b tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:29:45.434476 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-0cee9034-a09c-499d-90b5-37c2d9717e3b tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] [instance: 8b3855b6-18b1-46de-a1cc-f7a2941a42b9] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:29:45.441073 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0cee9034-a09c-499d-90b5-37c2d9717e3b tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:45.441813 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0cee9034-a09c-499d-90b5-37c2d9717e3b tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:45.442485 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0cee9034-a09c-499d-90b5-37c2d9717e3b tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:45.443527 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0cee9034-a09c-499d-90b5-37c2d9717e3b tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:45.444010 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0cee9034-a09c-499d-90b5-37c2d9717e3b tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:45.444655 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0cee9034-a09c-499d-90b5-37c2d9717e3b tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:45.596046 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-0cee9034-a09c-499d-90b5-37c2d9717e3b tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5bf070765946168f7e5937f2b076c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890469995c02465eb9b9ad2d1fb9ab6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:45.608856 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-0cee9034-a09c-499d-90b5-37c2d9717e3b tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] 10.222.0.55 "GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9" status: 200 len: 1442 microversion: 2.1 time: 0.178821 Sep 27 17:29:45.626225 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 296/610] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:29:45 2022] GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9 => generated 1442 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:29:45.639538 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-a31f3e6d-66e3-436b-8690-b900dc6582bb tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:29:45.641047 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-a31f3e6d-66e3-436b-8690-b900dc6582bb tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] [instance: 8b3855b6-18b1-46de-a1cc-f7a2941a42b9] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:29:45.671039 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a31f3e6d-66e3-436b-8690-b900dc6582bb tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:45.672465 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a31f3e6d-66e3-436b-8690-b900dc6582bb tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:45.686690 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a31f3e6d-66e3-436b-8690-b900dc6582bb tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:45.690932 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a31f3e6d-66e3-436b-8690-b900dc6582bb tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:45.692538 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a31f3e6d-66e3-436b-8690-b900dc6582bb tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:45.693314 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a31f3e6d-66e3-436b-8690-b900dc6582bb tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:45.860443 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-590278ec-a099-4d72-830d-a4675212ff64 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:29:45.867530 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-590278ec-a099-4d72-830d-a4675212ff64 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:29:45.926274 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-590278ec-a099-4d72-830d-a4675212ff64 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:45.927418 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-590278ec-a099-4d72-830d-a4675212ff64 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:45.928086 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-590278ec-a099-4d72-830d-a4675212ff64 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:45.930166 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-590278ec-a099-4d72-830d-a4675212ff64 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:45.931540 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-590278ec-a099-4d72-830d-a4675212ff64 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:45.933581 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-590278ec-a099-4d72-830d-a4675212ff64 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:46.073421 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-a31f3e6d-66e3-436b-8690-b900dc6582bb tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5bf070765946168f7e5937f2b076c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890469995c02465eb9b9ad2d1fb9ab6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:46.085527 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-a31f3e6d-66e3-436b-8690-b900dc6582bb tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] 10.222.0.55 "GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9" status: 200 len: 1442 microversion: 2.1 time: 0.451623 Sep 27 17:29:46.086711 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 315/611] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:29:45 2022] GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9 => generated 1442 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:29:46.182202 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-590278ec-a099-4d72-830d-a4675212ff64 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:46.192057 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-590278ec-a099-4d72-830d-a4675212ff64 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:46.193669 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-590278ec-a099-4d72-830d-a4675212ff64 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:46.195124 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-590278ec-a099-4d72-830d-a4675212ff64 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1738 microversion: 2.20 time: 0.382826 Sep 27 17:29:46.195853 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 297/612] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:29:45 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1738 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:29:47.221020 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-9a13126e-9661-4d70-9188-7bdbe38f9731 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:29:47.221648 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-9a13126e-9661-4d70-9188-7bdbe38f9731 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:29:47.230358 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9a13126e-9661-4d70-9188-7bdbe38f9731 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:47.231721 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9a13126e-9661-4d70-9188-7bdbe38f9731 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:47.234659 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9a13126e-9661-4d70-9188-7bdbe38f9731 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:47.235616 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9a13126e-9661-4d70-9188-7bdbe38f9731 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:47.236285 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9a13126e-9661-4d70-9188-7bdbe38f9731 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:47.236776 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9a13126e-9661-4d70-9188-7bdbe38f9731 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:47.437922 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-9a13126e-9661-4d70-9188-7bdbe38f9731 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:47.453378 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-9a13126e-9661-4d70-9188-7bdbe38f9731 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:47.455611 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-9a13126e-9661-4d70-9188-7bdbe38f9731 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:47.457880 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-9a13126e-9661-4d70-9188-7bdbe38f9731 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1738 microversion: 2.20 time: 0.240806 Sep 27 17:29:47.475667 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 316/613] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:29:47 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1738 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:29:48.335094 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [req-33b3e6db-9f2c-48dd-a19e-5fbcc0fe43e6 req-bdbf1592-ba88-47c8-b20a-e1a7df30f37f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b3855b6-18b1-46de-a1cc-f7a2941a42b9", "tag": "c0932507-0f02-4d95-8195-002c756fdef5"}]} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:29:48.347138 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-33b3e6db-9f2c-48dd-a19e-5fbcc0fe43e6 req-bdbf1592-ba88-47c8-b20a-e1a7df30f37f service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:48.347782 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-33b3e6db-9f2c-48dd-a19e-5fbcc0fe43e6 req-bdbf1592-ba88-47c8-b20a-e1a7df30f37f service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:48.348198 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-33b3e6db-9f2c-48dd-a19e-5fbcc0fe43e6 req-bdbf1592-ba88-47c8-b20a-e1a7df30f37f service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:48.362171 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.compute.server_external_events [req-33b3e6db-9f2c-48dd-a19e-5fbcc0fe43e6 req-bdbf1592-ba88-47c8-b20a-e1a7df30f37f service nova] Creating event network-changed:c0932507-0f02-4d95-8195-002c756fdef5 for instance 8b3855b6-18b1-46de-a1cc-f7a2941a42b9 on hv-cinder-84914 Sep 27 17:29:48.368045 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [req-33b3e6db-9f2c-48dd-a19e-5fbcc0fe43e6 req-bdbf1592-ba88-47c8-b20a-e1a7df30f37f service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.248744 Sep 27 17:29:48.369494 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 298/614] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:29:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:29:48.486902 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-37b3888e-42ff-432e-9fa2-6c76bbd45d9d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:29:48.489281 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-37b3888e-42ff-432e-9fa2-6c76bbd45d9d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:29:48.499460 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-37b3888e-42ff-432e-9fa2-6c76bbd45d9d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:48.502031 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-37b3888e-42ff-432e-9fa2-6c76bbd45d9d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:48.502686 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-37b3888e-42ff-432e-9fa2-6c76bbd45d9d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:48.503572 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-37b3888e-42ff-432e-9fa2-6c76bbd45d9d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:48.506425 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-37b3888e-42ff-432e-9fa2-6c76bbd45d9d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:48.507035 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-37b3888e-42ff-432e-9fa2-6c76bbd45d9d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:49.098053 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-37b3888e-42ff-432e-9fa2-6c76bbd45d9d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:49.113474 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-37b3888e-42ff-432e-9fa2-6c76bbd45d9d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:49.119928 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-37b3888e-42ff-432e-9fa2-6c76bbd45d9d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:49.122921 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-37b3888e-42ff-432e-9fa2-6c76bbd45d9d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1738 microversion: 2.20 time: 0.639702 Sep 27 17:29:49.124020 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 317/615] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:29:48 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1738 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:29:50.155838 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-2ec82efd-3369-45f6-9222-7dcb6d7fe995 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:29:50.156554 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-2ec82efd-3369-45f6-9222-7dcb6d7fe995 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:29:50.163542 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2ec82efd-3369-45f6-9222-7dcb6d7fe995 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:50.164222 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2ec82efd-3369-45f6-9222-7dcb6d7fe995 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:50.164657 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2ec82efd-3369-45f6-9222-7dcb6d7fe995 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:50.165422 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2ec82efd-3369-45f6-9222-7dcb6d7fe995 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:50.165871 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2ec82efd-3369-45f6-9222-7dcb6d7fe995 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:50.166322 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2ec82efd-3369-45f6-9222-7dcb6d7fe995 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:50.314203 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-2ec82efd-3369-45f6-9222-7dcb6d7fe995 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:50.324069 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-2ec82efd-3369-45f6-9222-7dcb6d7fe995 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:50.328357 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-2ec82efd-3369-45f6-9222-7dcb6d7fe995 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:50.330219 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-2ec82efd-3369-45f6-9222-7dcb6d7fe995 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1738 microversion: 2.20 time: 0.181828 Sep 27 17:29:50.330827 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 299/616] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:29:50 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1738 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 17:29:51.356636 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-20ef01cb-8d1c-4243-a7fa-9fe2ed9bda40 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:29:51.357248 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-20ef01cb-8d1c-4243-a7fa-9fe2ed9bda40 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:29:51.363334 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-20ef01cb-8d1c-4243-a7fa-9fe2ed9bda40 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:51.363816 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-20ef01cb-8d1c-4243-a7fa-9fe2ed9bda40 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:51.364255 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-20ef01cb-8d1c-4243-a7fa-9fe2ed9bda40 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:51.364942 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-20ef01cb-8d1c-4243-a7fa-9fe2ed9bda40 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:51.365438 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-20ef01cb-8d1c-4243-a7fa-9fe2ed9bda40 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:51.365889 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-20ef01cb-8d1c-4243-a7fa-9fe2ed9bda40 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:51.494206 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-20ef01cb-8d1c-4243-a7fa-9fe2ed9bda40 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:51.502174 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-20ef01cb-8d1c-4243-a7fa-9fe2ed9bda40 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:51.503624 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-20ef01cb-8d1c-4243-a7fa-9fe2ed9bda40 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:51.504769 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-20ef01cb-8d1c-4243-a7fa-9fe2ed9bda40 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1738 microversion: 2.20 time: 0.152493 Sep 27 17:29:51.505327 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 318/617] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:29:51 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:29:52.530315 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-22994676-ca17-4dcb-a596-1f4188e116fc tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:29:52.530945 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-22994676-ca17-4dcb-a596-1f4188e116fc tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:29:52.537255 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-22994676-ca17-4dcb-a596-1f4188e116fc tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:52.537733 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-22994676-ca17-4dcb-a596-1f4188e116fc tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:52.538195 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-22994676-ca17-4dcb-a596-1f4188e116fc tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:52.538876 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-22994676-ca17-4dcb-a596-1f4188e116fc tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:52.539318 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-22994676-ca17-4dcb-a596-1f4188e116fc tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:52.539737 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-22994676-ca17-4dcb-a596-1f4188e116fc tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:52.664396 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-22994676-ca17-4dcb-a596-1f4188e116fc tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:52.672331 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-22994676-ca17-4dcb-a596-1f4188e116fc tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:52.673777 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-22994676-ca17-4dcb-a596-1f4188e116fc tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:52.675046 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-22994676-ca17-4dcb-a596-1f4188e116fc tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1738 microversion: 2.20 time: 0.148681 Sep 27 17:29:52.675594 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 300/618] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:29:52 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1738 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:29:53.699363 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-be6ce254-7989-4f13-b46b-3073ce5a1190 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:29:53.699992 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-be6ce254-7989-4f13-b46b-3073ce5a1190 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:29:53.706088 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-be6ce254-7989-4f13-b46b-3073ce5a1190 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:53.706580 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-be6ce254-7989-4f13-b46b-3073ce5a1190 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:53.707017 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-be6ce254-7989-4f13-b46b-3073ce5a1190 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:53.707701 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-be6ce254-7989-4f13-b46b-3073ce5a1190 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:53.708155 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-be6ce254-7989-4f13-b46b-3073ce5a1190 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:53.708580 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-be6ce254-7989-4f13-b46b-3073ce5a1190 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:53.837879 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-be6ce254-7989-4f13-b46b-3073ce5a1190 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:53.845860 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-be6ce254-7989-4f13-b46b-3073ce5a1190 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:53.847347 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-be6ce254-7989-4f13-b46b-3073ce5a1190 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:53.848498 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-be6ce254-7989-4f13-b46b-3073ce5a1190 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1738 microversion: 2.20 time: 0.153124 Sep 27 17:29:53.849048 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 319/619] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:29:53 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:29:54.875634 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-6712ca1b-136b-499b-8154-534b625a4b2d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:29:54.876229 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-6712ca1b-136b-499b-8154-534b625a4b2d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:29:54.882481 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6712ca1b-136b-499b-8154-534b625a4b2d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:54.882950 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6712ca1b-136b-499b-8154-534b625a4b2d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:54.883858 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6712ca1b-136b-499b-8154-534b625a4b2d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:54.884533 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6712ca1b-136b-499b-8154-534b625a4b2d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:54.884973 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6712ca1b-136b-499b-8154-534b625a4b2d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:54.885390 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6712ca1b-136b-499b-8154-534b625a4b2d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:55.013444 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-6712ca1b-136b-499b-8154-534b625a4b2d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:55.021341 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-6712ca1b-136b-499b-8154-534b625a4b2d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:55.022821 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-6712ca1b-136b-499b-8154-534b625a4b2d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:55.023984 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-6712ca1b-136b-499b-8154-534b625a4b2d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1738 microversion: 2.20 time: 0.152149 Sep 27 17:29:55.025104 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 301/620] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:29:54 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:29:56.048824 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-4383d146-5670-4011-b185-5c929306a570 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:29:56.049430 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-4383d146-5670-4011-b185-5c929306a570 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:29:56.055319 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4383d146-5670-4011-b185-5c929306a570 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:56.055807 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4383d146-5670-4011-b185-5c929306a570 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:56.056247 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4383d146-5670-4011-b185-5c929306a570 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:56.056998 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4383d146-5670-4011-b185-5c929306a570 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:56.057448 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4383d146-5670-4011-b185-5c929306a570 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:56.057871 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4383d146-5670-4011-b185-5c929306a570 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:56.271476 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-4383d146-5670-4011-b185-5c929306a570 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:56.281658 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-4383d146-5670-4011-b185-5c929306a570 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:56.283257 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-4383d146-5670-4011-b185-5c929306a570 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:56.284400 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-4383d146-5670-4011-b185-5c929306a570 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1720 microversion: 2.20 time: 0.239485 Sep 27 17:29:56.284962 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 320/621] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:29:56 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1720 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:29:57.311816 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-9970a540-22cb-4fe1-aa8f-fc074aeccb12 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:29:57.312421 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-9970a540-22cb-4fe1-aa8f-fc074aeccb12 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:29:57.315782 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_api:SELECT=46 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:29:57.321706 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9970a540-22cb-4fe1-aa8f-fc074aeccb12 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:57.322227 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9970a540-22cb-4fe1-aa8f-fc074aeccb12 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:57.323317 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9970a540-22cb-4fe1-aa8f-fc074aeccb12 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:57.324026 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9970a540-22cb-4fe1-aa8f-fc074aeccb12 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:57.324914 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9970a540-22cb-4fe1-aa8f-fc074aeccb12 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:57.325471 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9970a540-22cb-4fe1-aa8f-fc074aeccb12 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:57.459455 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-9970a540-22cb-4fe1-aa8f-fc074aeccb12 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:57.468117 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-9970a540-22cb-4fe1-aa8f-fc074aeccb12 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:57.469637 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-9970a540-22cb-4fe1-aa8f-fc074aeccb12 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:57.470953 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-9970a540-22cb-4fe1-aa8f-fc074aeccb12 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1720 microversion: 2.20 time: 0.163212 Sep 27 17:29:57.471515 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 302/622] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:29:57 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1720 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:29:57.505963 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [req-21e950f6-f3c9-492c-b3be-3a72f9746708 req-5ccf636e-9137-47db-9500-7101d9f3db4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d209f2ce-43c8-422a-a703-cdc9a9fb5cee", "name": "network-vif-unplugged", "status": "completed", "tag": "5a5276d6-632d-4adb-a46b-8471fb0bf332"}]} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:29:57.515978 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-21e950f6-f3c9-492c-b3be-3a72f9746708 req-5ccf636e-9137-47db-9500-7101d9f3db4a service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:57.516457 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-21e950f6-f3c9-492c-b3be-3a72f9746708 req-5ccf636e-9137-47db-9500-7101d9f3db4a service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:57.516890 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-21e950f6-f3c9-492c-b3be-3a72f9746708 req-5ccf636e-9137-47db-9500-7101d9f3db4a service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:57.528404 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.compute.server_external_events [req-21e950f6-f3c9-492c-b3be-3a72f9746708 req-5ccf636e-9137-47db-9500-7101d9f3db4a service nova] Creating event network-vif-unplugged:5a5276d6-632d-4adb-a46b-8471fb0bf332 for instance d209f2ce-43c8-422a-a703-cdc9a9fb5cee on hv-cinder-84914 Sep 27 17:29:57.533316 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [req-21e950f6-f3c9-492c-b3be-3a72f9746708 req-5ccf636e-9137-47db-9500-7101d9f3db4a service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031050 Sep 27 17:29:57.533890 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 321/623] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:29:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:29:58.496676 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-5a9425db-5483-4fb2-ab36-bfd42a14a83c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:29:58.497720 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-5a9425db-5483-4fb2-ab36-bfd42a14a83c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:29:58.503783 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5a9425db-5483-4fb2-ab36-bfd42a14a83c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:58.504357 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5a9425db-5483-4fb2-ab36-bfd42a14a83c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:58.504859 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5a9425db-5483-4fb2-ab36-bfd42a14a83c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:58.505618 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5a9425db-5483-4fb2-ab36-bfd42a14a83c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:58.506201 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5a9425db-5483-4fb2-ab36-bfd42a14a83c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:58.506694 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5a9425db-5483-4fb2-ab36-bfd42a14a83c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:58.706155 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-5a9425db-5483-4fb2-ab36-bfd42a14a83c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:58.714786 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-5a9425db-5483-4fb2-ab36-bfd42a14a83c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:58.716239 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-5a9425db-5483-4fb2-ab36-bfd42a14a83c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:58.717408 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-5a9425db-5483-4fb2-ab36-bfd42a14a83c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1720 microversion: 2.20 time: 0.224671 Sep 27 17:29:58.724841 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 303/624] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:29:58 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1720 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:29:59.745251 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-f5e05ed6-06f0-4b7a-b53c-ea4efdda8823 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:29:59.745948 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-f5e05ed6-06f0-4b7a-b53c-ea4efdda8823 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:29:59.752235 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f5e05ed6-06f0-4b7a-b53c-ea4efdda8823 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:59.752736 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f5e05ed6-06f0-4b7a-b53c-ea4efdda8823 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:59.753184 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f5e05ed6-06f0-4b7a-b53c-ea4efdda8823 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:59.753837 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f5e05ed6-06f0-4b7a-b53c-ea4efdda8823 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:29:59.754322 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f5e05ed6-06f0-4b7a-b53c-ea4efdda8823 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:29:59.754745 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f5e05ed6-06f0-4b7a-b53c-ea4efdda8823 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:29:59.956548 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-f5e05ed6-06f0-4b7a-b53c-ea4efdda8823 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:59.965988 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-f5e05ed6-06f0-4b7a-b53c-ea4efdda8823 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:59.967777 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-f5e05ed6-06f0-4b7a-b53c-ea4efdda8823 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:29:59.969083 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-f5e05ed6-06f0-4b7a-b53c-ea4efdda8823 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1663 microversion: 2.20 time: 0.228289 Sep 27 17:29:59.969749 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 322/625] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:29:59 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1663 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 17:29:59.995360 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-59c7b52a-34bc-4793-8772-ec22042743c1 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fa867908-9194-4f19-90c5-c3c4802039fc"}} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:29:59.998499 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-59c7b52a-34bc-4793-8772-ec22042743c1 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:30:00.006279 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-59c7b52a-34bc-4793-8772-ec22042743c1 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:00.006831 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-59c7b52a-34bc-4793-8772-ec22042743c1 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:00.007338 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-59c7b52a-34bc-4793-8772-ec22042743c1 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:00.008067 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-59c7b52a-34bc-4793-8772-ec22042743c1 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:00.008559 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-59c7b52a-34bc-4793-8772-ec22042743c1 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:00.009167 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-59c7b52a-34bc-4793-8772-ec22042743c1 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:00.338352 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-59c7b52a-34bc-4793-8772-ec22042743c1 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "POST /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.347299 Sep 27 17:30:00.339183 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 304/626] 10.222.0.55 () {62 vars in 1364 bytes} [Tue Sep 27 17:29:59 2022] POST /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee/os-volume_attachments => generated 188 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 17:30:00.479479 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-f9cab307-eb60-433c-9d45-b1f5ccb28f47 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:30:00.480294 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-f9cab307-eb60-433c-9d45-b1f5ccb28f47 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:30:00.485382 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_api:SELECT=44 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:30:00.487436 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f9cab307-eb60-433c-9d45-b1f5ccb28f47 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:00.488499 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f9cab307-eb60-433c-9d45-b1f5ccb28f47 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:00.488975 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f9cab307-eb60-433c-9d45-b1f5ccb28f47 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:00.489688 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f9cab307-eb60-433c-9d45-b1f5ccb28f47 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:00.490347 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f9cab307-eb60-433c-9d45-b1f5ccb28f47 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:00.490931 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f9cab307-eb60-433c-9d45-b1f5ccb28f47 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:00.538042 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-f9cab307-eb60-433c-9d45-b1f5ccb28f47 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120416) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 27 17:30:00.613806 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-f9cab307-eb60-433c-9d45-b1f5ccb28f47 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "POST /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee/action" status: 202 len: 0 microversion: 2.20 time: 0.138546 Sep 27 17:30:00.614452 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 323/627] 10.222.0.55 () {62 vars in 1319 bytes} [Tue Sep 27 17:30:00 2022] POST /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 27 17:30:00.625027 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-53e7a462-edf7-4c22-9dfd-4d2f47b99b5a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:30:00.625895 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-53e7a462-edf7-4c22-9dfd-4d2f47b99b5a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:30:00.635441 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-53e7a462-edf7-4c22-9dfd-4d2f47b99b5a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:00.636124 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-53e7a462-edf7-4c22-9dfd-4d2f47b99b5a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:00.636733 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-53e7a462-edf7-4c22-9dfd-4d2f47b99b5a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:00.637581 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-53e7a462-edf7-4c22-9dfd-4d2f47b99b5a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:00.638225 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-53e7a462-edf7-4c22-9dfd-4d2f47b99b5a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:00.638913 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-53e7a462-edf7-4c22-9dfd-4d2f47b99b5a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:00.659687 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:30:00.899831 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-53e7a462-edf7-4c22-9dfd-4d2f47b99b5a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:00.909197 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-53e7a462-edf7-4c22-9dfd-4d2f47b99b5a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:00.910830 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-53e7a462-edf7-4c22-9dfd-4d2f47b99b5a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:00.912951 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-53e7a462-edf7-4c22-9dfd-4d2f47b99b5a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1749 microversion: 2.20 time: 0.293131 Sep 27 17:30:00.927741 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 305/628] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:30:00 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1749 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:30:01.942996 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-070b52ed-9100-42ec-aa45-8472e72ed911 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:30:01.943713 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-070b52ed-9100-42ec-aa45-8472e72ed911 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:30:01.951766 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-070b52ed-9100-42ec-aa45-8472e72ed911 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:01.952513 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-070b52ed-9100-42ec-aa45-8472e72ed911 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:01.952938 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-070b52ed-9100-42ec-aa45-8472e72ed911 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:01.953639 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-070b52ed-9100-42ec-aa45-8472e72ed911 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:01.954112 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-070b52ed-9100-42ec-aa45-8472e72ed911 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:01.954543 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-070b52ed-9100-42ec-aa45-8472e72ed911 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:02.196470 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-070b52ed-9100-42ec-aa45-8472e72ed911 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:02.207681 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-070b52ed-9100-42ec-aa45-8472e72ed911 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:02.210318 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-070b52ed-9100-42ec-aa45-8472e72ed911 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:02.214356 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-070b52ed-9100-42ec-aa45-8472e72ed911 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1749 microversion: 2.20 time: 0.274327 Sep 27 17:30:02.215253 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 324/629] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:30:01 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1749 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:30:03.241104 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-ada934e4-0372-484b-9759-02bd271ce8f3 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:30:03.242340 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-ada934e4-0372-484b-9759-02bd271ce8f3 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:30:03.255366 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ada934e4-0372-484b-9759-02bd271ce8f3 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:03.255958 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ada934e4-0372-484b-9759-02bd271ce8f3 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:03.260409 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ada934e4-0372-484b-9759-02bd271ce8f3 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:03.261240 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ada934e4-0372-484b-9759-02bd271ce8f3 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:03.261774 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ada934e4-0372-484b-9759-02bd271ce8f3 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:03.262299 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ada934e4-0372-484b-9759-02bd271ce8f3 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:03.471507 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-ada934e4-0372-484b-9759-02bd271ce8f3 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:03.481993 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-ada934e4-0372-484b-9759-02bd271ce8f3 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:03.483647 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-ada934e4-0372-484b-9759-02bd271ce8f3 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:03.485146 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-ada934e4-0372-484b-9759-02bd271ce8f3 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1807 microversion: 2.20 time: 0.248227 Sep 27 17:30:03.494143 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 306/630] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:30:03 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1807 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:30:04.512421 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-1e176fae-e617-4eca-a498-8aee4a653b2d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:30:04.513691 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-1e176fae-e617-4eca-a498-8aee4a653b2d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:30:04.524347 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1e176fae-e617-4eca-a498-8aee4a653b2d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:04.525117 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1e176fae-e617-4eca-a498-8aee4a653b2d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:04.525721 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1e176fae-e617-4eca-a498-8aee4a653b2d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:04.526622 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1e176fae-e617-4eca-a498-8aee4a653b2d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:04.527232 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1e176fae-e617-4eca-a498-8aee4a653b2d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:04.527853 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1e176fae-e617-4eca-a498-8aee4a653b2d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:04.746547 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-1e176fae-e617-4eca-a498-8aee4a653b2d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:04.758972 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-1e176fae-e617-4eca-a498-8aee4a653b2d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:04.761443 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-1e176fae-e617-4eca-a498-8aee4a653b2d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:04.763842 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-1e176fae-e617-4eca-a498-8aee4a653b2d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1807 microversion: 2.20 time: 0.255586 Sep 27 17:30:04.765087 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 325/631] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:30:04 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1807 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:30:05.791158 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-510926c0-d71c-42af-9161-736ba7bc8c27 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:30:05.792647 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-510926c0-d71c-42af-9161-736ba7bc8c27 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:30:05.808527 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-510926c0-d71c-42af-9161-736ba7bc8c27 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:05.809291 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-510926c0-d71c-42af-9161-736ba7bc8c27 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:05.809945 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-510926c0-d71c-42af-9161-736ba7bc8c27 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:05.810917 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-510926c0-d71c-42af-9161-736ba7bc8c27 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:05.813672 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-510926c0-d71c-42af-9161-736ba7bc8c27 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:05.814444 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-510926c0-d71c-42af-9161-736ba7bc8c27 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:06.257110 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-510926c0-d71c-42af-9161-736ba7bc8c27 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:06.272679 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-510926c0-d71c-42af-9161-736ba7bc8c27 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:06.276576 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-510926c0-d71c-42af-9161-736ba7bc8c27 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:06.278336 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-510926c0-d71c-42af-9161-736ba7bc8c27 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1807 microversion: 2.20 time: 0.490720 Sep 27 17:30:06.279564 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 307/632] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:30:05 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1807 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:30:07.309432 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-e4898f40-bb3a-45b2-ab22-15ea8c63ff4e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:30:07.310976 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-e4898f40-bb3a-45b2-ab22-15ea8c63ff4e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:30:07.327542 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e4898f40-bb3a-45b2-ab22-15ea8c63ff4e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:07.334963 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e4898f40-bb3a-45b2-ab22-15ea8c63ff4e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:07.335711 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e4898f40-bb3a-45b2-ab22-15ea8c63ff4e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:07.337204 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e4898f40-bb3a-45b2-ab22-15ea8c63ff4e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:07.343019 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e4898f40-bb3a-45b2-ab22-15ea8c63ff4e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:07.343738 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e4898f40-bb3a-45b2-ab22-15ea8c63ff4e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:07.658165 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-e4898f40-bb3a-45b2-ab22-15ea8c63ff4e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:07.671138 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-e4898f40-bb3a-45b2-ab22-15ea8c63ff4e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:07.673233 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-e4898f40-bb3a-45b2-ab22-15ea8c63ff4e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:07.680058 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-e4898f40-bb3a-45b2-ab22-15ea8c63ff4e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1807 microversion: 2.20 time: 0.374973 Sep 27 17:30:07.682997 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 326/633] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:30:07 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1807 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:30:08.738650 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-3afa123f-9e72-4df0-af97-211b45310df7 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:30:08.740234 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-3afa123f-9e72-4df0-af97-211b45310df7 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:30:08.763609 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3afa123f-9e72-4df0-af97-211b45310df7 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:08.765742 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3afa123f-9e72-4df0-af97-211b45310df7 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:08.766611 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3afa123f-9e72-4df0-af97-211b45310df7 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:08.770747 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3afa123f-9e72-4df0-af97-211b45310df7 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:08.771609 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3afa123f-9e72-4df0-af97-211b45310df7 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:08.772232 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3afa123f-9e72-4df0-af97-211b45310df7 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:09.185067 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-3afa123f-9e72-4df0-af97-211b45310df7 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:09.201836 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-3afa123f-9e72-4df0-af97-211b45310df7 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:09.203578 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-3afa123f-9e72-4df0-af97-211b45310df7 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:09.206064 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-3afa123f-9e72-4df0-af97-211b45310df7 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1807 microversion: 2.20 time: 0.496475 Sep 27 17:30:09.243651 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 308/634] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:30:08 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1807 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:30:10.248526 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-55969ebe-e35a-4e3f-9037-d8f6e73ca8f1 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:30:10.249311 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-55969ebe-e35a-4e3f-9037-d8f6e73ca8f1 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:30:10.267335 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-55969ebe-e35a-4e3f-9037-d8f6e73ca8f1 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:10.268286 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-55969ebe-e35a-4e3f-9037-d8f6e73ca8f1 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:10.269344 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-55969ebe-e35a-4e3f-9037-d8f6e73ca8f1 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:10.271358 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-55969ebe-e35a-4e3f-9037-d8f6e73ca8f1 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:10.276597 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-55969ebe-e35a-4e3f-9037-d8f6e73ca8f1 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:10.277197 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-55969ebe-e35a-4e3f-9037-d8f6e73ca8f1 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:10.534398 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-55969ebe-e35a-4e3f-9037-d8f6e73ca8f1 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:10.546595 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-55969ebe-e35a-4e3f-9037-d8f6e73ca8f1 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:10.548668 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-55969ebe-e35a-4e3f-9037-d8f6e73ca8f1 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:10.550135 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-55969ebe-e35a-4e3f-9037-d8f6e73ca8f1 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1807 microversion: 2.20 time: 0.305496 Sep 27 17:30:10.551189 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 327/635] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:30:10 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1807 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:30:11.586033 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-c482e2bc-7272-4ad7-841d-e2e2aec69076 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:30:11.586813 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-c482e2bc-7272-4ad7-841d-e2e2aec69076 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:30:11.595789 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c482e2bc-7272-4ad7-841d-e2e2aec69076 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:11.596283 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c482e2bc-7272-4ad7-841d-e2e2aec69076 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:11.598358 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c482e2bc-7272-4ad7-841d-e2e2aec69076 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:11.600082 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c482e2bc-7272-4ad7-841d-e2e2aec69076 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:11.602500 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c482e2bc-7272-4ad7-841d-e2e2aec69076 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:11.605373 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c482e2bc-7272-4ad7-841d-e2e2aec69076 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:11.819405 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-c482e2bc-7272-4ad7-841d-e2e2aec69076 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:11.824407 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:30:11.827708 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-2055c36f-e7d7-418a-99a7-cf541e3a5b8a tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Action: 'create', calling method: .version_select at 0x7fe7248b8790>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2033463902", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPUS4KeFSwdWsj4XlM9luIdTGnLhXUe/tlw4RaqD6t0NVS4jpyV7pfU7v0OIHaGRqWUGw/YNl+f0gsCSc67TPgT6UUFZ1U8p5uJyxT2s37yYhOoVKy2V/3siCh+1QoBNFg=="}} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:30:11.833276 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-c482e2bc-7272-4ad7-841d-e2e2aec69076 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:11.839154 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-c482e2bc-7272-4ad7-841d-e2e2aec69076 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:11.839154 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-c482e2bc-7272-4ad7-841d-e2e2aec69076 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1807 microversion: 2.20 time: 0.264043 Sep 27 17:30:11.839154 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 328/636] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:30:11 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1807 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 17:30:11.853222 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.quota [None req-2055c36f-e7d7-418a-99a7-cf541e3a5b8a tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Getting quotas for project f4db1a85e2504cb9956a6461b5072aa3. Resources: {'key_pairs'} {{(pid=120415) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 17:30:11.859502 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.quota [None req-2055c36f-e7d7-418a-99a7-cf541e3a5b8a tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Getting quotas for user cac1528c35fb464db00b5d18396b8eac and project f4db1a85e2504cb9956a6461b5072aa3. Resources: {'key_pairs'} {{(pid=120415) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 17:30:11.900263 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-2055c36f-e7d7-418a-99a7-cf541e3a5b8a tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.422450 Sep 27 17:30:11.919344 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 309/637] 10.222.0.55 () {60 vars in 1159 bytes} [Tue Sep 27 17:30:11 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:30:12.865486 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-3cb4f78d-dd3d-483e-ba27-d7c909d124ee tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:30:12.866354 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-3cb4f78d-dd3d-483e-ba27-d7c909d124ee tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:30:12.897481 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3cb4f78d-dd3d-483e-ba27-d7c909d124ee tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:12.898964 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3cb4f78d-dd3d-483e-ba27-d7c909d124ee tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:12.901242 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3cb4f78d-dd3d-483e-ba27-d7c909d124ee tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:12.902263 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3cb4f78d-dd3d-483e-ba27-d7c909d124ee tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:12.904446 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3cb4f78d-dd3d-483e-ba27-d7c909d124ee tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:12.905189 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3cb4f78d-dd3d-483e-ba27-d7c909d124ee tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:13.386327 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-3cb4f78d-dd3d-483e-ba27-d7c909d124ee tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:13.444277 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-3cb4f78d-dd3d-483e-ba27-d7c909d124ee tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:13.451208 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-3cb4f78d-dd3d-483e-ba27-d7c909d124ee tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:13.453147 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-3cb4f78d-dd3d-483e-ba27-d7c909d124ee tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1807 microversion: 2.20 time: 0.591999 Sep 27 17:30:13.454154 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 329/638] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:30:12 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1807 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 17:30:14.481870 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-36cad398-755c-4e75-b2e7-35f9916e87fd tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:30:14.482507 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-36cad398-755c-4e75-b2e7-35f9916e87fd tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:30:14.497835 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-36cad398-755c-4e75-b2e7-35f9916e87fd tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:14.498427 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-36cad398-755c-4e75-b2e7-35f9916e87fd tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:14.498920 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-36cad398-755c-4e75-b2e7-35f9916e87fd tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:14.499820 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-36cad398-755c-4e75-b2e7-35f9916e87fd tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:14.500320 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-36cad398-755c-4e75-b2e7-35f9916e87fd tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:14.500717 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-36cad398-755c-4e75-b2e7-35f9916e87fd tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:14.662502 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-36cad398-755c-4e75-b2e7-35f9916e87fd tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:14.671842 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-36cad398-755c-4e75-b2e7-35f9916e87fd tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:14.673847 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-36cad398-755c-4e75-b2e7-35f9916e87fd tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:14.696207 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-36cad398-755c-4e75-b2e7-35f9916e87fd tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1807 microversion: 2.20 time: 0.198155 Sep 27 17:30:14.696207 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 310/639] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:30:14 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1807 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:30:15.713800 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-229ae21b-da21-475d-88e4-8b1acc417758 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:30:15.714445 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-229ae21b-da21-475d-88e4-8b1acc417758 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:30:15.720280 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-229ae21b-da21-475d-88e4-8b1acc417758 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:15.720768 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-229ae21b-da21-475d-88e4-8b1acc417758 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:15.721205 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-229ae21b-da21-475d-88e4-8b1acc417758 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:15.721899 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-229ae21b-da21-475d-88e4-8b1acc417758 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:15.722389 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-229ae21b-da21-475d-88e4-8b1acc417758 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:15.722821 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-229ae21b-da21-475d-88e4-8b1acc417758 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:15.880491 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-229ae21b-da21-475d-88e4-8b1acc417758 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:15.892043 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-229ae21b-da21-475d-88e4-8b1acc417758 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:15.895296 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-229ae21b-da21-475d-88e4-8b1acc417758 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:15.897655 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-229ae21b-da21-475d-88e4-8b1acc417758 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1807 microversion: 2.20 time: 0.188327 Sep 27 17:30:15.899588 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 330/640] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:30:15 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1807 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:30:16.924917 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-82e91d1e-b173-4fcf-b9ff-6c8f769b303f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:30:16.925618 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-82e91d1e-b173-4fcf-b9ff-6c8f769b303f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:30:16.933109 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-82e91d1e-b173-4fcf-b9ff-6c8f769b303f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:16.933621 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-82e91d1e-b173-4fcf-b9ff-6c8f769b303f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:16.934190 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-82e91d1e-b173-4fcf-b9ff-6c8f769b303f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:16.934940 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-82e91d1e-b173-4fcf-b9ff-6c8f769b303f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:16.935600 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-82e91d1e-b173-4fcf-b9ff-6c8f769b303f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:16.936019 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-82e91d1e-b173-4fcf-b9ff-6c8f769b303f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:17.073473 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-82e91d1e-b173-4fcf-b9ff-6c8f769b303f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:17.081955 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-82e91d1e-b173-4fcf-b9ff-6c8f769b303f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:17.083423 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-82e91d1e-b173-4fcf-b9ff-6c8f769b303f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:17.084577 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-82e91d1e-b173-4fcf-b9ff-6c8f769b303f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1807 microversion: 2.20 time: 0.163729 Sep 27 17:30:17.085134 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 311/641] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:30:16 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:30:17.618850 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-15668bed-6957-4770-86dd-c330aa579c7b tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:30:17.619440 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-15668bed-6957-4770-86dd-c330aa579c7b tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: fef20d9a-42bf-4605-bbcb-b673d215a5b9] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:30:17.625178 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-15668bed-6957-4770-86dd-c330aa579c7b tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:17.625653 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-15668bed-6957-4770-86dd-c330aa579c7b tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:17.626100 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-15668bed-6957-4770-86dd-c330aa579c7b tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:17.626781 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-15668bed-6957-4770-86dd-c330aa579c7b tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:17.627233 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-15668bed-6957-4770-86dd-c330aa579c7b tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:17.627655 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-15668bed-6957-4770-86dd-c330aa579c7b tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:17.650471 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-15668bed-6957-4770-86dd-c330aa579c7b tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9/ips" status: 200 len: 150 microversion: 2.1 time: 0.035519 Sep 27 17:30:17.651019 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 331/642] 10.222.0.55 () {58 vars in 1248 bytes} [Tue Sep 27 17:30:17 2022] GET /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9/ips => generated 150 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:30:18.110659 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-3b943992-d37b-4b36-b2bd-1e7c5345a0ec tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:30:18.111269 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-3b943992-d37b-4b36-b2bd-1e7c5345a0ec tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:30:18.117699 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3b943992-d37b-4b36-b2bd-1e7c5345a0ec tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:18.118215 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3b943992-d37b-4b36-b2bd-1e7c5345a0ec tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:18.118649 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3b943992-d37b-4b36-b2bd-1e7c5345a0ec tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:18.119332 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3b943992-d37b-4b36-b2bd-1e7c5345a0ec tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:18.119782 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3b943992-d37b-4b36-b2bd-1e7c5345a0ec tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:18.120231 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3b943992-d37b-4b36-b2bd-1e7c5345a0ec tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:18.253983 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-3b943992-d37b-4b36-b2bd-1e7c5345a0ec tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:18.263245 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-3b943992-d37b-4b36-b2bd-1e7c5345a0ec tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:18.264689 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-3b943992-d37b-4b36-b2bd-1e7c5345a0ec tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:18.265837 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-3b943992-d37b-4b36-b2bd-1e7c5345a0ec tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1807 microversion: 2.20 time: 0.159068 Sep 27 17:30:18.266602 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 312/643] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:30:18 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 17:30:19.293113 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-a067d275-817d-4e14-9800-1acc92ee6240 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:30:19.293113 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-a067d275-817d-4e14-9800-1acc92ee6240 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:30:19.298485 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a067d275-817d-4e14-9800-1acc92ee6240 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:19.298958 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a067d275-817d-4e14-9800-1acc92ee6240 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:19.299383 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a067d275-817d-4e14-9800-1acc92ee6240 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:19.300110 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a067d275-817d-4e14-9800-1acc92ee6240 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:19.300567 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a067d275-817d-4e14-9800-1acc92ee6240 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:19.300984 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a067d275-817d-4e14-9800-1acc92ee6240 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:19.426935 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-a067d275-817d-4e14-9800-1acc92ee6240 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:19.435994 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-a067d275-817d-4e14-9800-1acc92ee6240 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:19.437428 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-a067d275-817d-4e14-9800-1acc92ee6240 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:19.438628 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-a067d275-817d-4e14-9800-1acc92ee6240 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1807 microversion: 2.20 time: 0.151355 Sep 27 17:30:19.439183 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 332/644] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:30:19 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 17:30:20.086464 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-7a204278-7db2-4363-9e2d-cf98f051bea5 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "27b6cfd9-3384-409b-a763-5be9d5c19670"}} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:30:20.088870 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-7a204278-7db2-4363-9e2d-cf98f051bea5 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: fef20d9a-42bf-4605-bbcb-b673d215a5b9] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:30:20.095932 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7a204278-7db2-4363-9e2d-cf98f051bea5 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:20.096483 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7a204278-7db2-4363-9e2d-cf98f051bea5 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:20.096951 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7a204278-7db2-4363-9e2d-cf98f051bea5 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:20.097676 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7a204278-7db2-4363-9e2d-cf98f051bea5 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:20.098209 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7a204278-7db2-4363-9e2d-cf98f051bea5 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:20.098671 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7a204278-7db2-4363-9e2d-cf98f051bea5 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:20.464434 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-10805ee8-92b7-43b3-9d48-cd3043a2c774 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:30:20.465040 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-10805ee8-92b7-43b3-9d48-cd3043a2c774 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:30:20.471262 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-10805ee8-92b7-43b3-9d48-cd3043a2c774 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:20.471743 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-10805ee8-92b7-43b3-9d48-cd3043a2c774 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:20.472173 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-10805ee8-92b7-43b3-9d48-cd3043a2c774 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:20.472867 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-10805ee8-92b7-43b3-9d48-cd3043a2c774 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:20.473320 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-10805ee8-92b7-43b3-9d48-cd3043a2c774 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:20.473737 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-10805ee8-92b7-43b3-9d48-cd3043a2c774 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:20.604126 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-10805ee8-92b7-43b3-9d48-cd3043a2c774 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:20.612861 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-10805ee8-92b7-43b3-9d48-cd3043a2c774 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:20.614338 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-10805ee8-92b7-43b3-9d48-cd3043a2c774 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:20.615497 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-10805ee8-92b7-43b3-9d48-cd3043a2c774 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1807 microversion: 2.20 time: 0.155163 Sep 27 17:30:20.616051 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 333/645] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:30:20 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 17:30:21.641941 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-8d88521e-88d7-4af2-be34-7f8eb2899436 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:30:21.642576 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-8d88521e-88d7-4af2-be34-7f8eb2899436 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:30:21.648350 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8d88521e-88d7-4af2-be34-7f8eb2899436 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:21.648826 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8d88521e-88d7-4af2-be34-7f8eb2899436 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:21.649249 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8d88521e-88d7-4af2-be34-7f8eb2899436 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:21.649923 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8d88521e-88d7-4af2-be34-7f8eb2899436 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:21.650399 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8d88521e-88d7-4af2-be34-7f8eb2899436 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:21.650820 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8d88521e-88d7-4af2-be34-7f8eb2899436 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:21.780004 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-8d88521e-88d7-4af2-be34-7f8eb2899436 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:21.788455 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-8d88521e-88d7-4af2-be34-7f8eb2899436 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:21.791146 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-8d88521e-88d7-4af2-be34-7f8eb2899436 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:21.792325 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-8d88521e-88d7-4af2-be34-7f8eb2899436 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1807 microversion: 2.20 time: 0.154358 Sep 27 17:30:21.793076 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 334/646] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:30:21 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 17:30:21.869658 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell0:SELECT=4 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:30:22.630377 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-7a204278-7db2-4363-9e2d-cf98f051bea5 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "POST /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.548577 Sep 27 17:30:22.631112 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 313/647] 10.222.0.55 () {60 vars in 1323 bytes} [Tue Sep 27 17:30:20 2022] POST /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9/os-volume_attachments => generated 194 bytes in 2550 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:30:22.824883 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-69b72c33-b095-48cc-aa5d-c6e88cbcbdce tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:30:22.826516 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-69b72c33-b095-48cc-aa5d-c6e88cbcbdce tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:30:22.837162 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-69b72c33-b095-48cc-aa5d-c6e88cbcbdce tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:22.838019 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-69b72c33-b095-48cc-aa5d-c6e88cbcbdce tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:22.839678 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-69b72c33-b095-48cc-aa5d-c6e88cbcbdce tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:22.840602 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-69b72c33-b095-48cc-aa5d-c6e88cbcbdce tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:22.841462 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-69b72c33-b095-48cc-aa5d-c6e88cbcbdce tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:22.842171 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-69b72c33-b095-48cc-aa5d-c6e88cbcbdce tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:23.067125 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-69b72c33-b095-48cc-aa5d-c6e88cbcbdce tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:23.076298 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-69b72c33-b095-48cc-aa5d-c6e88cbcbdce tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:23.077757 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-69b72c33-b095-48cc-aa5d-c6e88cbcbdce tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:23.078955 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-69b72c33-b095-48cc-aa5d-c6e88cbcbdce tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1807 microversion: 2.20 time: 0.263015 Sep 27 17:30:23.079517 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 335/648] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:30:22 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1807 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:30:24.106652 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-452e1b9c-cdda-413c-89c8-bf7cbd47e5db tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:30:24.107351 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-452e1b9c-cdda-413c-89c8-bf7cbd47e5db tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:30:24.113457 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-452e1b9c-cdda-413c-89c8-bf7cbd47e5db tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:24.113938 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-452e1b9c-cdda-413c-89c8-bf7cbd47e5db tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:24.114402 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-452e1b9c-cdda-413c-89c8-bf7cbd47e5db tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:24.115088 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-452e1b9c-cdda-413c-89c8-bf7cbd47e5db tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:24.115541 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-452e1b9c-cdda-413c-89c8-bf7cbd47e5db tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:24.115963 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-452e1b9c-cdda-413c-89c8-bf7cbd47e5db tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:24.256370 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-452e1b9c-cdda-413c-89c8-bf7cbd47e5db tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:24.265740 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-452e1b9c-cdda-413c-89c8-bf7cbd47e5db tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:24.267239 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-452e1b9c-cdda-413c-89c8-bf7cbd47e5db tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:24.268400 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-452e1b9c-cdda-413c-89c8-bf7cbd47e5db tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1807 microversion: 2.20 time: 0.167354 Sep 27 17:30:24.268980 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 314/649] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:30:24 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:30:25.294215 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-ab713506-d8eb-4ec0-bf70-da5dfed0aea7 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:30:25.294840 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-ab713506-d8eb-4ec0-bf70-da5dfed0aea7 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:30:25.300747 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ab713506-d8eb-4ec0-bf70-da5dfed0aea7 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:25.301239 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ab713506-d8eb-4ec0-bf70-da5dfed0aea7 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:25.301681 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ab713506-d8eb-4ec0-bf70-da5dfed0aea7 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:25.302403 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ab713506-d8eb-4ec0-bf70-da5dfed0aea7 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:25.302865 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ab713506-d8eb-4ec0-bf70-da5dfed0aea7 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:25.303304 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ab713506-d8eb-4ec0-bf70-da5dfed0aea7 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:25.435166 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-ab713506-d8eb-4ec0-bf70-da5dfed0aea7 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:25.443737 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-ab713506-d8eb-4ec0-bf70-da5dfed0aea7 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:25.445169 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-ab713506-d8eb-4ec0-bf70-da5dfed0aea7 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:25.446864 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-ab713506-d8eb-4ec0-bf70-da5dfed0aea7 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1807 microversion: 2.20 time: 0.156023 Sep 27 17:30:25.447407 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 336/650] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:30:25 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:30:25.945738 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-e0020332-5d14-4422-adea-2a3112312559 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Action: 'create', calling method: .version_select at 0x7fe724855a60>, body: {"keypair": {"name": "tempest-keypair-1199101514", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIhcWRS5aeG+iqVD7nvZFYZYgzkc7BM/k7B8YQqpbE/FUnY8eTYGFyRxgDHSSooS1OwjIK3bv79T1L8Cz0fIJigZ7AQBzEaFf6rojhgdfIVLBpxXTp1aU5ydIu/4SKpaJw=="}} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:30:25.962246 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.quota [None req-e0020332-5d14-4422-adea-2a3112312559 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Getting quotas for project ef13103d3d8b43e1882d4820c8d9247b. Resources: {'key_pairs'} {{(pid=120415) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 17:30:25.966416 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.quota [None req-e0020332-5d14-4422-adea-2a3112312559 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Getting quotas for user 0b02c2ba9a0a48c294a11b42cbfe28e3 and project ef13103d3d8b43e1882d4820c8d9247b. Resources: {'key_pairs'} {{(pid=120415) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 17:30:25.988501 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-e0020332-5d14-4422-adea-2a3112312559 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046553 Sep 27 17:30:25.989090 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 315/651] 10.222.0.55 () {60 vars in 1159 bytes} [Tue Sep 27 17:30:25 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:30:26.474206 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-074a4fb8-1b0f-40b4-b4b8-5c56428f5c4a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:30:26.474846 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-074a4fb8-1b0f-40b4-b4b8-5c56428f5c4a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:30:26.481406 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-074a4fb8-1b0f-40b4-b4b8-5c56428f5c4a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:26.481896 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-074a4fb8-1b0f-40b4-b4b8-5c56428f5c4a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:26.482360 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-074a4fb8-1b0f-40b4-b4b8-5c56428f5c4a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:26.483062 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-074a4fb8-1b0f-40b4-b4b8-5c56428f5c4a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:26.483516 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-074a4fb8-1b0f-40b4-b4b8-5c56428f5c4a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:26.483944 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-074a4fb8-1b0f-40b4-b4b8-5c56428f5c4a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:26.616027 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-074a4fb8-1b0f-40b4-b4b8-5c56428f5c4a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:26.624513 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-074a4fb8-1b0f-40b4-b4b8-5c56428f5c4a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:26.625948 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-074a4fb8-1b0f-40b4-b4b8-5c56428f5c4a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:26.627187 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-074a4fb8-1b0f-40b4-b4b8-5c56428f5c4a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1807 microversion: 2.20 time: 0.157016 Sep 27 17:30:26.627743 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 337/652] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:30:26 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:30:27.237038 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-990d9d01-9985-4c81-b8d9-1fba5c1cdd77 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-172373723", "imageRef": "9355bd92-0a49-42cd-b079-ff9f0d54b91b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "50dc8265-0d0d-49da-afd6-19daca5e673b"}], "security_groups": [{"name": "tempest-securitygroup--639797773"}], "key_name": "tempest-keypair-1199101514", "user_data": "}} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:30:27.341399 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.network.neutron [None req-990d9d01-9985-4c81-b8d9-1fba5c1cdd77 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] validate_networks() for [('50dc8265-0d0d-49da-afd6-19daca5e673b', None, None, None, None, None)] {{(pid=120415) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 17:30:27.519178 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=2 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:30:27.654345 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-3d926c2d-7fb9-4964-8a80-206125030655 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:30:27.654964 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-3d926c2d-7fb9-4964-8a80-206125030655 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:30:27.660894 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3d926c2d-7fb9-4964-8a80-206125030655 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:27.661372 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3d926c2d-7fb9-4964-8a80-206125030655 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:27.661806 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3d926c2d-7fb9-4964-8a80-206125030655 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:27.662525 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3d926c2d-7fb9-4964-8a80-206125030655 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:27.662981 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3d926c2d-7fb9-4964-8a80-206125030655 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:27.663404 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3d926c2d-7fb9-4964-8a80-206125030655 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:27.860393 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-3d926c2d-7fb9-4964-8a80-206125030655 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:27.869569 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-3d926c2d-7fb9-4964-8a80-206125030655 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:27.871332 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-3d926c2d-7fb9-4964-8a80-206125030655 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:27.872569 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-3d926c2d-7fb9-4964-8a80-206125030655 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1807 microversion: 2.20 time: 0.223632 Sep 27 17:30:27.873140 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 338/653] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:30:27 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1807 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 17:30:27.874510 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-990d9d01-9985-4c81-b8d9-1fba5c1cdd77 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Flavor limits 0:0:0 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 17:30:27.874922 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-990d9d01-9985-4c81-b8d9-1fba5c1cdd77 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Image limits 0:0:0 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 17:30:27.875384 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-990d9d01-9985-4c81-b8d9-1fba5c1cdd77 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Flavor pref 0:0:0 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 17:30:27.875781 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-990d9d01-9985-4c81-b8d9-1fba5c1cdd77 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Image pref 0:0:0 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 17:30:27.876180 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-990d9d01-9985-4c81-b8d9-1fba5c1cdd77 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 17:30:27.885357 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-990d9d01-9985-4c81-b8d9-1fba5c1cdd77 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:27.885823 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-990d9d01-9985-4c81-b8d9-1fba5c1cdd77 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:27.886284 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-990d9d01-9985-4c81-b8d9-1fba5c1cdd77 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:27.886999 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-990d9d01-9985-4c81-b8d9-1fba5c1cdd77 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:27.887444 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-990d9d01-9985-4c81-b8d9-1fba5c1cdd77 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:27.887858 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-990d9d01-9985-4c81-b8d9-1fba5c1cdd77 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:27.908384 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.quota [None req-990d9d01-9985-4c81-b8d9-1fba5c1cdd77 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Getting quotas for project ef13103d3d8b43e1882d4820c8d9247b. Resources: {'cores', 'ram', 'instances'} {{(pid=120415) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 17:30:27.912513 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.quota [None req-990d9d01-9985-4c81-b8d9-1fba5c1cdd77 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Getting quotas for user 0b02c2ba9a0a48c294a11b42cbfe28e3 and project ef13103d3d8b43e1882d4820c8d9247b. Resources: {'cores', 'ram', 'instances'} {{(pid=120415) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 17:30:27.924409 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-990d9d01-9985-4c81-b8d9-1fba5c1cdd77 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Going to run 1 instances... {{(pid=120415) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 17:30:27.926744 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-990d9d01-9985-4c81-b8d9-1fba5c1cdd77 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: 9cd2f537-78c4-4a00-95ab-4f7b115810cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9355bd92-0a49-42cd-b079-ff9f0d54b91b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120415) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 17:30:27.980206 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-990d9d01-9985-4c81-b8d9-1fba5c1cdd77 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.747816 Sep 27 17:30:27.981582 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 316/654] 10.222.0.55 () {60 vars in 1147 bytes} [Tue Sep 27 17:30:27 2022] POST /compute/v2.1/servers => generated 401 bytes in 750 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 17:30:27.992794 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-be25ab5f-82b6-496d-9597-5ca4f02a3338 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:30:27.994208 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-be25ab5f-82b6-496d-9597-5ca4f02a3338 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: 9cd2f537-78c4-4a00-95ab-4f7b115810cd] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:30:28.053713 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-be25ab5f-82b6-496d-9597-5ca4f02a3338 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b02c2ba9a0a48c294a11b42cbfe28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef13103d3d8b43e1882d4820c8d9247b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:28.063228 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-be25ab5f-82b6-496d-9597-5ca4f02a3338 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/9cd2f537-78c4-4a00-95ab-4f7b115810cd" status: 200 len: 1241 microversion: 2.1 time: 0.073298 Sep 27 17:30:28.074168 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 339/655] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:30:27 2022] GET /compute/v2.1/servers/9cd2f537-78c4-4a00-95ab-4f7b115810cd => generated 1241 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:30:28.898966 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-5ec155bb-e695-4ee8-9e46-0bfc0d737641 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:30:28.900216 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-5ec155bb-e695-4ee8-9e46-0bfc0d737641 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:30:28.906505 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5ec155bb-e695-4ee8-9e46-0bfc0d737641 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:28.906989 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5ec155bb-e695-4ee8-9e46-0bfc0d737641 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:28.907428 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5ec155bb-e695-4ee8-9e46-0bfc0d737641 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:28.908123 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5ec155bb-e695-4ee8-9e46-0bfc0d737641 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:28.908575 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5ec155bb-e695-4ee8-9e46-0bfc0d737641 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:28.908997 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5ec155bb-e695-4ee8-9e46-0bfc0d737641 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:29.044138 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-5ec155bb-e695-4ee8-9e46-0bfc0d737641 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:29.054082 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-5ec155bb-e695-4ee8-9e46-0bfc0d737641 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:29.055696 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-5ec155bb-e695-4ee8-9e46-0bfc0d737641 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:29.056893 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-5ec155bb-e695-4ee8-9e46-0bfc0d737641 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1807 microversion: 2.20 time: 0.162501 Sep 27 17:30:29.057443 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 317/656] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:30:28 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:30:29.096380 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-75e538a1-399f-447d-a8ca-cbfd01e264ad tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:30:29.097110 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-75e538a1-399f-447d-a8ca-cbfd01e264ad tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: 9cd2f537-78c4-4a00-95ab-4f7b115810cd] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:30:29.105381 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-75e538a1-399f-447d-a8ca-cbfd01e264ad tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:29.106495 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-75e538a1-399f-447d-a8ca-cbfd01e264ad tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:29.106823 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-75e538a1-399f-447d-a8ca-cbfd01e264ad tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:29.107709 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-75e538a1-399f-447d-a8ca-cbfd01e264ad tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:29.108166 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-75e538a1-399f-447d-a8ca-cbfd01e264ad tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:29.108595 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-75e538a1-399f-447d-a8ca-cbfd01e264ad tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:29.170154 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-75e538a1-399f-447d-a8ca-cbfd01e264ad tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b02c2ba9a0a48c294a11b42cbfe28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef13103d3d8b43e1882d4820c8d9247b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:29.178155 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-75e538a1-399f-447d-a8ca-cbfd01e264ad tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/9cd2f537-78c4-4a00-95ab-4f7b115810cd" status: 200 len: 1245 microversion: 2.1 time: 0.085851 Sep 27 17:30:29.178720 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 340/657] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:30:29 2022] GET /compute/v2.1/servers/9cd2f537-78c4-4a00-95ab-4f7b115810cd => generated 1245 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:30:30.084537 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-61012bdc-1673-4f30-ad98-5c550da4902c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:30:30.085134 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-61012bdc-1673-4f30-ad98-5c550da4902c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:30:30.093151 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-61012bdc-1673-4f30-ad98-5c550da4902c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:30.093996 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-61012bdc-1673-4f30-ad98-5c550da4902c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:30.094683 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-61012bdc-1673-4f30-ad98-5c550da4902c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:30.095357 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-61012bdc-1673-4f30-ad98-5c550da4902c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:30.095782 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-61012bdc-1673-4f30-ad98-5c550da4902c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:30.096207 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-61012bdc-1673-4f30-ad98-5c550da4902c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:30.202232 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-9e708acf-64a6-4b00-b4ed-23df8db68f4e tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:30:30.202851 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-9e708acf-64a6-4b00-b4ed-23df8db68f4e tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: 9cd2f537-78c4-4a00-95ab-4f7b115810cd] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:30:30.209073 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9e708acf-64a6-4b00-b4ed-23df8db68f4e tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:30.209562 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9e708acf-64a6-4b00-b4ed-23df8db68f4e tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:30.209995 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9e708acf-64a6-4b00-b4ed-23df8db68f4e tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:30.212553 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9e708acf-64a6-4b00-b4ed-23df8db68f4e tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:30.213236 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9e708acf-64a6-4b00-b4ed-23df8db68f4e tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:30.214296 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9e708acf-64a6-4b00-b4ed-23df8db68f4e tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:30.249178 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-61012bdc-1673-4f30-ad98-5c550da4902c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:30.261531 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-61012bdc-1673-4f30-ad98-5c550da4902c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:30.263303 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-61012bdc-1673-4f30-ad98-5c550da4902c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:30.265188 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-61012bdc-1673-4f30-ad98-5c550da4902c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1807 microversion: 2.20 time: 0.185174 Sep 27 17:30:30.275826 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 318/658] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:30:30 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1807 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:30:30.339825 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-9e708acf-64a6-4b00-b4ed-23df8db68f4e tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b02c2ba9a0a48c294a11b42cbfe28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef13103d3d8b43e1882d4820c8d9247b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:30.349369 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-9e708acf-64a6-4b00-b4ed-23df8db68f4e tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/9cd2f537-78c4-4a00-95ab-4f7b115810cd" status: 200 len: 1237 microversion: 2.1 time: 0.152053 Sep 27 17:30:30.349955 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 341/659] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:30:30 2022] GET /compute/v2.1/servers/9cd2f537-78c4-4a00-95ab-4f7b115810cd => generated 1237 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:30:31.293106 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-4c4df4ab-97a8-4ffd-bafc-a9265e0ba33a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:30:31.293712 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-4c4df4ab-97a8-4ffd-bafc-a9265e0ba33a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:30:31.300425 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4c4df4ab-97a8-4ffd-bafc-a9265e0ba33a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:31.300896 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4c4df4ab-97a8-4ffd-bafc-a9265e0ba33a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:31.301370 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4c4df4ab-97a8-4ffd-bafc-a9265e0ba33a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:31.302052 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4c4df4ab-97a8-4ffd-bafc-a9265e0ba33a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:31.302517 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4c4df4ab-97a8-4ffd-bafc-a9265e0ba33a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:31.302931 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4c4df4ab-97a8-4ffd-bafc-a9265e0ba33a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:31.306229 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:30:31.377217 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-d8143a64-9c96-4d82-a51b-778ff46105a0 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:30:31.377837 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-d8143a64-9c96-4d82-a51b-778ff46105a0 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: 9cd2f537-78c4-4a00-95ab-4f7b115810cd] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:30:31.379745 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:30:31.385992 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d8143a64-9c96-4d82-a51b-778ff46105a0 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:31.386654 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d8143a64-9c96-4d82-a51b-778ff46105a0 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:31.387282 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d8143a64-9c96-4d82-a51b-778ff46105a0 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:31.388666 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d8143a64-9c96-4d82-a51b-778ff46105a0 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:31.389143 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d8143a64-9c96-4d82-a51b-778ff46105a0 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:31.389610 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d8143a64-9c96-4d82-a51b-778ff46105a0 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:31.479127 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-d8143a64-9c96-4d82-a51b-778ff46105a0 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b02c2ba9a0a48c294a11b42cbfe28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef13103d3d8b43e1882d4820c8d9247b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:31.487572 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-d8143a64-9c96-4d82-a51b-778ff46105a0 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/9cd2f537-78c4-4a00-95ab-4f7b115810cd" status: 200 len: 1299 microversion: 2.1 time: 0.116854 Sep 27 17:30:31.489300 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 342/660] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:30:31 2022] GET /compute/v2.1/servers/9cd2f537-78c4-4a00-95ab-4f7b115810cd => generated 1299 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:30:31.561020 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-4c4df4ab-97a8-4ffd-bafc-a9265e0ba33a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:31.575344 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-4c4df4ab-97a8-4ffd-bafc-a9265e0ba33a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:31.577105 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-4c4df4ab-97a8-4ffd-bafc-a9265e0ba33a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:31.578573 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-4c4df4ab-97a8-4ffd-bafc-a9265e0ba33a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1807 microversion: 2.20 time: 0.290032 Sep 27 17:30:31.586760 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 319/661] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:30:31 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1807 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:30:32.511527 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-c285c5af-478a-4355-97e1-de2cc59366a4 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:30:32.512207 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-c285c5af-478a-4355-97e1-de2cc59366a4 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: 9cd2f537-78c4-4a00-95ab-4f7b115810cd] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:30:32.519363 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c285c5af-478a-4355-97e1-de2cc59366a4 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:32.519755 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c285c5af-478a-4355-97e1-de2cc59366a4 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:32.522133 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c285c5af-478a-4355-97e1-de2cc59366a4 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:32.523003 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c285c5af-478a-4355-97e1-de2cc59366a4 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:32.523468 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c285c5af-478a-4355-97e1-de2cc59366a4 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:32.523892 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c285c5af-478a-4355-97e1-de2cc59366a4 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:32.608557 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-d8ef8ccf-7811-43c4-a7b7-69178b02abbd tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:30:32.609858 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-d8ef8ccf-7811-43c4-a7b7-69178b02abbd tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:30:32.619408 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d8ef8ccf-7811-43c4-a7b7-69178b02abbd tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:32.620239 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d8ef8ccf-7811-43c4-a7b7-69178b02abbd tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:32.620892 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d8ef8ccf-7811-43c4-a7b7-69178b02abbd tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:32.621797 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d8ef8ccf-7811-43c4-a7b7-69178b02abbd tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:32.622483 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d8ef8ccf-7811-43c4-a7b7-69178b02abbd tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:32.623112 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d8ef8ccf-7811-43c4-a7b7-69178b02abbd tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:32.783317 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-c285c5af-478a-4355-97e1-de2cc59366a4 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b02c2ba9a0a48c294a11b42cbfe28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef13103d3d8b43e1882d4820c8d9247b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:32.792858 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-c285c5af-478a-4355-97e1-de2cc59366a4 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/9cd2f537-78c4-4a00-95ab-4f7b115810cd" status: 200 len: 1366 microversion: 2.1 time: 0.285160 Sep 27 17:30:32.793375 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 343/662] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:30:32 2022] GET /compute/v2.1/servers/9cd2f537-78c4-4a00-95ab-4f7b115810cd => generated 1366 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:30:32.863678 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-d8ef8ccf-7811-43c4-a7b7-69178b02abbd tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:32.876687 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-d8ef8ccf-7811-43c4-a7b7-69178b02abbd tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:32.878316 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-d8ef8ccf-7811-43c4-a7b7-69178b02abbd tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:32.880173 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-d8ef8ccf-7811-43c4-a7b7-69178b02abbd tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1807 microversion: 2.20 time: 0.275836 Sep 27 17:30:32.882336 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 320/663] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:30:32 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1807 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:30:33.027737 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [req-60c82b83-60f6-4b58-a350-f5cc4a800fbc req-c8b0ff63-97b0-45cb-b8ce-b7fb004c1b67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9cd2f537-78c4-4a00-95ab-4f7b115810cd", "tag": "a7cbab4a-ebf6-4274-83af-582db23d3344"}]} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:30:33.043807 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-60c82b83-60f6-4b58-a350-f5cc4a800fbc req-c8b0ff63-97b0-45cb-b8ce-b7fb004c1b67 service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:33.044301 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-60c82b83-60f6-4b58-a350-f5cc4a800fbc req-c8b0ff63-97b0-45cb-b8ce-b7fb004c1b67 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:33.044728 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-60c82b83-60f6-4b58-a350-f5cc4a800fbc req-c8b0ff63-97b0-45cb-b8ce-b7fb004c1b67 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:33.057375 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.compute.server_external_events [req-60c82b83-60f6-4b58-a350-f5cc4a800fbc req-c8b0ff63-97b0-45cb-b8ce-b7fb004c1b67 service nova] Creating event network-changed:a7cbab4a-ebf6-4274-83af-582db23d3344 for instance 9cd2f537-78c4-4a00-95ab-4f7b115810cd on hv-cinder-84914 Sep 27 17:30:33.063090 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [req-60c82b83-60f6-4b58-a350-f5cc4a800fbc req-c8b0ff63-97b0-45cb-b8ce-b7fb004c1b67 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139278 Sep 27 17:30:33.063980 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 344/664] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:30:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:30:33.815715 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-4118471c-70e6-4e8a-a42f-b08dc6e1e293 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:30:33.816484 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-4118471c-70e6-4e8a-a42f-b08dc6e1e293 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: 9cd2f537-78c4-4a00-95ab-4f7b115810cd] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:30:33.823231 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4118471c-70e6-4e8a-a42f-b08dc6e1e293 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:33.823713 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4118471c-70e6-4e8a-a42f-b08dc6e1e293 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:33.824139 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4118471c-70e6-4e8a-a42f-b08dc6e1e293 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:33.824817 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4118471c-70e6-4e8a-a42f-b08dc6e1e293 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:33.825258 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4118471c-70e6-4e8a-a42f-b08dc6e1e293 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:33.825697 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4118471c-70e6-4e8a-a42f-b08dc6e1e293 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:33.906833 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-012daad3-f1de-4dc8-ac61-b84254151ddb tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:30:33.907905 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-012daad3-f1de-4dc8-ac61-b84254151ddb tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:30:33.915502 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-012daad3-f1de-4dc8-ac61-b84254151ddb tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:33.916099 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-012daad3-f1de-4dc8-ac61-b84254151ddb tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:33.916529 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-012daad3-f1de-4dc8-ac61-b84254151ddb tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:33.917249 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-012daad3-f1de-4dc8-ac61-b84254151ddb tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:33.917818 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-012daad3-f1de-4dc8-ac61-b84254151ddb tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:33.918297 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-012daad3-f1de-4dc8-ac61-b84254151ddb tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:33.973723 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-4118471c-70e6-4e8a-a42f-b08dc6e1e293 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b02c2ba9a0a48c294a11b42cbfe28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef13103d3d8b43e1882d4820c8d9247b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:33.983687 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-4118471c-70e6-4e8a-a42f-b08dc6e1e293 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/9cd2f537-78c4-4a00-95ab-4f7b115810cd" status: 200 len: 1366 microversion: 2.1 time: 0.171776 Sep 27 17:30:33.984295 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 321/665] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:30:33 2022] GET /compute/v2.1/servers/9cd2f537-78c4-4a00-95ab-4f7b115810cd => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:30:34.066992 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-012daad3-f1de-4dc8-ac61-b84254151ddb tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:34.076148 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-012daad3-f1de-4dc8-ac61-b84254151ddb tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:34.077626 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-012daad3-f1de-4dc8-ac61-b84254151ddb tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:34.078852 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-012daad3-f1de-4dc8-ac61-b84254151ddb tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1807 microversion: 2.20 time: 0.176393 Sep 27 17:30:34.079395 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 345/666] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:30:33 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1807 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 17:30:34.919249 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [req-c33e394d-b09b-48c4-bcd0-df49ec98f05f req-22a6b931-05c0-498c-becb-ffbc14a58eef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d209f2ce-43c8-422a-a703-cdc9a9fb5cee", "name": "network-vif-plugged", "status": "completed", "tag": "5a5276d6-632d-4adb-a46b-8471fb0bf332"}]} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:30:34.929579 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-c33e394d-b09b-48c4-bcd0-df49ec98f05f req-22a6b931-05c0-498c-becb-ffbc14a58eef service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:34.930152 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-c33e394d-b09b-48c4-bcd0-df49ec98f05f req-22a6b931-05c0-498c-becb-ffbc14a58eef service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:34.930711 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-c33e394d-b09b-48c4-bcd0-df49ec98f05f req-22a6b931-05c0-498c-becb-ffbc14a58eef service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:34.945474 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.compute.server_external_events [req-c33e394d-b09b-48c4-bcd0-df49ec98f05f req-22a6b931-05c0-498c-becb-ffbc14a58eef service nova] Creating event network-vif-plugged:5a5276d6-632d-4adb-a46b-8471fb0bf332 for instance d209f2ce-43c8-422a-a703-cdc9a9fb5cee on hv-cinder-84914 Sep 27 17:30:34.951844 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [req-c33e394d-b09b-48c4-bcd0-df49ec98f05f req-22a6b931-05c0-498c-becb-ffbc14a58eef service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108876 Sep 27 17:30:34.952453 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 322/667] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:30:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:30:35.006691 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-e6b77746-5876-4eda-8b46-e2257d743e3a tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:30:35.007310 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-e6b77746-5876-4eda-8b46-e2257d743e3a tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: 9cd2f537-78c4-4a00-95ab-4f7b115810cd] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:30:35.013858 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e6b77746-5876-4eda-8b46-e2257d743e3a tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:35.014371 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e6b77746-5876-4eda-8b46-e2257d743e3a tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:35.014811 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e6b77746-5876-4eda-8b46-e2257d743e3a tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:35.015499 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e6b77746-5876-4eda-8b46-e2257d743e3a tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:35.015953 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e6b77746-5876-4eda-8b46-e2257d743e3a tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:35.016411 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e6b77746-5876-4eda-8b46-e2257d743e3a tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:35.119372 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-ccfdbab2-df30-42a3-ab09-449dcd8bc71e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:30:35.121453 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-ccfdbab2-df30-42a3-ab09-449dcd8bc71e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:30:35.129547 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ccfdbab2-df30-42a3-ab09-449dcd8bc71e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:35.130467 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ccfdbab2-df30-42a3-ab09-449dcd8bc71e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:35.130943 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ccfdbab2-df30-42a3-ab09-449dcd8bc71e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:35.131662 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ccfdbab2-df30-42a3-ab09-449dcd8bc71e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:35.132122 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ccfdbab2-df30-42a3-ab09-449dcd8bc71e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:35.132549 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ccfdbab2-df30-42a3-ab09-449dcd8bc71e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:35.456976 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-e6b77746-5876-4eda-8b46-e2257d743e3a tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b02c2ba9a0a48c294a11b42cbfe28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef13103d3d8b43e1882d4820c8d9247b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:35.459989 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-ccfdbab2-df30-42a3-ab09-449dcd8bc71e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:35.469318 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-ccfdbab2-df30-42a3-ab09-449dcd8bc71e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:35.470815 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-ccfdbab2-df30-42a3-ab09-449dcd8bc71e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:35.471817 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-e6b77746-5876-4eda-8b46-e2257d743e3a tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/9cd2f537-78c4-4a00-95ab-4f7b115810cd" status: 200 len: 1366 microversion: 2.1 time: 0.468948 Sep 27 17:30:35.472102 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-ccfdbab2-df30-42a3-ab09-449dcd8bc71e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1807 microversion: 2.20 time: 0.363775 Sep 27 17:30:35.487996 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 346/668] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:30:35 2022] GET /compute/v2.1/servers/9cd2f537-78c4-4a00-95ab-4f7b115810cd => generated 1366 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:30:35.488139 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 323/669] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:30:35 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1807 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:30:36.495755 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-87703255-d740-4196-87f2-e1bc60a6b0c0 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:30:36.496365 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-87703255-d740-4196-87f2-e1bc60a6b0c0 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: 9cd2f537-78c4-4a00-95ab-4f7b115810cd] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:30:36.496695 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-abc998c2-a12f-4483-84f4-d8ebce8daca3 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:30:36.497346 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-abc998c2-a12f-4483-84f4-d8ebce8daca3 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:30:36.502651 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-87703255-d740-4196-87f2-e1bc60a6b0c0 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:36.503169 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-87703255-d740-4196-87f2-e1bc60a6b0c0 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:36.503603 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-87703255-d740-4196-87f2-e1bc60a6b0c0 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:36.503709 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-abc998c2-a12f-4483-84f4-d8ebce8daca3 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:36.504155 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-abc998c2-a12f-4483-84f4-d8ebce8daca3 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:36.504296 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-87703255-d740-4196-87f2-e1bc60a6b0c0 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:36.504591 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-abc998c2-a12f-4483-84f4-d8ebce8daca3 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:36.504749 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-87703255-d740-4196-87f2-e1bc60a6b0c0 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:36.505172 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-87703255-d740-4196-87f2-e1bc60a6b0c0 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:36.505269 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-abc998c2-a12f-4483-84f4-d8ebce8daca3 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:36.505715 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-abc998c2-a12f-4483-84f4-d8ebce8daca3 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:36.506174 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-abc998c2-a12f-4483-84f4-d8ebce8daca3 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:36.525473 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_cell1:SELECT=100 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:30:36.699367 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-abc998c2-a12f-4483-84f4-d8ebce8daca3 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:36.703609 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-87703255-d740-4196-87f2-e1bc60a6b0c0 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b02c2ba9a0a48c294a11b42cbfe28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef13103d3d8b43e1882d4820c8d9247b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:36.708072 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-abc998c2-a12f-4483-84f4-d8ebce8daca3 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:36.709531 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-abc998c2-a12f-4483-84f4-d8ebce8daca3 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:36.710724 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-abc998c2-a12f-4483-84f4-d8ebce8daca3 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1807 microversion: 2.20 time: 0.217931 Sep 27 17:30:36.711147 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-87703255-d740-4196-87f2-e1bc60a6b0c0 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/9cd2f537-78c4-4a00-95ab-4f7b115810cd" status: 200 len: 1366 microversion: 2.1 time: 0.219294 Sep 27 17:30:36.712136 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 324/670] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:30:36 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1807 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 17:30:36.712339 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 347/671] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:30:36 2022] GET /compute/v2.1/servers/9cd2f537-78c4-4a00-95ab-4f7b115810cd => generated 1366 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:30:37.735750 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-ab3b1f44-c043-49a2-bbee-5a2bc7c714bb tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:30:37.736369 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-ab3b1f44-c043-49a2-bbee-5a2bc7c714bb tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: 9cd2f537-78c4-4a00-95ab-4f7b115810cd] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:30:37.747590 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-6378827f-de63-4e21-b228-9825bdd0b7c2 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:30:37.747590 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-6378827f-de63-4e21-b228-9825bdd0b7c2 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:30:37.748075 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ab3b1f44-c043-49a2-bbee-5a2bc7c714bb tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:37.748075 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ab3b1f44-c043-49a2-bbee-5a2bc7c714bb tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:37.748075 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ab3b1f44-c043-49a2-bbee-5a2bc7c714bb tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:37.748075 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ab3b1f44-c043-49a2-bbee-5a2bc7c714bb tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:37.748373 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ab3b1f44-c043-49a2-bbee-5a2bc7c714bb tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:37.748373 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ab3b1f44-c043-49a2-bbee-5a2bc7c714bb tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:37.751832 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6378827f-de63-4e21-b228-9825bdd0b7c2 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:37.752315 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6378827f-de63-4e21-b228-9825bdd0b7c2 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:37.752746 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6378827f-de63-4e21-b228-9825bdd0b7c2 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:37.753470 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6378827f-de63-4e21-b228-9825bdd0b7c2 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:37.753925 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6378827f-de63-4e21-b228-9825bdd0b7c2 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:37.754406 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6378827f-de63-4e21-b228-9825bdd0b7c2 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:37.896650 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell0:SELECT=2 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:30:37.919866 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell0:SELECT=10 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:30:37.935672 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-ab3b1f44-c043-49a2-bbee-5a2bc7c714bb tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b02c2ba9a0a48c294a11b42cbfe28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef13103d3d8b43e1882d4820c8d9247b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:37.943497 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-ab3b1f44-c043-49a2-bbee-5a2bc7c714bb tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/9cd2f537-78c4-4a00-95ab-4f7b115810cd" status: 200 len: 1366 microversion: 2.1 time: 0.212558 Sep 27 17:30:37.944083 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 325/672] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:30:37 2022] GET /compute/v2.1/servers/9cd2f537-78c4-4a00-95ab-4f7b115810cd => generated 1366 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:30:37.944322 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-6378827f-de63-4e21-b228-9825bdd0b7c2 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:37.958904 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-6378827f-de63-4e21-b228-9825bdd0b7c2 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:37.960261 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-6378827f-de63-4e21-b228-9825bdd0b7c2 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:37.961971 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-6378827f-de63-4e21-b228-9825bdd0b7c2 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1807 microversion: 2.20 time: 0.228577 Sep 27 17:30:37.962555 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 348/673] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:30:37 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1807 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:30:38.968077 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-9dad37f6-0fcc-4998-a1a6-5e5a287d0c8f tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:30:38.968670 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-9dad37f6-0fcc-4998-a1a6-5e5a287d0c8f tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: 9cd2f537-78c4-4a00-95ab-4f7b115810cd] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:30:38.975097 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9dad37f6-0fcc-4998-a1a6-5e5a287d0c8f tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:38.975577 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9dad37f6-0fcc-4998-a1a6-5e5a287d0c8f tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:38.976008 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9dad37f6-0fcc-4998-a1a6-5e5a287d0c8f tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:38.976696 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9dad37f6-0fcc-4998-a1a6-5e5a287d0c8f tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:38.977644 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9dad37f6-0fcc-4998-a1a6-5e5a287d0c8f tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:38.978065 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9dad37f6-0fcc-4998-a1a6-5e5a287d0c8f tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:38.988122 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-8689ec3b-1e85-4b4b-a34d-7e0d92b0a2c1 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:30:38.988725 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-8689ec3b-1e85-4b4b-a34d-7e0d92b0a2c1 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:30:38.990570 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_cell0:SELECT=2 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:30:38.996535 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8689ec3b-1e85-4b4b-a34d-7e0d92b0a2c1 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:38.997013 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8689ec3b-1e85-4b4b-a34d-7e0d92b0a2c1 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:38.997438 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8689ec3b-1e85-4b4b-a34d-7e0d92b0a2c1 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:38.998145 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8689ec3b-1e85-4b4b-a34d-7e0d92b0a2c1 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:38.998591 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8689ec3b-1e85-4b4b-a34d-7e0d92b0a2c1 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:38.999003 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8689ec3b-1e85-4b4b-a34d-7e0d92b0a2c1 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:39.172835 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-9dad37f6-0fcc-4998-a1a6-5e5a287d0c8f tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b02c2ba9a0a48c294a11b42cbfe28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef13103d3d8b43e1882d4820c8d9247b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:39.180492 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-9dad37f6-0fcc-4998-a1a6-5e5a287d0c8f tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/9cd2f537-78c4-4a00-95ab-4f7b115810cd" status: 200 len: 1366 microversion: 2.1 time: 0.216241 Sep 27 17:30:39.186642 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 326/674] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:30:38 2022] GET /compute/v2.1/servers/9cd2f537-78c4-4a00-95ab-4f7b115810cd => generated 1366 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:30:39.186829 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-8689ec3b-1e85-4b4b-a34d-7e0d92b0a2c1 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:39.193284 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-8689ec3b-1e85-4b4b-a34d-7e0d92b0a2c1 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:39.194781 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-8689ec3b-1e85-4b4b-a34d-7e0d92b0a2c1 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:39.195937 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-8689ec3b-1e85-4b4b-a34d-7e0d92b0a2c1 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1807 microversion: 2.20 time: 0.211751 Sep 27 17:30:39.196473 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 349/675] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:30:38 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1807 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 17:30:40.204524 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-cceb2d8d-822d-41b2-920d-d5de352f8283 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:30:40.205076 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-cceb2d8d-822d-41b2-920d-d5de352f8283 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: 9cd2f537-78c4-4a00-95ab-4f7b115810cd] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:30:40.212826 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cceb2d8d-822d-41b2-920d-d5de352f8283 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:40.213696 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cceb2d8d-822d-41b2-920d-d5de352f8283 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:40.214512 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cceb2d8d-822d-41b2-920d-d5de352f8283 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:40.215766 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cceb2d8d-822d-41b2-920d-d5de352f8283 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:40.216556 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cceb2d8d-822d-41b2-920d-d5de352f8283 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:40.216990 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cceb2d8d-822d-41b2-920d-d5de352f8283 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:40.223463 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-f2ded829-78cb-459d-b184-449b6fd2e1ad tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:30:40.224081 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-f2ded829-78cb-459d-b184-449b6fd2e1ad tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:30:40.230788 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f2ded829-78cb-459d-b184-449b6fd2e1ad tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:40.232100 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f2ded829-78cb-459d-b184-449b6fd2e1ad tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:40.232100 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f2ded829-78cb-459d-b184-449b6fd2e1ad tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:40.232796 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f2ded829-78cb-459d-b184-449b6fd2e1ad tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:40.233255 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f2ded829-78cb-459d-b184-449b6fd2e1ad tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:40.233682 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f2ded829-78cb-459d-b184-449b6fd2e1ad tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:40.416139 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-cceb2d8d-822d-41b2-920d-d5de352f8283 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b02c2ba9a0a48c294a11b42cbfe28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef13103d3d8b43e1882d4820c8d9247b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:40.422679 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-f2ded829-78cb-459d-b184-449b6fd2e1ad tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:40.424258 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-cceb2d8d-822d-41b2-920d-d5de352f8283 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/9cd2f537-78c4-4a00-95ab-4f7b115810cd" status: 200 len: 1366 microversion: 2.1 time: 0.223694 Sep 27 17:30:40.424839 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 327/676] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:30:40 2022] GET /compute/v2.1/servers/9cd2f537-78c4-4a00-95ab-4f7b115810cd => generated 1366 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:30:40.431831 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-f2ded829-78cb-459d-b184-449b6fd2e1ad tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:40.433523 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-f2ded829-78cb-459d-b184-449b6fd2e1ad tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:40.434703 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-f2ded829-78cb-459d-b184-449b6fd2e1ad tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1807 microversion: 2.20 time: 0.217389 Sep 27 17:30:40.435239 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 350/677] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:30:40 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1807 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:30:41.443078 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [req-7a008efa-a1f5-4646-9c0c-3a28fd500022 req-f5e0c72c-77e2-4d3c-992a-c3eb706e1746 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cd2f537-78c4-4a00-95ab-4f7b115810cd", "name": "network-vif-plugged", "status": "completed", "tag": "a7cbab4a-ebf6-4274-83af-582db23d3344"}]} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:30:41.446969 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-a386a69d-8099-4d61-9aa6-254629092e0f tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:30:41.449566 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-a386a69d-8099-4d61-9aa6-254629092e0f tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:30:41.457657 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-7a008efa-a1f5-4646-9c0c-3a28fd500022 req-f5e0c72c-77e2-4d3c-992a-c3eb706e1746 service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:41.457836 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a386a69d-8099-4d61-9aa6-254629092e0f tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:41.458171 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-7a008efa-a1f5-4646-9c0c-3a28fd500022 req-f5e0c72c-77e2-4d3c-992a-c3eb706e1746 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:41.458287 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a386a69d-8099-4d61-9aa6-254629092e0f tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:41.458608 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-7a008efa-a1f5-4646-9c0c-3a28fd500022 req-f5e0c72c-77e2-4d3c-992a-c3eb706e1746 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:41.458720 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a386a69d-8099-4d61-9aa6-254629092e0f tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:41.459457 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a386a69d-8099-4d61-9aa6-254629092e0f tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:41.459922 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a386a69d-8099-4d61-9aa6-254629092e0f tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:41.460499 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a386a69d-8099-4d61-9aa6-254629092e0f tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:41.470283 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.compute.server_external_events [req-7a008efa-a1f5-4646-9c0c-3a28fd500022 req-f5e0c72c-77e2-4d3c-992a-c3eb706e1746 service nova] Creating event network-vif-plugged:a7cbab4a-ebf6-4274-83af-582db23d3344 for instance 9cd2f537-78c4-4a00-95ab-4f7b115810cd on hv-cinder-84914 Sep 27 17:30:41.475867 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [req-7a008efa-a1f5-4646-9c0c-3a28fd500022 req-f5e0c72c-77e2-4d3c-992a-c3eb706e1746 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037029 Sep 27 17:30:41.477256 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 328/678] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:30:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:30:41.483997 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-4471b310-5e22-446c-8cb0-874436b06bb8 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:30:41.484854 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-4471b310-5e22-446c-8cb0-874436b06bb8 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: 9cd2f537-78c4-4a00-95ab-4f7b115810cd] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:30:41.494179 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4471b310-5e22-446c-8cb0-874436b06bb8 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:41.494881 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4471b310-5e22-446c-8cb0-874436b06bb8 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:41.495846 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4471b310-5e22-446c-8cb0-874436b06bb8 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:41.496745 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4471b310-5e22-446c-8cb0-874436b06bb8 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:41.497407 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4471b310-5e22-446c-8cb0-874436b06bb8 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:41.497988 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4471b310-5e22-446c-8cb0-874436b06bb8 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:41.553062 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-a386a69d-8099-4d61-9aa6-254629092e0f tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "POST /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b/action" status: 202 len: 0 microversion: 2.1 time: 0.110710 Sep 27 17:30:41.553702 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 351/679] 10.222.0.55 () {60 vars in 1278 bytes} [Tue Sep 27 17:30:41 2022] POST /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 27 17:30:41.560222 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-9aa04655-972b-4bfc-897d-784c9271c02f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:30:41.560921 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-9aa04655-972b-4bfc-897d-784c9271c02f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:30:41.568603 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9aa04655-972b-4bfc-897d-784c9271c02f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:41.569131 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9aa04655-972b-4bfc-897d-784c9271c02f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:41.569567 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9aa04655-972b-4bfc-897d-784c9271c02f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:41.570315 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9aa04655-972b-4bfc-897d-784c9271c02f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:41.571429 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9aa04655-972b-4bfc-897d-784c9271c02f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:41.571897 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9aa04655-972b-4bfc-897d-784c9271c02f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:41.747414 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-4471b310-5e22-446c-8cb0-874436b06bb8 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b02c2ba9a0a48c294a11b42cbfe28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef13103d3d8b43e1882d4820c8d9247b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:41.755464 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-4471b310-5e22-446c-8cb0-874436b06bb8 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/9cd2f537-78c4-4a00-95ab-4f7b115810cd" status: 200 len: 1366 microversion: 2.1 time: 0.276399 Sep 27 17:30:41.756135 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 329/680] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:30:41 2022] GET /compute/v2.1/servers/9cd2f537-78c4-4a00-95ab-4f7b115810cd => generated 1366 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:30:41.770169 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-f42a1112-aa0d-4be5-9bfa-334db6a4c290 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:30:41.770169 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-f42a1112-aa0d-4be5-9bfa-334db6a4c290 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:30:41.770169 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f42a1112-aa0d-4be5-9bfa-334db6a4c290 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:41.770169 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f42a1112-aa0d-4be5-9bfa-334db6a4c290 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:41.770603 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f42a1112-aa0d-4be5-9bfa-334db6a4c290 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:41.770603 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f42a1112-aa0d-4be5-9bfa-334db6a4c290 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:41.770603 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f42a1112-aa0d-4be5-9bfa-334db6a4c290 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:41.770603 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f42a1112-aa0d-4be5-9bfa-334db6a4c290 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:41.797343 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-9aa04655-972b-4bfc-897d-784c9271c02f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:41.806724 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-9aa04655-972b-4bfc-897d-784c9271c02f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:41.808181 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-9aa04655-972b-4bfc-897d-784c9271c02f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:41.809354 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-9aa04655-972b-4bfc-897d-784c9271c02f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1807 microversion: 2.20 time: 0.254275 Sep 27 17:30:41.809907 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 352/681] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:30:41 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1807 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:30:41.957844 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-f42a1112-aa0d-4be5-9bfa-334db6a4c290 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acafe7ed414c87a5ca235b96047aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf4e20a59f147afb4f036fc8d04adb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:41.967127 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-f42a1112-aa0d-4be5-9bfa-334db6a4c290 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b" status: 200 len: 1750 microversion: 2.1 time: 0.209947 Sep 27 17:30:41.967781 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 330/682] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:30:41 2022] GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b => generated 1750 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:30:42.068677 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-0b79f5a4-b1a8-464d-82df-9130f34a5cf5 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1824960641", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2033463902", "security_groups": [{"name": "tempest-secgroup-smoke-981048707"}], "block_device_mapping_v2": [{"uuid": "1393a372-ee60-4254-8d8a-e6ccbba596dd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e7d51347-695f-4b89-ba87-954fe70eed97"}]}} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:30:42.188974 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.network.neutron [None req-0b79f5a4-b1a8-464d-82df-9130f34a5cf5 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] validate_networks() for [('e7d51347-695f-4b89-ba87-954fe70eed97', None, None, None, None, None)] {{(pid=120416) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 17:30:42.573650 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.virt.hardware [None req-0b79f5a4-b1a8-464d-82df-9130f34a5cf5 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Flavor limits 0:0:0 {{(pid=120416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 17:30:42.574237 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.virt.hardware [None req-0b79f5a4-b1a8-464d-82df-9130f34a5cf5 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Image limits 0:0:0 {{(pid=120416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 17:30:42.574981 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.virt.hardware [None req-0b79f5a4-b1a8-464d-82df-9130f34a5cf5 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Flavor pref 0:0:0 {{(pid=120416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 17:30:42.575080 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.virt.hardware [None req-0b79f5a4-b1a8-464d-82df-9130f34a5cf5 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Image pref 0:0:0 {{(pid=120416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 17:30:42.575474 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.virt.hardware [None req-0b79f5a4-b1a8-464d-82df-9130f34a5cf5 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 17:30:42.584437 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-0b79f5a4-b1a8-464d-82df-9130f34a5cf5 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:42.584913 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-0b79f5a4-b1a8-464d-82df-9130f34a5cf5 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:42.585336 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-0b79f5a4-b1a8-464d-82df-9130f34a5cf5 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:42.586173 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-0b79f5a4-b1a8-464d-82df-9130f34a5cf5 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:42.586540 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-0b79f5a4-b1a8-464d-82df-9130f34a5cf5 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:42.586957 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-0b79f5a4-b1a8-464d-82df-9130f34a5cf5 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:42.603917 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.quota [None req-0b79f5a4-b1a8-464d-82df-9130f34a5cf5 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Getting quotas for project f4db1a85e2504cb9956a6461b5072aa3. Resources: {'cores', 'ram', 'instances'} {{(pid=120416) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 17:30:42.608171 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.quota [None req-0b79f5a4-b1a8-464d-82df-9130f34a5cf5 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Getting quotas for user cac1528c35fb464db00b5d18396b8eac and project f4db1a85e2504cb9956a6461b5072aa3. Resources: {'cores', 'ram', 'instances'} {{(pid=120416) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 17:30:42.668510 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-0b79f5a4-b1a8-464d-82df-9130f34a5cf5 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Going to run 1 instances... {{(pid=120416) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 17:30:42.670660 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-0b79f5a4-b1a8-464d-82df-9130f34a5cf5 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] [instance: 40e2eab1-2d75-4ad4-9e7b-da70094ed345] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1393a372-ee60-4254-8d8a-e6ccbba596dd',volume_size=None,volume_type=None)] {{(pid=120416) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 17:30:42.780015 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-7fc44047-6dd7-432d-9122-802dbab0afd8 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:30:42.780606 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-7fc44047-6dd7-432d-9122-802dbab0afd8 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: 9cd2f537-78c4-4a00-95ab-4f7b115810cd] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:30:42.787587 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7fc44047-6dd7-432d-9122-802dbab0afd8 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:42.788136 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7fc44047-6dd7-432d-9122-802dbab0afd8 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:42.788533 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7fc44047-6dd7-432d-9122-802dbab0afd8 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:42.789715 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7fc44047-6dd7-432d-9122-802dbab0afd8 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:42.790362 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7fc44047-6dd7-432d-9122-802dbab0afd8 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:42.790778 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7fc44047-6dd7-432d-9122-802dbab0afd8 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:42.821681 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-0b79f5a4-b1a8-464d-82df-9130f34a5cf5 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.756700 Sep 27 17:30:42.822745 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 353/683] 10.222.0.55 () {60 vars in 1147 bytes} [Tue Sep 27 17:30:42 2022] POST /compute/v2.1/servers => generated 405 bytes in 758 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 27 17:30:42.833660 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-ffab00d0-25dc-46b8-8f6b-04be19b6682b tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:30:42.834306 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-ffab00d0-25dc-46b8-8f6b-04be19b6682b tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] [instance: 40e2eab1-2d75-4ad4-9e7b-da70094ed345] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:30:42.915002 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-ffab00d0-25dc-46b8-8f6b-04be19b6682b tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac1528c35fb464db00b5d18396b8eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4db1a85e2504cb9956a6461b5072aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:42.923515 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-ffab00d0-25dc-46b8-8f6b-04be19b6682b tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] 10.222.0.55 "GET /compute/v2.1/servers/40e2eab1-2d75-4ad4-9e7b-da70094ed345" status: 200 len: 1095 microversion: 2.1 time: 0.093914 Sep 27 17:30:42.925254 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 354/684] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:30:42 2022] GET /compute/v2.1/servers/40e2eab1-2d75-4ad4-9e7b-da70094ed345 => generated 1095 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:30:42.930539 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-83966837-e062-4f7d-b4c6-8dead263d1c5 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:30:42.931430 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-83966837-e062-4f7d-b4c6-8dead263d1c5 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:30:42.943320 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-83966837-e062-4f7d-b4c6-8dead263d1c5 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:42.944260 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-83966837-e062-4f7d-b4c6-8dead263d1c5 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:42.946188 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-83966837-e062-4f7d-b4c6-8dead263d1c5 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:42.948030 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-83966837-e062-4f7d-b4c6-8dead263d1c5 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:42.948665 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-83966837-e062-4f7d-b4c6-8dead263d1c5 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:42.949307 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-83966837-e062-4f7d-b4c6-8dead263d1c5 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:42.997038 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-7fc44047-6dd7-432d-9122-802dbab0afd8 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b02c2ba9a0a48c294a11b42cbfe28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef13103d3d8b43e1882d4820c8d9247b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:43.005607 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-7fc44047-6dd7-432d-9122-802dbab0afd8 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/9cd2f537-78c4-4a00-95ab-4f7b115810cd" status: 200 len: 1366 microversion: 2.1 time: 0.229365 Sep 27 17:30:43.006339 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 331/685] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:30:42 2022] GET /compute/v2.1/servers/9cd2f537-78c4-4a00-95ab-4f7b115810cd => generated 1366 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:30:43.011447 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-9d701aad-53e4-428e-acda-02e53657082d tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:30:43.012178 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-9d701aad-53e4-428e-acda-02e53657082d tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:30:43.035407 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9d701aad-53e4-428e-acda-02e53657082d tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:43.036767 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9d701aad-53e4-428e-acda-02e53657082d tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:43.037207 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9d701aad-53e4-428e-acda-02e53657082d tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:43.038200 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9d701aad-53e4-428e-acda-02e53657082d tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:43.039469 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9d701aad-53e4-428e-acda-02e53657082d tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:43.039896 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9d701aad-53e4-428e-acda-02e53657082d tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:43.153089 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-83966837-e062-4f7d-b4c6-8dead263d1c5 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:43.162915 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-83966837-e062-4f7d-b4c6-8dead263d1c5 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:43.165185 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-83966837-e062-4f7d-b4c6-8dead263d1c5 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:43.166386 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-83966837-e062-4f7d-b4c6-8dead263d1c5 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1807 microversion: 2.20 time: 0.239577 Sep 27 17:30:43.167238 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 355/686] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:30:42 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1807 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:30:43.212816 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-9d701aad-53e4-428e-acda-02e53657082d tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acafe7ed414c87a5ca235b96047aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf4e20a59f147afb4f036fc8d04adb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:43.220987 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-9d701aad-53e4-428e-acda-02e53657082d tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b" status: 200 len: 1750 microversion: 2.1 time: 0.213554 Sep 27 17:30:43.221528 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 332/687] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:30:43 2022] GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b => generated 1750 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:30:43.946767 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-1f8bfb1e-03b1-4859-9c29-428099f43264 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:30:43.947419 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-1f8bfb1e-03b1-4859-9c29-428099f43264 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] [instance: 40e2eab1-2d75-4ad4-9e7b-da70094ed345] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:30:43.953758 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1f8bfb1e-03b1-4859-9c29-428099f43264 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:43.954263 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1f8bfb1e-03b1-4859-9c29-428099f43264 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:43.954690 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1f8bfb1e-03b1-4859-9c29-428099f43264 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:43.955370 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1f8bfb1e-03b1-4859-9c29-428099f43264 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:43.955815 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1f8bfb1e-03b1-4859-9c29-428099f43264 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:43.956227 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1f8bfb1e-03b1-4859-9c29-428099f43264 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:44.020002 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-1f8bfb1e-03b1-4859-9c29-428099f43264 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac1528c35fb464db00b5d18396b8eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4db1a85e2504cb9956a6461b5072aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:44.029755 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-79b4fb64-cfcb-440d-a1b7-fa5235a52215 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:30:44.030393 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-79b4fb64-cfcb-440d-a1b7-fa5235a52215 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: 9cd2f537-78c4-4a00-95ab-4f7b115810cd] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:30:44.038495 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-1f8bfb1e-03b1-4859-9c29-428099f43264 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] 10.222.0.55 "GET /compute/v2.1/servers/40e2eab1-2d75-4ad4-9e7b-da70094ed345" status: 200 len: 1137 microversion: 2.1 time: 0.095463 Sep 27 17:30:44.038729 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-79b4fb64-cfcb-440d-a1b7-fa5235a52215 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:44.039260 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-79b4fb64-cfcb-440d-a1b7-fa5235a52215 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:44.039708 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-79b4fb64-cfcb-440d-a1b7-fa5235a52215 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:44.040414 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-79b4fb64-cfcb-440d-a1b7-fa5235a52215 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:44.040872 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-79b4fb64-cfcb-440d-a1b7-fa5235a52215 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:44.041303 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-79b4fb64-cfcb-440d-a1b7-fa5235a52215 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:44.053647 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 356/688] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:30:43 2022] GET /compute/v2.1/servers/40e2eab1-2d75-4ad4-9e7b-da70094ed345 => generated 1137 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:30:44.180163 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-79b4fb64-cfcb-440d-a1b7-fa5235a52215 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b02c2ba9a0a48c294a11b42cbfe28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef13103d3d8b43e1882d4820c8d9247b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:44.187800 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-79b4fb64-cfcb-440d-a1b7-fa5235a52215 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/9cd2f537-78c4-4a00-95ab-4f7b115810cd" status: 200 len: 1366 microversion: 2.1 time: 0.162155 Sep 27 17:30:44.188369 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 333/689] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:30:44 2022] GET /compute/v2.1/servers/9cd2f537-78c4-4a00-95ab-4f7b115810cd => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:30:44.192915 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-578982b2-7df6-4f17-9bbf-dcc983f9d359 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:30:44.193588 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-578982b2-7df6-4f17-9bbf-dcc983f9d359 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:30:44.200253 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-578982b2-7df6-4f17-9bbf-dcc983f9d359 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:44.200735 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-578982b2-7df6-4f17-9bbf-dcc983f9d359 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:44.201167 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-578982b2-7df6-4f17-9bbf-dcc983f9d359 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:44.201854 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-578982b2-7df6-4f17-9bbf-dcc983f9d359 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:44.202334 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-578982b2-7df6-4f17-9bbf-dcc983f9d359 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:44.202790 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-578982b2-7df6-4f17-9bbf-dcc983f9d359 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:44.244707 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-f76468e8-379a-4793-a8dd-77b50f69e84b tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:30:44.245325 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-f76468e8-379a-4793-a8dd-77b50f69e84b tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:30:44.251141 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f76468e8-379a-4793-a8dd-77b50f69e84b tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:44.251626 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f76468e8-379a-4793-a8dd-77b50f69e84b tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:44.252068 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f76468e8-379a-4793-a8dd-77b50f69e84b tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:44.252768 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f76468e8-379a-4793-a8dd-77b50f69e84b tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:44.253209 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f76468e8-379a-4793-a8dd-77b50f69e84b tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:44.253630 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f76468e8-379a-4793-a8dd-77b50f69e84b tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:44.382868 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-578982b2-7df6-4f17-9bbf-dcc983f9d359 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:44.392286 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-578982b2-7df6-4f17-9bbf-dcc983f9d359 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:44.393872 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-578982b2-7df6-4f17-9bbf-dcc983f9d359 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:44.395078 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-578982b2-7df6-4f17-9bbf-dcc983f9d359 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1794 microversion: 2.20 time: 0.206544 Sep 27 17:30:44.395634 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 357/690] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:30:44 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1794 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 17:30:44.425594 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-f76468e8-379a-4793-a8dd-77b50f69e84b tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acafe7ed414c87a5ca235b96047aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf4e20a59f147afb4f036fc8d04adb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:44.434250 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-f76468e8-379a-4793-a8dd-77b50f69e84b tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b" status: 200 len: 1750 microversion: 2.1 time: 0.193424 Sep 27 17:30:44.434813 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 334/691] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:30:44 2022] GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b => generated 1750 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:30:45.061487 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-03f33de7-2b1a-406b-bc5e-18495f31f58e tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:30:45.062229 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-03f33de7-2b1a-406b-bc5e-18495f31f58e tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] [instance: 40e2eab1-2d75-4ad4-9e7b-da70094ed345] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:30:45.069123 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-03f33de7-2b1a-406b-bc5e-18495f31f58e tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:45.069601 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-03f33de7-2b1a-406b-bc5e-18495f31f58e tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:45.070026 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-03f33de7-2b1a-406b-bc5e-18495f31f58e tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:45.070852 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-03f33de7-2b1a-406b-bc5e-18495f31f58e tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:45.071364 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-03f33de7-2b1a-406b-bc5e-18495f31f58e tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:45.071790 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-03f33de7-2b1a-406b-bc5e-18495f31f58e tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:45.134990 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-03f33de7-2b1a-406b-bc5e-18495f31f58e tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac1528c35fb464db00b5d18396b8eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4db1a85e2504cb9956a6461b5072aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:45.145584 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-03f33de7-2b1a-406b-bc5e-18495f31f58e tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] 10.222.0.55 "GET /compute/v2.1/servers/40e2eab1-2d75-4ad4-9e7b-da70094ed345" status: 200 len: 1193 microversion: 2.1 time: 0.087885 Sep 27 17:30:45.146171 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 358/692] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:30:45 2022] GET /compute/v2.1/servers/40e2eab1-2d75-4ad4-9e7b-da70094ed345 => generated 1193 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:30:45.210930 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-19c6c957-38ff-42e5-8ed2-891009a80653 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:30:45.212031 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-19c6c957-38ff-42e5-8ed2-891009a80653 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: 9cd2f537-78c4-4a00-95ab-4f7b115810cd] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:30:45.218503 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-19c6c957-38ff-42e5-8ed2-891009a80653 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:45.219102 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-19c6c957-38ff-42e5-8ed2-891009a80653 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:45.219538 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-19c6c957-38ff-42e5-8ed2-891009a80653 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:45.220275 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-19c6c957-38ff-42e5-8ed2-891009a80653 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:45.220721 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-19c6c957-38ff-42e5-8ed2-891009a80653 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:45.221240 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-19c6c957-38ff-42e5-8ed2-891009a80653 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:45.353629 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-19c6c957-38ff-42e5-8ed2-891009a80653 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b02c2ba9a0a48c294a11b42cbfe28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef13103d3d8b43e1882d4820c8d9247b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:45.361846 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-19c6c957-38ff-42e5-8ed2-891009a80653 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/9cd2f537-78c4-4a00-95ab-4f7b115810cd" status: 200 len: 1556 microversion: 2.1 time: 0.154696 Sep 27 17:30:45.362447 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 335/693] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:30:45 2022] GET /compute/v2.1/servers/9cd2f537-78c4-4a00-95ab-4f7b115810cd => generated 1556 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:30:45.385286 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-80f8f659-d768-4763-b2ba-3aa597ed1fd2 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:30:45.385715 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-80f8f659-d768-4763-b2ba-3aa597ed1fd2 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: 9cd2f537-78c4-4a00-95ab-4f7b115810cd] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:30:45.391759 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-80f8f659-d768-4763-b2ba-3aa597ed1fd2 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:45.392239 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-80f8f659-d768-4763-b2ba-3aa597ed1fd2 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:45.392672 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-80f8f659-d768-4763-b2ba-3aa597ed1fd2 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:45.393362 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-80f8f659-d768-4763-b2ba-3aa597ed1fd2 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:45.393817 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-80f8f659-d768-4763-b2ba-3aa597ed1fd2 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:45.394278 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-80f8f659-d768-4763-b2ba-3aa597ed1fd2 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:45.460364 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-63ee7f65-24f9-4b7b-aa1b-f8a9cd96890b tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:30:45.461861 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-63ee7f65-24f9-4b7b-aa1b-f8a9cd96890b tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:30:45.467949 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-63ee7f65-24f9-4b7b-aa1b-f8a9cd96890b tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:45.468437 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-63ee7f65-24f9-4b7b-aa1b-f8a9cd96890b tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:45.468881 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-63ee7f65-24f9-4b7b-aa1b-f8a9cd96890b tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:45.469576 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-63ee7f65-24f9-4b7b-aa1b-f8a9cd96890b tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:45.470160 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-63ee7f65-24f9-4b7b-aa1b-f8a9cd96890b tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:45.470584 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-63ee7f65-24f9-4b7b-aa1b-f8a9cd96890b tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:45.475358 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-80f8f659-d768-4763-b2ba-3aa597ed1fd2 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/9cd2f537-78c4-4a00-95ab-4f7b115810cd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094681 Sep 27 17:30:45.476038 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 359/694] 10.222.0.55 () {58 vars in 1275 bytes} [Tue Sep 27 17:30:45 2022] GET /compute/v2.1/servers/9cd2f537-78c4-4a00-95ab-4f7b115810cd/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:30:45.636324 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-63ee7f65-24f9-4b7b-aa1b-f8a9cd96890b tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acafe7ed414c87a5ca235b96047aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf4e20a59f147afb4f036fc8d04adb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:45.647347 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-63ee7f65-24f9-4b7b-aa1b-f8a9cd96890b tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b" status: 200 len: 1755 microversion: 2.1 time: 0.192648 Sep 27 17:30:45.647923 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 336/695] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:30:45 2022] GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b => generated 1755 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:30:46.169901 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-96ffa51d-74a0-403b-9547-bc0fd9bc9948 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:30:46.170662 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-96ffa51d-74a0-403b-9547-bc0fd9bc9948 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] [instance: 40e2eab1-2d75-4ad4-9e7b-da70094ed345] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:30:46.177951 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-96ffa51d-74a0-403b-9547-bc0fd9bc9948 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:46.178663 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-96ffa51d-74a0-403b-9547-bc0fd9bc9948 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:46.179898 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-96ffa51d-74a0-403b-9547-bc0fd9bc9948 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:46.180694 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-96ffa51d-74a0-403b-9547-bc0fd9bc9948 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:46.181363 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-96ffa51d-74a0-403b-9547-bc0fd9bc9948 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:46.182056 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-96ffa51d-74a0-403b-9547-bc0fd9bc9948 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:46.252770 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-96ffa51d-74a0-403b-9547-bc0fd9bc9948 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac1528c35fb464db00b5d18396b8eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4db1a85e2504cb9956a6461b5072aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:46.261731 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-96ffa51d-74a0-403b-9547-bc0fd9bc9948 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] 10.222.0.55 "GET /compute/v2.1/servers/40e2eab1-2d75-4ad4-9e7b-da70094ed345" status: 200 len: 1211 microversion: 2.1 time: 0.096082 Sep 27 17:30:46.263879 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 360/696] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:30:46 2022] GET /compute/v2.1/servers/40e2eab1-2d75-4ad4-9e7b-da70094ed345 => generated 1211 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:30:46.671849 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-5c658118-545c-45bc-9d98-90183e243824 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:30:46.673107 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-5c658118-545c-45bc-9d98-90183e243824 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:30:46.679493 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5c658118-545c-45bc-9d98-90183e243824 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:46.680469 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5c658118-545c-45bc-9d98-90183e243824 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:46.680900 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5c658118-545c-45bc-9d98-90183e243824 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:46.681587 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5c658118-545c-45bc-9d98-90183e243824 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:46.682047 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5c658118-545c-45bc-9d98-90183e243824 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:46.682482 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5c658118-545c-45bc-9d98-90183e243824 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:46.686583 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell1:SELECT=100 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:30:46.828278 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-5c658118-545c-45bc-9d98-90183e243824 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acafe7ed414c87a5ca235b96047aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf4e20a59f147afb4f036fc8d04adb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:46.837160 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-5c658118-545c-45bc-9d98-90183e243824 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b" status: 200 len: 1755 microversion: 2.1 time: 0.169215 Sep 27 17:30:46.850286 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 337/697] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:30:46 2022] GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:30:47.153583 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [req-0cb8de73-d903-4373-be4e-3d667dda6235 req-f9ba8492-7b5e-418e-913d-940ff14de132 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9cd2f537-78c4-4a00-95ab-4f7b115810cd", "tag": "a7cbab4a-ebf6-4274-83af-582db23d3344"}]} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:30:47.165769 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-0cb8de73-d903-4373-be4e-3d667dda6235 req-f9ba8492-7b5e-418e-913d-940ff14de132 service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:47.166573 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-0cb8de73-d903-4373-be4e-3d667dda6235 req-f9ba8492-7b5e-418e-913d-940ff14de132 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:47.167255 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-0cb8de73-d903-4373-be4e-3d667dda6235 req-f9ba8492-7b5e-418e-913d-940ff14de132 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:47.179582 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.compute.server_external_events [req-0cb8de73-d903-4373-be4e-3d667dda6235 req-f9ba8492-7b5e-418e-913d-940ff14de132 service nova] Creating event network-changed:a7cbab4a-ebf6-4274-83af-582db23d3344 for instance 9cd2f537-78c4-4a00-95ab-4f7b115810cd on hv-cinder-84914 Sep 27 17:30:47.186252 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [req-0cb8de73-d903-4373-be4e-3d667dda6235 req-f9ba8492-7b5e-418e-913d-940ff14de132 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036209 Sep 27 17:30:47.187096 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 361/698] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:30:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:30:47.285475 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-3ccc76d3-46d3-41bc-8e6b-eb3dfbfb34bf tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:30:47.286224 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-3ccc76d3-46d3-41bc-8e6b-eb3dfbfb34bf tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] [instance: 40e2eab1-2d75-4ad4-9e7b-da70094ed345] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:30:47.292744 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3ccc76d3-46d3-41bc-8e6b-eb3dfbfb34bf tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:47.293879 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3ccc76d3-46d3-41bc-8e6b-eb3dfbfb34bf tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:47.294950 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3ccc76d3-46d3-41bc-8e6b-eb3dfbfb34bf tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:47.295903 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3ccc76d3-46d3-41bc-8e6b-eb3dfbfb34bf tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:47.296431 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3ccc76d3-46d3-41bc-8e6b-eb3dfbfb34bf tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:47.297109 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3ccc76d3-46d3-41bc-8e6b-eb3dfbfb34bf tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:47.590871 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-3ccc76d3-46d3-41bc-8e6b-eb3dfbfb34bf tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac1528c35fb464db00b5d18396b8eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4db1a85e2504cb9956a6461b5072aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:47.610163 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-3ccc76d3-46d3-41bc-8e6b-eb3dfbfb34bf tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] 10.222.0.55 "GET /compute/v2.1/servers/40e2eab1-2d75-4ad4-9e7b-da70094ed345" status: 200 len: 1266 microversion: 2.1 time: 0.324943 Sep 27 17:30:47.612151 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 338/699] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:30:47 2022] GET /compute/v2.1/servers/40e2eab1-2d75-4ad4-9e7b-da70094ed345 => generated 1266 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:30:47.864590 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-bc2a2002-d7b7-4382-bc4a-6779f23a271c tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:30:47.865668 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-bc2a2002-d7b7-4382-bc4a-6779f23a271c tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:30:47.872916 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-bc2a2002-d7b7-4382-bc4a-6779f23a271c tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:47.873619 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-bc2a2002-d7b7-4382-bc4a-6779f23a271c tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:47.874473 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-bc2a2002-d7b7-4382-bc4a-6779f23a271c tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:47.875349 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-bc2a2002-d7b7-4382-bc4a-6779f23a271c tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:47.875967 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-bc2a2002-d7b7-4382-bc4a-6779f23a271c tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:47.876540 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-bc2a2002-d7b7-4382-bc4a-6779f23a271c tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:48.055964 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-bc2a2002-d7b7-4382-bc4a-6779f23a271c tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acafe7ed414c87a5ca235b96047aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf4e20a59f147afb4f036fc8d04adb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:48.065813 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-bc2a2002-d7b7-4382-bc4a-6779f23a271c tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b" status: 200 len: 1755 microversion: 2.1 time: 0.208305 Sep 27 17:30:48.080028 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 362/700] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:30:47 2022] GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b => generated 1755 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:30:48.371694 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-99ad269d-50d9-4419-a535-06f103905216 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1fff520c-19e5-4d3a-9712-154acb0ecb10"}} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:30:48.374251 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-99ad269d-50d9-4419-a535-06f103905216 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:30:48.380225 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-99ad269d-50d9-4419-a535-06f103905216 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:48.380706 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-99ad269d-50d9-4419-a535-06f103905216 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:48.381141 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-99ad269d-50d9-4419-a535-06f103905216 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:48.381828 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-99ad269d-50d9-4419-a535-06f103905216 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:48.382379 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-99ad269d-50d9-4419-a535-06f103905216 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:48.383476 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-99ad269d-50d9-4419-a535-06f103905216 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:48.635094 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-37ed1bbc-967c-4bb0-911c-8ecce691cf49 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:30:48.635703 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-37ed1bbc-967c-4bb0-911c-8ecce691cf49 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] [instance: 40e2eab1-2d75-4ad4-9e7b-da70094ed345] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:30:48.642547 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-37ed1bbc-967c-4bb0-911c-8ecce691cf49 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:48.643348 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-37ed1bbc-967c-4bb0-911c-8ecce691cf49 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:48.643841 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-37ed1bbc-967c-4bb0-911c-8ecce691cf49 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:48.644738 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-37ed1bbc-967c-4bb0-911c-8ecce691cf49 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:48.645439 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-37ed1bbc-967c-4bb0-911c-8ecce691cf49 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:48.646100 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-37ed1bbc-967c-4bb0-911c-8ecce691cf49 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:48.659937 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-99ad269d-50d9-4419-a535-06f103905216 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "POST /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.410088 Sep 27 17:30:48.661192 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 339/701] 10.222.0.55 () {60 vars in 1323 bytes} [Tue Sep 27 17:30:48 2022] POST /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1/os-volume_attachments => generated 194 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:30:48.805441 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-37ed1bbc-967c-4bb0-911c-8ecce691cf49 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac1528c35fb464db00b5d18396b8eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4db1a85e2504cb9956a6461b5072aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:48.813016 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-37ed1bbc-967c-4bb0-911c-8ecce691cf49 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] 10.222.0.55 "GET /compute/v2.1/servers/40e2eab1-2d75-4ad4-9e7b-da70094ed345" status: 200 len: 1266 microversion: 2.1 time: 0.182217 Sep 27 17:30:48.813577 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 363/702] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:30:48 2022] GET /compute/v2.1/servers/40e2eab1-2d75-4ad4-9e7b-da70094ed345 => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:30:49.091565 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-68e2bbbb-b3c6-468c-a5ae-e89a1167d67d tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:30:49.092177 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-68e2bbbb-b3c6-468c-a5ae-e89a1167d67d tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:30:49.098314 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-68e2bbbb-b3c6-468c-a5ae-e89a1167d67d tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:49.098792 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-68e2bbbb-b3c6-468c-a5ae-e89a1167d67d tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:49.099228 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-68e2bbbb-b3c6-468c-a5ae-e89a1167d67d tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:49.099909 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-68e2bbbb-b3c6-468c-a5ae-e89a1167d67d tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:49.100358 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-68e2bbbb-b3c6-468c-a5ae-e89a1167d67d tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:49.100777 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-68e2bbbb-b3c6-468c-a5ae-e89a1167d67d tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:49.204663 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [req-3524951d-d78a-49b2-a8ed-98e6aa80e8d6 req-6366a810-80b4-4900-aa5f-eeaaec59f9af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40e2eab1-2d75-4ad4-9e7b-da70094ed345", "tag": "945bab49-e787-4511-9e29-ddfbda056c05"}]} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:30:49.214686 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-3524951d-d78a-49b2-a8ed-98e6aa80e8d6 req-6366a810-80b4-4900-aa5f-eeaaec59f9af service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:49.215176 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-3524951d-d78a-49b2-a8ed-98e6aa80e8d6 req-6366a810-80b4-4900-aa5f-eeaaec59f9af service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:49.216283 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-3524951d-d78a-49b2-a8ed-98e6aa80e8d6 req-6366a810-80b4-4900-aa5f-eeaaec59f9af service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:49.228000 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.compute.server_external_events [req-3524951d-d78a-49b2-a8ed-98e6aa80e8d6 req-6366a810-80b4-4900-aa5f-eeaaec59f9af service nova] Creating event network-changed:945bab49-e787-4511-9e29-ddfbda056c05 for instance 40e2eab1-2d75-4ad4-9e7b-da70094ed345 on hv-cinder-84914 Sep 27 17:30:49.233125 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [req-3524951d-d78a-49b2-a8ed-98e6aa80e8d6 req-6366a810-80b4-4900-aa5f-eeaaec59f9af service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032114 Sep 27 17:30:49.233716 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 364/703] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:30:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:30:49.243795 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-68e2bbbb-b3c6-468c-a5ae-e89a1167d67d tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acafe7ed414c87a5ca235b96047aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf4e20a59f147afb4f036fc8d04adb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:49.252087 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-68e2bbbb-b3c6-468c-a5ae-e89a1167d67d tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b" status: 200 len: 1755 microversion: 2.1 time: 0.165837 Sep 27 17:30:49.252657 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 340/704] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:30:49 2022] GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:30:49.835151 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-41dfcc23-48eb-4786-900c-75e52190afe6 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:30:49.835842 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-41dfcc23-48eb-4786-900c-75e52190afe6 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] [instance: 40e2eab1-2d75-4ad4-9e7b-da70094ed345] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:30:49.841851 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-41dfcc23-48eb-4786-900c-75e52190afe6 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:49.842355 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-41dfcc23-48eb-4786-900c-75e52190afe6 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:49.842786 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-41dfcc23-48eb-4786-900c-75e52190afe6 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:49.843463 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-41dfcc23-48eb-4786-900c-75e52190afe6 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:49.843909 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-41dfcc23-48eb-4786-900c-75e52190afe6 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:49.844326 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-41dfcc23-48eb-4786-900c-75e52190afe6 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:49.994641 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-41dfcc23-48eb-4786-900c-75e52190afe6 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac1528c35fb464db00b5d18396b8eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4db1a85e2504cb9956a6461b5072aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:50.002727 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-41dfcc23-48eb-4786-900c-75e52190afe6 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] 10.222.0.55 "GET /compute/v2.1/servers/40e2eab1-2d75-4ad4-9e7b-da70094ed345" status: 200 len: 1266 microversion: 2.1 time: 0.171577 Sep 27 17:30:50.003293 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 365/705] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:30:49 2022] GET /compute/v2.1/servers/40e2eab1-2d75-4ad4-9e7b-da70094ed345 => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:30:50.275421 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-b8f1cc58-2a14-4108-a6ea-3b4ac20f0792 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:30:50.275970 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-b8f1cc58-2a14-4108-a6ea-3b4ac20f0792 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:30:50.282488 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b8f1cc58-2a14-4108-a6ea-3b4ac20f0792 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:50.282992 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b8f1cc58-2a14-4108-a6ea-3b4ac20f0792 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:50.283414 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b8f1cc58-2a14-4108-a6ea-3b4ac20f0792 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:50.284097 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b8f1cc58-2a14-4108-a6ea-3b4ac20f0792 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:50.284553 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b8f1cc58-2a14-4108-a6ea-3b4ac20f0792 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:50.284975 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b8f1cc58-2a14-4108-a6ea-3b4ac20f0792 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:50.434361 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-b8f1cc58-2a14-4108-a6ea-3b4ac20f0792 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acafe7ed414c87a5ca235b96047aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf4e20a59f147afb4f036fc8d04adb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:50.442557 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-b8f1cc58-2a14-4108-a6ea-3b4ac20f0792 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b" status: 200 len: 1755 microversion: 2.1 time: 0.171073 Sep 27 17:30:50.443132 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 341/706] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:30:50 2022] GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b => generated 1755 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:30:51.026950 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-ada400f3-6792-4273-8e0e-8b264c24760e tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:30:51.027569 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-ada400f3-6792-4273-8e0e-8b264c24760e tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] [instance: 40e2eab1-2d75-4ad4-9e7b-da70094ed345] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:30:51.033426 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ada400f3-6792-4273-8e0e-8b264c24760e tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:51.033907 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ada400f3-6792-4273-8e0e-8b264c24760e tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:51.034381 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ada400f3-6792-4273-8e0e-8b264c24760e tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:51.035069 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ada400f3-6792-4273-8e0e-8b264c24760e tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:51.035527 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ada400f3-6792-4273-8e0e-8b264c24760e tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:51.035952 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ada400f3-6792-4273-8e0e-8b264c24760e tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:51.053789 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:30:51.167049 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-ada400f3-6792-4273-8e0e-8b264c24760e tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac1528c35fb464db00b5d18396b8eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4db1a85e2504cb9956a6461b5072aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:51.174631 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-ada400f3-6792-4273-8e0e-8b264c24760e tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] 10.222.0.55 "GET /compute/v2.1/servers/40e2eab1-2d75-4ad4-9e7b-da70094ed345" status: 200 len: 1266 microversion: 2.1 time: 0.152199 Sep 27 17:30:51.175188 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 366/707] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:30:51 2022] GET /compute/v2.1/servers/40e2eab1-2d75-4ad4-9e7b-da70094ed345 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:30:51.465499 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-28971bdf-a664-4b4b-9813-58f61aae7753 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:30:51.466138 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-28971bdf-a664-4b4b-9813-58f61aae7753 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:30:51.472388 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-28971bdf-a664-4b4b-9813-58f61aae7753 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:51.472871 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-28971bdf-a664-4b4b-9813-58f61aae7753 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:51.473383 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-28971bdf-a664-4b4b-9813-58f61aae7753 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:51.474094 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-28971bdf-a664-4b4b-9813-58f61aae7753 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:51.474533 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-28971bdf-a664-4b4b-9813-58f61aae7753 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:51.474955 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-28971bdf-a664-4b4b-9813-58f61aae7753 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:51.614555 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-28971bdf-a664-4b4b-9813-58f61aae7753 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acafe7ed414c87a5ca235b96047aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf4e20a59f147afb4f036fc8d04adb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:51.626148 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-28971bdf-a664-4b4b-9813-58f61aae7753 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b" status: 200 len: 1755 microversion: 2.1 time: 0.164488 Sep 27 17:30:51.626725 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 342/708] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:30:51 2022] GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:30:52.197486 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-b8be3656-8fef-46e8-9156-d6b7dfd9c3d8 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:30:52.198032 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-b8be3656-8fef-46e8-9156-d6b7dfd9c3d8 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] [instance: 40e2eab1-2d75-4ad4-9e7b-da70094ed345] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:30:52.204007 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b8be3656-8fef-46e8-9156-d6b7dfd9c3d8 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:52.204495 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b8be3656-8fef-46e8-9156-d6b7dfd9c3d8 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:52.204923 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b8be3656-8fef-46e8-9156-d6b7dfd9c3d8 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:52.205640 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b8be3656-8fef-46e8-9156-d6b7dfd9c3d8 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:52.206139 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b8be3656-8fef-46e8-9156-d6b7dfd9c3d8 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:52.206556 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b8be3656-8fef-46e8-9156-d6b7dfd9c3d8 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:52.334053 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-b8be3656-8fef-46e8-9156-d6b7dfd9c3d8 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac1528c35fb464db00b5d18396b8eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4db1a85e2504cb9956a6461b5072aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:52.341562 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-b8be3656-8fef-46e8-9156-d6b7dfd9c3d8 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] 10.222.0.55 "GET /compute/v2.1/servers/40e2eab1-2d75-4ad4-9e7b-da70094ed345" status: 200 len: 1266 microversion: 2.1 time: 0.148671 Sep 27 17:30:52.342135 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 367/709] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:30:52 2022] GET /compute/v2.1/servers/40e2eab1-2d75-4ad4-9e7b-da70094ed345 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:30:52.653704 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-a52036df-4479-438d-b097-10dd36d7664d tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:30:52.654376 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-a52036df-4479-438d-b097-10dd36d7664d tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:30:52.660963 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a52036df-4479-438d-b097-10dd36d7664d tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:52.661437 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a52036df-4479-438d-b097-10dd36d7664d tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:52.661872 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a52036df-4479-438d-b097-10dd36d7664d tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:52.662657 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a52036df-4479-438d-b097-10dd36d7664d tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:52.663100 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a52036df-4479-438d-b097-10dd36d7664d tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:52.663515 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a52036df-4479-438d-b097-10dd36d7664d tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:52.809889 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-a52036df-4479-438d-b097-10dd36d7664d tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acafe7ed414c87a5ca235b96047aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf4e20a59f147afb4f036fc8d04adb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:52.818252 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-a52036df-4479-438d-b097-10dd36d7664d tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b" status: 200 len: 1755 microversion: 2.1 time: 0.168358 Sep 27 17:30:52.818944 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 343/710] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:30:52 2022] GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:30:53.364662 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-62c96c41-dd6b-4018-83c0-5ccff09d248e tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:30:53.365237 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-62c96c41-dd6b-4018-83c0-5ccff09d248e tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] [instance: 40e2eab1-2d75-4ad4-9e7b-da70094ed345] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:30:53.367566 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_cell0:SELECT=2 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:30:53.368251 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_cell0:SELECT=8 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:30:53.374218 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-62c96c41-dd6b-4018-83c0-5ccff09d248e tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:53.374707 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-62c96c41-dd6b-4018-83c0-5ccff09d248e tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:53.375142 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-62c96c41-dd6b-4018-83c0-5ccff09d248e tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:53.375831 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-62c96c41-dd6b-4018-83c0-5ccff09d248e tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:53.376287 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-62c96c41-dd6b-4018-83c0-5ccff09d248e tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:53.376711 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-62c96c41-dd6b-4018-83c0-5ccff09d248e tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:53.503446 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-62c96c41-dd6b-4018-83c0-5ccff09d248e tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac1528c35fb464db00b5d18396b8eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4db1a85e2504cb9956a6461b5072aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:53.512090 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-62c96c41-dd6b-4018-83c0-5ccff09d248e tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] 10.222.0.55 "GET /compute/v2.1/servers/40e2eab1-2d75-4ad4-9e7b-da70094ed345" status: 200 len: 1266 microversion: 2.1 time: 0.151436 Sep 27 17:30:53.512683 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 368/711] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:30:53 2022] GET /compute/v2.1/servers/40e2eab1-2d75-4ad4-9e7b-da70094ed345 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:30:53.841828 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-b6ab03ef-f7ff-4a81-a98e-624261927597 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:30:53.842399 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-b6ab03ef-f7ff-4a81-a98e-624261927597 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:30:53.848627 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b6ab03ef-f7ff-4a81-a98e-624261927597 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:53.849099 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b6ab03ef-f7ff-4a81-a98e-624261927597 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:53.849525 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b6ab03ef-f7ff-4a81-a98e-624261927597 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:53.850221 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b6ab03ef-f7ff-4a81-a98e-624261927597 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:53.850668 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b6ab03ef-f7ff-4a81-a98e-624261927597 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:53.851080 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b6ab03ef-f7ff-4a81-a98e-624261927597 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:53.991325 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-b6ab03ef-f7ff-4a81-a98e-624261927597 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acafe7ed414c87a5ca235b96047aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf4e20a59f147afb4f036fc8d04adb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:54.001698 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-b6ab03ef-f7ff-4a81-a98e-624261927597 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b" status: 200 len: 1755 microversion: 2.1 time: 0.163837 Sep 27 17:30:54.002302 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 344/712] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:30:53 2022] GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:30:54.534961 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-a2ac0cce-111a-4452-8b99-c3faf8bf6529 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:30:54.535496 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-a2ac0cce-111a-4452-8b99-c3faf8bf6529 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] [instance: 40e2eab1-2d75-4ad4-9e7b-da70094ed345] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:30:54.541613 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a2ac0cce-111a-4452-8b99-c3faf8bf6529 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:54.542150 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a2ac0cce-111a-4452-8b99-c3faf8bf6529 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:54.542582 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a2ac0cce-111a-4452-8b99-c3faf8bf6529 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:54.543270 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a2ac0cce-111a-4452-8b99-c3faf8bf6529 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:54.543721 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a2ac0cce-111a-4452-8b99-c3faf8bf6529 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:54.544175 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a2ac0cce-111a-4452-8b99-c3faf8bf6529 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:54.678619 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-a2ac0cce-111a-4452-8b99-c3faf8bf6529 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac1528c35fb464db00b5d18396b8eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4db1a85e2504cb9956a6461b5072aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:54.688475 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-a2ac0cce-111a-4452-8b99-c3faf8bf6529 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] 10.222.0.55 "GET /compute/v2.1/servers/40e2eab1-2d75-4ad4-9e7b-da70094ed345" status: 200 len: 1266 microversion: 2.1 time: 0.157137 Sep 27 17:30:54.689468 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 369/713] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:30:54 2022] GET /compute/v2.1/servers/40e2eab1-2d75-4ad4-9e7b-da70094ed345 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:30:55.024409 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-d524e4e6-b75f-4474-9b1e-9dd739f7aafb tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:30:55.025010 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-d524e4e6-b75f-4474-9b1e-9dd739f7aafb tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:30:55.031452 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d524e4e6-b75f-4474-9b1e-9dd739f7aafb tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:55.031927 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d524e4e6-b75f-4474-9b1e-9dd739f7aafb tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:55.032359 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d524e4e6-b75f-4474-9b1e-9dd739f7aafb tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:55.033042 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d524e4e6-b75f-4474-9b1e-9dd739f7aafb tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:55.033489 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d524e4e6-b75f-4474-9b1e-9dd739f7aafb tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:55.033908 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d524e4e6-b75f-4474-9b1e-9dd739f7aafb tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:55.178901 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-d524e4e6-b75f-4474-9b1e-9dd739f7aafb tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acafe7ed414c87a5ca235b96047aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf4e20a59f147afb4f036fc8d04adb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:55.186969 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-d524e4e6-b75f-4474-9b1e-9dd739f7aafb tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b" status: 200 len: 1755 microversion: 2.1 time: 0.166418 Sep 27 17:30:55.187535 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 345/714] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:30:55 2022] GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:30:55.712257 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-4f60037b-ffa7-4085-b0ba-bdcda6aca7ce tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:30:55.712905 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-4f60037b-ffa7-4085-b0ba-bdcda6aca7ce tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] [instance: 40e2eab1-2d75-4ad4-9e7b-da70094ed345] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:30:55.718865 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4f60037b-ffa7-4085-b0ba-bdcda6aca7ce tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:55.719347 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4f60037b-ffa7-4085-b0ba-bdcda6aca7ce tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:55.719778 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4f60037b-ffa7-4085-b0ba-bdcda6aca7ce tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:55.720474 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4f60037b-ffa7-4085-b0ba-bdcda6aca7ce tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:55.720924 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4f60037b-ffa7-4085-b0ba-bdcda6aca7ce tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:55.721347 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4f60037b-ffa7-4085-b0ba-bdcda6aca7ce tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:55.851325 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-4f60037b-ffa7-4085-b0ba-bdcda6aca7ce tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac1528c35fb464db00b5d18396b8eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4db1a85e2504cb9956a6461b5072aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:55.859128 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-4f60037b-ffa7-4085-b0ba-bdcda6aca7ce tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] 10.222.0.55 "GET /compute/v2.1/servers/40e2eab1-2d75-4ad4-9e7b-da70094ed345" status: 200 len: 1266 microversion: 2.1 time: 0.150788 Sep 27 17:30:55.859685 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 370/715] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:30:55 2022] GET /compute/v2.1/servers/40e2eab1-2d75-4ad4-9e7b-da70094ed345 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:30:56.210761 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-2163a02f-be61-4984-bbc4-4e1f2b2fe4b0 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:30:56.211427 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-2163a02f-be61-4984-bbc4-4e1f2b2fe4b0 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:30:56.217758 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2163a02f-be61-4984-bbc4-4e1f2b2fe4b0 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:56.218276 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2163a02f-be61-4984-bbc4-4e1f2b2fe4b0 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:56.218710 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2163a02f-be61-4984-bbc4-4e1f2b2fe4b0 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:56.219393 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2163a02f-be61-4984-bbc4-4e1f2b2fe4b0 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:56.219838 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2163a02f-be61-4984-bbc4-4e1f2b2fe4b0 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:56.220259 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2163a02f-be61-4984-bbc4-4e1f2b2fe4b0 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:56.361064 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-2163a02f-be61-4984-bbc4-4e1f2b2fe4b0 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acafe7ed414c87a5ca235b96047aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf4e20a59f147afb4f036fc8d04adb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:56.369791 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-2163a02f-be61-4984-bbc4-4e1f2b2fe4b0 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b" status: 200 len: 1755 microversion: 2.1 time: 0.162938 Sep 27 17:30:56.370398 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 346/716] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:30:56 2022] GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:30:56.882002 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-254558f8-17ad-4177-b156-214529c72534 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:30:56.883164 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-254558f8-17ad-4177-b156-214529c72534 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] [instance: 40e2eab1-2d75-4ad4-9e7b-da70094ed345] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:30:56.889172 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-254558f8-17ad-4177-b156-214529c72534 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:56.889652 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-254558f8-17ad-4177-b156-214529c72534 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:56.890096 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-254558f8-17ad-4177-b156-214529c72534 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:56.890809 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-254558f8-17ad-4177-b156-214529c72534 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:56.891261 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-254558f8-17ad-4177-b156-214529c72534 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:56.891687 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-254558f8-17ad-4177-b156-214529c72534 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:57.021880 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-254558f8-17ad-4177-b156-214529c72534 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac1528c35fb464db00b5d18396b8eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4db1a85e2504cb9956a6461b5072aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:57.030783 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-254558f8-17ad-4177-b156-214529c72534 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] 10.222.0.55 "GET /compute/v2.1/servers/40e2eab1-2d75-4ad4-9e7b-da70094ed345" status: 200 len: 1266 microversion: 2.1 time: 0.152750 Sep 27 17:30:57.031342 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 371/717] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:30:56 2022] GET /compute/v2.1/servers/40e2eab1-2d75-4ad4-9e7b-da70094ed345 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:30:57.392891 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-915139a1-7229-437b-889d-d29dd9a5aaab tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:30:57.393502 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-915139a1-7229-437b-889d-d29dd9a5aaab tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:30:57.399835 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-915139a1-7229-437b-889d-d29dd9a5aaab tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:57.400316 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-915139a1-7229-437b-889d-d29dd9a5aaab tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:57.400752 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-915139a1-7229-437b-889d-d29dd9a5aaab tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:57.401441 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-915139a1-7229-437b-889d-d29dd9a5aaab tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:57.401890 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-915139a1-7229-437b-889d-d29dd9a5aaab tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:57.402341 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-915139a1-7229-437b-889d-d29dd9a5aaab tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:57.544277 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-915139a1-7229-437b-889d-d29dd9a5aaab tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acafe7ed414c87a5ca235b96047aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf4e20a59f147afb4f036fc8d04adb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:57.552880 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-915139a1-7229-437b-889d-d29dd9a5aaab tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b" status: 200 len: 1755 microversion: 2.1 time: 0.163852 Sep 27 17:30:57.568607 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 347/718] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:30:57 2022] GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b => generated 1755 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:30:58.052900 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-39a0fd5c-9993-401d-9742-32538ffdefdd tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:30:58.053436 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-39a0fd5c-9993-401d-9742-32538ffdefdd tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] [instance: 40e2eab1-2d75-4ad4-9e7b-da70094ed345] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:30:58.059382 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-39a0fd5c-9993-401d-9742-32538ffdefdd tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:58.059864 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-39a0fd5c-9993-401d-9742-32538ffdefdd tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:58.060301 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-39a0fd5c-9993-401d-9742-32538ffdefdd tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:58.060989 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-39a0fd5c-9993-401d-9742-32538ffdefdd tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:58.061441 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-39a0fd5c-9993-401d-9742-32538ffdefdd tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:58.061864 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-39a0fd5c-9993-401d-9742-32538ffdefdd tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:58.193036 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-39a0fd5c-9993-401d-9742-32538ffdefdd tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac1528c35fb464db00b5d18396b8eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4db1a85e2504cb9956a6461b5072aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:58.201142 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-39a0fd5c-9993-401d-9742-32538ffdefdd tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] 10.222.0.55 "GET /compute/v2.1/servers/40e2eab1-2d75-4ad4-9e7b-da70094ed345" status: 200 len: 1266 microversion: 2.1 time: 0.152248 Sep 27 17:30:58.201705 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 372/719] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:30:58 2022] GET /compute/v2.1/servers/40e2eab1-2d75-4ad4-9e7b-da70094ed345 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:30:58.577249 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-79f4fd54-46af-479c-b922-d2b6c50a5ff2 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:30:58.577793 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-79f4fd54-46af-479c-b922-d2b6c50a5ff2 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:30:58.580497 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:30:58.586482 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-79f4fd54-46af-479c-b922-d2b6c50a5ff2 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:58.586972 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-79f4fd54-46af-479c-b922-d2b6c50a5ff2 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:58.587411 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-79f4fd54-46af-479c-b922-d2b6c50a5ff2 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:58.588106 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-79f4fd54-46af-479c-b922-d2b6c50a5ff2 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:58.588595 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-79f4fd54-46af-479c-b922-d2b6c50a5ff2 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:58.589024 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-79f4fd54-46af-479c-b922-d2b6c50a5ff2 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:58.726502 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-79f4fd54-46af-479c-b922-d2b6c50a5ff2 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acafe7ed414c87a5ca235b96047aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf4e20a59f147afb4f036fc8d04adb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:58.734816 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-79f4fd54-46af-479c-b922-d2b6c50a5ff2 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b" status: 200 len: 1755 microversion: 2.1 time: 0.161595 Sep 27 17:30:58.735390 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 348/720] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:30:58 2022] GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:30:59.223530 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-4abb7a2e-19be-4bad-8db0-85f5b4f7b349 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:30:59.224150 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-4abb7a2e-19be-4bad-8db0-85f5b4f7b349 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] [instance: 40e2eab1-2d75-4ad4-9e7b-da70094ed345] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:30:59.230606 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4abb7a2e-19be-4bad-8db0-85f5b4f7b349 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:59.231345 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4abb7a2e-19be-4bad-8db0-85f5b4f7b349 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:59.231780 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4abb7a2e-19be-4bad-8db0-85f5b4f7b349 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:59.232467 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4abb7a2e-19be-4bad-8db0-85f5b4f7b349 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:59.232924 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4abb7a2e-19be-4bad-8db0-85f5b4f7b349 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:59.233347 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4abb7a2e-19be-4bad-8db0-85f5b4f7b349 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:59.364239 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-4abb7a2e-19be-4bad-8db0-85f5b4f7b349 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac1528c35fb464db00b5d18396b8eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4db1a85e2504cb9956a6461b5072aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:59.372439 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-4abb7a2e-19be-4bad-8db0-85f5b4f7b349 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] 10.222.0.55 "GET /compute/v2.1/servers/40e2eab1-2d75-4ad4-9e7b-da70094ed345" status: 200 len: 1266 microversion: 2.1 time: 0.152777 Sep 27 17:30:59.373014 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 373/721] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:30:59 2022] GET /compute/v2.1/servers/40e2eab1-2d75-4ad4-9e7b-da70094ed345 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:30:59.409356 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-5d0f6c4b-f5e0-418f-b452-68c34fb05b74 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:30:59.411687 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-5d0f6c4b-f5e0-418f-b452-68c34fb05b74 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:30:59.418226 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5d0f6c4b-f5e0-418f-b452-68c34fb05b74 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:59.418711 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5d0f6c4b-f5e0-418f-b452-68c34fb05b74 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:59.419148 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5d0f6c4b-f5e0-418f-b452-68c34fb05b74 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:59.419839 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5d0f6c4b-f5e0-418f-b452-68c34fb05b74 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:59.420292 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5d0f6c4b-f5e0-418f-b452-68c34fb05b74 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:59.420714 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5d0f6c4b-f5e0-418f-b452-68c34fb05b74 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:59.442747 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.objects.instance [None req-5d0f6c4b-f5e0-418f-b452-68c34fb05b74 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lazy-loading 'flavor' on Instance uuid ca74fda8-afd6-41f2-8c93-5e8971c645f1 {{(pid=120415) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 17:30:59.564501 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-5d0f6c4b-f5e0-418f-b452-68c34fb05b74 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "POST /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1/action" status: 200 len: 32 microversion: 2.1 time: 0.159102 Sep 27 17:30:59.565123 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 349/722] 10.222.0.55 () {60 vars in 1278 bytes} [Tue Sep 27 17:30:59 2022] POST /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1/action => generated 32 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 17:30:59.575465 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-6e0d2a8b-3ba9-49d7-bf6b-ed75f1226b34 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:30:59.576083 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-6e0d2a8b-3ba9-49d7-bf6b-ed75f1226b34 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:30:59.581917 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6e0d2a8b-3ba9-49d7-bf6b-ed75f1226b34 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:59.582479 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6e0d2a8b-3ba9-49d7-bf6b-ed75f1226b34 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:59.583046 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6e0d2a8b-3ba9-49d7-bf6b-ed75f1226b34 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:59.583835 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6e0d2a8b-3ba9-49d7-bf6b-ed75f1226b34 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:59.584359 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6e0d2a8b-3ba9-49d7-bf6b-ed75f1226b34 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:59.584949 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6e0d2a8b-3ba9-49d7-bf6b-ed75f1226b34 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:59.718923 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-6e0d2a8b-3ba9-49d7-bf6b-ed75f1226b34 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:59.727879 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-6e0d2a8b-3ba9-49d7-bf6b-ed75f1226b34 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1" status: 200 len: 1737 microversion: 2.1 time: 0.156900 Sep 27 17:30:59.728507 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 374/723] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:30:59 2022] GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:30:59.760601 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-75b77377-726d-40fb-aa5a-9dfc3e78bb1e tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:30:59.761353 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-75b77377-726d-40fb-aa5a-9dfc3e78bb1e tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:30:59.768762 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-75b77377-726d-40fb-aa5a-9dfc3e78bb1e tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:59.769510 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-75b77377-726d-40fb-aa5a-9dfc3e78bb1e tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:59.770265 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-75b77377-726d-40fb-aa5a-9dfc3e78bb1e tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:59.771140 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-75b77377-726d-40fb-aa5a-9dfc3e78bb1e tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:59.771754 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-75b77377-726d-40fb-aa5a-9dfc3e78bb1e tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:59.772322 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-75b77377-726d-40fb-aa5a-9dfc3e78bb1e tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:59.788554 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:30:59.931536 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-75b77377-726d-40fb-aa5a-9dfc3e78bb1e tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acafe7ed414c87a5ca235b96047aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf4e20a59f147afb4f036fc8d04adb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:30:59.938414 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [req-63818f14-95c2-4496-ac55-32b9cb548ba9 req-1324b1dc-960b-4ad6-860d-dcce19e0836c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40e2eab1-2d75-4ad4-9e7b-da70094ed345", "name": "network-vif-plugged", "status": "completed", "tag": "945bab49-e787-4511-9e29-ddfbda056c05"}]} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:30:59.949578 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-75b77377-726d-40fb-aa5a-9dfc3e78bb1e tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b" status: 200 len: 1755 microversion: 2.1 time: 0.194360 Sep 27 17:30:59.955570 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-63818f14-95c2-4496-ac55-32b9cb548ba9 req-1324b1dc-960b-4ad6-860d-dcce19e0836c service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:30:59.956075 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 350/724] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:30:59 2022] GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b => generated 1755 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:30:59.956741 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-63818f14-95c2-4496-ac55-32b9cb548ba9 req-1324b1dc-960b-4ad6-860d-dcce19e0836c service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:30:59.957330 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-63818f14-95c2-4496-ac55-32b9cb548ba9 req-1324b1dc-960b-4ad6-860d-dcce19e0836c service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:30:59.972232 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.compute.server_external_events [req-63818f14-95c2-4496-ac55-32b9cb548ba9 req-1324b1dc-960b-4ad6-860d-dcce19e0836c service nova] Creating event network-vif-plugged:945bab49-e787-4511-9e29-ddfbda056c05 for instance 40e2eab1-2d75-4ad4-9e7b-da70094ed345 on hv-cinder-84914 Sep 27 17:30:59.979739 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [req-63818f14-95c2-4496-ac55-32b9cb548ba9 req-1324b1dc-960b-4ad6-860d-dcce19e0836c service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056504 Sep 27 17:30:59.981306 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 375/725] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:30:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:31:00.396211 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-a82e5f37-3d13-4a67-ba6f-ff96eb374ada tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:31:00.397159 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-a82e5f37-3d13-4a67-ba6f-ff96eb374ada tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] [instance: 40e2eab1-2d75-4ad4-9e7b-da70094ed345] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:31:00.403667 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a82e5f37-3d13-4a67-ba6f-ff96eb374ada tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:31:00.404149 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a82e5f37-3d13-4a67-ba6f-ff96eb374ada tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:31:00.404584 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a82e5f37-3d13-4a67-ba6f-ff96eb374ada tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:31:00.405285 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a82e5f37-3d13-4a67-ba6f-ff96eb374ada tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:31:00.405737 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a82e5f37-3d13-4a67-ba6f-ff96eb374ada tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:31:00.406190 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a82e5f37-3d13-4a67-ba6f-ff96eb374ada tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:31:00.539858 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-a82e5f37-3d13-4a67-ba6f-ff96eb374ada tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac1528c35fb464db00b5d18396b8eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4db1a85e2504cb9956a6461b5072aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:31:00.550743 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-a82e5f37-3d13-4a67-ba6f-ff96eb374ada tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] 10.222.0.55 "GET /compute/v2.1/servers/40e2eab1-2d75-4ad4-9e7b-da70094ed345" status: 200 len: 1266 microversion: 2.1 time: 0.158515 Sep 27 17:31:00.562579 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 351/726] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:31:00 2022] GET /compute/v2.1/servers/40e2eab1-2d75-4ad4-9e7b-da70094ed345 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:31:00.752354 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-b99dbc57-bf5c-41bf-a776-6ef2006928b9 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:31:00.753075 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-b99dbc57-bf5c-41bf-a776-6ef2006928b9 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:31:00.759228 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b99dbc57-bf5c-41bf-a776-6ef2006928b9 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:31:00.759712 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b99dbc57-bf5c-41bf-a776-6ef2006928b9 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:31:00.760149 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b99dbc57-bf5c-41bf-a776-6ef2006928b9 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:31:00.760837 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b99dbc57-bf5c-41bf-a776-6ef2006928b9 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:31:00.761292 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b99dbc57-bf5c-41bf-a776-6ef2006928b9 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:31:00.761717 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b99dbc57-bf5c-41bf-a776-6ef2006928b9 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:31:00.889310 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-b99dbc57-bf5c-41bf-a776-6ef2006928b9 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:31:00.897456 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-b99dbc57-bf5c-41bf-a776-6ef2006928b9 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1" status: 200 len: 1737 microversion: 2.1 time: 0.149623 Sep 27 17:31:00.898530 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 376/727] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:31:00 2022] GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1 => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:31:00.973084 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-831ee47d-7119-40c8-a4a7-e18996825e13 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:31:00.973692 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-831ee47d-7119-40c8-a4a7-e18996825e13 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:31:00.980821 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-831ee47d-7119-40c8-a4a7-e18996825e13 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:31:00.981561 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-831ee47d-7119-40c8-a4a7-e18996825e13 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:31:00.981993 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-831ee47d-7119-40c8-a4a7-e18996825e13 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:31:00.982704 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-831ee47d-7119-40c8-a4a7-e18996825e13 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:31:00.983149 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-831ee47d-7119-40c8-a4a7-e18996825e13 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:31:00.983563 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-831ee47d-7119-40c8-a4a7-e18996825e13 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:31:01.121788 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-831ee47d-7119-40c8-a4a7-e18996825e13 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acafe7ed414c87a5ca235b96047aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf4e20a59f147afb4f036fc8d04adb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:31:01.130348 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-831ee47d-7119-40c8-a4a7-e18996825e13 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b" status: 200 len: 1755 microversion: 2.1 time: 0.161348 Sep 27 17:31:01.130919 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 352/728] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:31:00 2022] GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:31:01.574684 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-ff8a2d5b-134c-4832-8851-43dd46c1f778 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:31:01.575269 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-ff8a2d5b-134c-4832-8851-43dd46c1f778 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] [instance: 40e2eab1-2d75-4ad4-9e7b-da70094ed345] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:31:01.577246 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:31:01.582503 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ff8a2d5b-134c-4832-8851-43dd46c1f778 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:31:01.582987 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ff8a2d5b-134c-4832-8851-43dd46c1f778 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:31:01.583425 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ff8a2d5b-134c-4832-8851-43dd46c1f778 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:31:01.584118 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ff8a2d5b-134c-4832-8851-43dd46c1f778 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:31:01.584578 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ff8a2d5b-134c-4832-8851-43dd46c1f778 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:31:01.584999 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ff8a2d5b-134c-4832-8851-43dd46c1f778 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:31:01.718467 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-ff8a2d5b-134c-4832-8851-43dd46c1f778 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac1528c35fb464db00b5d18396b8eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4db1a85e2504cb9956a6461b5072aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:31:01.726140 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-ff8a2d5b-134c-4832-8851-43dd46c1f778 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] 10.222.0.55 "GET /compute/v2.1/servers/40e2eab1-2d75-4ad4-9e7b-da70094ed345" status: 200 len: 1266 microversion: 2.1 time: 0.155962 Sep 27 17:31:01.726709 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 377/729] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:31:01 2022] GET /compute/v2.1/servers/40e2eab1-2d75-4ad4-9e7b-da70094ed345 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:31:01.920981 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-9e155f29-4875-412d-aa02-79e57952c337 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:31:01.921615 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-9e155f29-4875-412d-aa02-79e57952c337 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:31:01.927813 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9e155f29-4875-412d-aa02-79e57952c337 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:31:01.928296 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9e155f29-4875-412d-aa02-79e57952c337 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:31:01.928764 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9e155f29-4875-412d-aa02-79e57952c337 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:31:01.929944 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9e155f29-4875-412d-aa02-79e57952c337 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:31:01.930424 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9e155f29-4875-412d-aa02-79e57952c337 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:31:01.930852 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9e155f29-4875-412d-aa02-79e57952c337 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:31:02.060472 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-9e155f29-4875-412d-aa02-79e57952c337 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:31:02.069100 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-9e155f29-4875-412d-aa02-79e57952c337 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1" status: 200 len: 1737 microversion: 2.1 time: 0.151989 Sep 27 17:31:02.069673 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 353/730] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:31:01 2022] GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:31:02.153744 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-5f0299cf-2fe2-4dc1-8cc0-c887f4742ef0 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:31:02.154373 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-5f0299cf-2fe2-4dc1-8cc0-c887f4742ef0 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:31:02.160222 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5f0299cf-2fe2-4dc1-8cc0-c887f4742ef0 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:31:02.160700 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5f0299cf-2fe2-4dc1-8cc0-c887f4742ef0 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:31:02.161154 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5f0299cf-2fe2-4dc1-8cc0-c887f4742ef0 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:31:02.161849 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5f0299cf-2fe2-4dc1-8cc0-c887f4742ef0 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:31:02.162329 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5f0299cf-2fe2-4dc1-8cc0-c887f4742ef0 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:31:02.162753 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5f0299cf-2fe2-4dc1-8cc0-c887f4742ef0 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:31:02.303239 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-5f0299cf-2fe2-4dc1-8cc0-c887f4742ef0 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acafe7ed414c87a5ca235b96047aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf4e20a59f147afb4f036fc8d04adb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:31:02.318678 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-5f0299cf-2fe2-4dc1-8cc0-c887f4742ef0 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b" status: 200 len: 1758 microversion: 2.1 time: 0.168690 Sep 27 17:31:02.319260 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 378/731] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:31:02 2022] GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b => generated 1758 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:31:02.748765 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-8fe0e3ec-15fe-4ab1-9b37-662f740bef5a tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:31:02.749368 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-8fe0e3ec-15fe-4ab1-9b37-662f740bef5a tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] [instance: 40e2eab1-2d75-4ad4-9e7b-da70094ed345] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:31:02.755398 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8fe0e3ec-15fe-4ab1-9b37-662f740bef5a tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:31:02.755877 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8fe0e3ec-15fe-4ab1-9b37-662f740bef5a tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:31:02.756308 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8fe0e3ec-15fe-4ab1-9b37-662f740bef5a tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:31:02.757022 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8fe0e3ec-15fe-4ab1-9b37-662f740bef5a tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:31:02.758053 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8fe0e3ec-15fe-4ab1-9b37-662f740bef5a tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:31:02.758500 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8fe0e3ec-15fe-4ab1-9b37-662f740bef5a tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:31:02.885290 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-8fe0e3ec-15fe-4ab1-9b37-662f740bef5a tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac1528c35fb464db00b5d18396b8eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4db1a85e2504cb9956a6461b5072aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:31:02.892816 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-8fe0e3ec-15fe-4ab1-9b37-662f740bef5a tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] 10.222.0.55 "GET /compute/v2.1/servers/40e2eab1-2d75-4ad4-9e7b-da70094ed345" status: 200 len: 1266 microversion: 2.1 time: 0.147908 Sep 27 17:31:02.893379 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 354/732] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:31:02 2022] GET /compute/v2.1/servers/40e2eab1-2d75-4ad4-9e7b-da70094ed345 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:31:03.093207 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-2e036c8c-14ce-4c39-a4d1-c354748b7e6a tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:31:03.093820 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-2e036c8c-14ce-4c39-a4d1-c354748b7e6a tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:31:03.099720 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-2e036c8c-14ce-4c39-a4d1-c354748b7e6a tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:31:03.100192 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-2e036c8c-14ce-4c39-a4d1-c354748b7e6a tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:31:03.100620 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-2e036c8c-14ce-4c39-a4d1-c354748b7e6a tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:31:03.101346 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-2e036c8c-14ce-4c39-a4d1-c354748b7e6a tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:31:03.101792 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-2e036c8c-14ce-4c39-a4d1-c354748b7e6a tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:31:03.102241 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-2e036c8c-14ce-4c39-a4d1-c354748b7e6a tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:31:03.230119 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-2e036c8c-14ce-4c39-a4d1-c354748b7e6a tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:31:03.238523 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-2e036c8c-14ce-4c39-a4d1-c354748b7e6a tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1" status: 200 len: 1737 microversion: 2.1 time: 0.149238 Sep 27 17:31:03.239075 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 379/733] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:31:03 2022] GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1 => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:31:03.916794 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-94007c7d-a02a-44bc-a6b9-f6e4b3521a90 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:31:03.917435 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-94007c7d-a02a-44bc-a6b9-f6e4b3521a90 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] [instance: 40e2eab1-2d75-4ad4-9e7b-da70094ed345] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:31:03.923792 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-94007c7d-a02a-44bc-a6b9-f6e4b3521a90 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:31:03.924272 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-94007c7d-a02a-44bc-a6b9-f6e4b3521a90 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:31:03.924707 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-94007c7d-a02a-44bc-a6b9-f6e4b3521a90 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:31:03.925388 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-94007c7d-a02a-44bc-a6b9-f6e4b3521a90 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:31:03.925840 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-94007c7d-a02a-44bc-a6b9-f6e4b3521a90 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:31:03.926295 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-94007c7d-a02a-44bc-a6b9-f6e4b3521a90 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:31:04.052381 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-94007c7d-a02a-44bc-a6b9-f6e4b3521a90 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac1528c35fb464db00b5d18396b8eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4db1a85e2504cb9956a6461b5072aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:31:04.060009 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-94007c7d-a02a-44bc-a6b9-f6e4b3521a90 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] 10.222.0.55 "GET /compute/v2.1/servers/40e2eab1-2d75-4ad4-9e7b-da70094ed345" status: 200 len: 1266 microversion: 2.1 time: 0.147815 Sep 27 17:31:04.060575 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 355/734] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:31:03 2022] GET /compute/v2.1/servers/40e2eab1-2d75-4ad4-9e7b-da70094ed345 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:31:04.262575 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-c9fa8097-61fe-470f-a964-0f88ea4c52c9 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:31:04.263136 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-c9fa8097-61fe-470f-a964-0f88ea4c52c9 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:31:04.269142 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c9fa8097-61fe-470f-a964-0f88ea4c52c9 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:31:04.269624 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c9fa8097-61fe-470f-a964-0f88ea4c52c9 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:31:04.270056 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c9fa8097-61fe-470f-a964-0f88ea4c52c9 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:31:04.270779 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c9fa8097-61fe-470f-a964-0f88ea4c52c9 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:31:04.271238 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c9fa8097-61fe-470f-a964-0f88ea4c52c9 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:31:04.271660 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c9fa8097-61fe-470f-a964-0f88ea4c52c9 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:31:04.396322 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-c9fa8097-61fe-470f-a964-0f88ea4c52c9 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:31:04.404845 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-c9fa8097-61fe-470f-a964-0f88ea4c52c9 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1" status: 200 len: 1737 microversion: 2.1 time: 0.146220 Sep 27 17:31:04.405412 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 380/735] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:31:04 2022] GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1 => generated 1737 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:31:05.083621 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-96d63024-b811-46e8-b1e4-fb3603eab7bc tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:31:05.084223 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-96d63024-b811-46e8-b1e4-fb3603eab7bc tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] [instance: 40e2eab1-2d75-4ad4-9e7b-da70094ed345] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:31:05.090584 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-96d63024-b811-46e8-b1e4-fb3603eab7bc tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:31:05.091088 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-96d63024-b811-46e8-b1e4-fb3603eab7bc tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:31:05.091524 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-96d63024-b811-46e8-b1e4-fb3603eab7bc tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:31:05.092204 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-96d63024-b811-46e8-b1e4-fb3603eab7bc tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:31:05.092656 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-96d63024-b811-46e8-b1e4-fb3603eab7bc tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:31:05.093077 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-96d63024-b811-46e8-b1e4-fb3603eab7bc tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:31:05.222390 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-96d63024-b811-46e8-b1e4-fb3603eab7bc tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac1528c35fb464db00b5d18396b8eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4db1a85e2504cb9956a6461b5072aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:31:05.230498 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-96d63024-b811-46e8-b1e4-fb3603eab7bc tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] 10.222.0.55 "GET /compute/v2.1/servers/40e2eab1-2d75-4ad4-9e7b-da70094ed345" status: 200 len: 1453 microversion: 2.1 time: 0.150739 Sep 27 17:31:05.231348 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 356/736] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:31:05 2022] GET /compute/v2.1/servers/40e2eab1-2d75-4ad4-9e7b-da70094ed345 => generated 1453 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:31:05.252885 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-a31858be-6e08-4399-a504-094fdfb21c3f tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:31:05.253503 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-a31858be-6e08-4399-a504-094fdfb21c3f tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] [instance: 40e2eab1-2d75-4ad4-9e7b-da70094ed345] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:31:05.259384 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a31858be-6e08-4399-a504-094fdfb21c3f tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:31:05.259864 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a31858be-6e08-4399-a504-094fdfb21c3f tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:31:05.260299 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a31858be-6e08-4399-a504-094fdfb21c3f tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:31:05.260981 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a31858be-6e08-4399-a504-094fdfb21c3f tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:31:05.261437 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a31858be-6e08-4399-a504-094fdfb21c3f tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:31:05.261856 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a31858be-6e08-4399-a504-094fdfb21c3f tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:31:05.395148 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-a31858be-6e08-4399-a504-094fdfb21c3f tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac1528c35fb464db00b5d18396b8eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4db1a85e2504cb9956a6461b5072aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:31:05.403260 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-a31858be-6e08-4399-a504-094fdfb21c3f tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] 10.222.0.55 "GET /compute/v2.1/servers/40e2eab1-2d75-4ad4-9e7b-da70094ed345" status: 200 len: 1453 microversion: 2.1 time: 0.154196 Sep 27 17:31:05.403820 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 381/737] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:31:05 2022] GET /compute/v2.1/servers/40e2eab1-2d75-4ad4-9e7b-da70094ed345 => generated 1453 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:31:05.427179 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-ede2e713-bd92-476c-a7d7-d49cb88e3271 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:31:05.427820 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-ede2e713-bd92-476c-a7d7-d49cb88e3271 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:31:05.433627 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ede2e713-bd92-476c-a7d7-d49cb88e3271 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:31:05.434127 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ede2e713-bd92-476c-a7d7-d49cb88e3271 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:31:05.434565 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ede2e713-bd92-476c-a7d7-d49cb88e3271 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:31:05.435242 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ede2e713-bd92-476c-a7d7-d49cb88e3271 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:31:05.435685 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ede2e713-bd92-476c-a7d7-d49cb88e3271 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:31:05.436102 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ede2e713-bd92-476c-a7d7-d49cb88e3271 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:31:05.592092 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-ede2e713-bd92-476c-a7d7-d49cb88e3271 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:31:05.600261 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-ede2e713-bd92-476c-a7d7-d49cb88e3271 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1" status: 200 len: 1737 microversion: 2.1 time: 0.176863 Sep 27 17:31:05.600824 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 357/738] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:31:05 2022] GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1 => generated 1737 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:31:06.624042 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-9e24ad39-6836-4a09-9fa1-869230ea4e8e tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:31:06.624783 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-9e24ad39-6836-4a09-9fa1-869230ea4e8e tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:31:06.630807 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9e24ad39-6836-4a09-9fa1-869230ea4e8e tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:31:06.631300 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9e24ad39-6836-4a09-9fa1-869230ea4e8e tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:31:06.631734 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9e24ad39-6836-4a09-9fa1-869230ea4e8e tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:31:06.632922 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9e24ad39-6836-4a09-9fa1-869230ea4e8e tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:31:06.633375 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9e24ad39-6836-4a09-9fa1-869230ea4e8e tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:31:06.633801 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9e24ad39-6836-4a09-9fa1-869230ea4e8e tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:31:06.760319 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-9e24ad39-6836-4a09-9fa1-869230ea4e8e tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:31:06.768696 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-9e24ad39-6836-4a09-9fa1-869230ea4e8e tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1" status: 200 len: 1737 microversion: 2.1 time: 0.148481 Sep 27 17:31:06.769311 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 382/739] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:31:06 2022] GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1 => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:31:07.025722 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [req-47807df5-0676-425a-9319-17e4c7a18c3d req-30ef1de0-410f-4efe-9216-d8ce817e14b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40e2eab1-2d75-4ad4-9e7b-da70094ed345", "tag": "945bab49-e787-4511-9e29-ddfbda056c05"}]} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:31:07.035496 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-47807df5-0676-425a-9319-17e4c7a18c3d req-30ef1de0-410f-4efe-9216-d8ce817e14b0 service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:31:07.035965 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-47807df5-0676-425a-9319-17e4c7a18c3d req-30ef1de0-410f-4efe-9216-d8ce817e14b0 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:31:07.036390 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-47807df5-0676-425a-9319-17e4c7a18c3d req-30ef1de0-410f-4efe-9216-d8ce817e14b0 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:31:07.047351 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.compute.server_external_events [req-47807df5-0676-425a-9319-17e4c7a18c3d req-30ef1de0-410f-4efe-9216-d8ce817e14b0 service nova] Creating event network-changed:945bab49-e787-4511-9e29-ddfbda056c05 for instance 40e2eab1-2d75-4ad4-9e7b-da70094ed345 on hv-cinder-84914 Sep 27 17:31:07.052094 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [req-47807df5-0676-425a-9319-17e4c7a18c3d req-30ef1de0-410f-4efe-9216-d8ce817e14b0 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030042 Sep 27 17:31:07.052676 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 358/740] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:31:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:31:07.793492 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-bbdf2cea-d0f7-433e-acd2-b2e8fb96e920 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:31:07.794290 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-bbdf2cea-d0f7-433e-acd2-b2e8fb96e920 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:31:07.801026 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-bbdf2cea-d0f7-433e-acd2-b2e8fb96e920 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:31:07.801585 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-bbdf2cea-d0f7-433e-acd2-b2e8fb96e920 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:31:07.802019 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-bbdf2cea-d0f7-433e-acd2-b2e8fb96e920 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:31:07.802811 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-bbdf2cea-d0f7-433e-acd2-b2e8fb96e920 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:31:07.803257 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-bbdf2cea-d0f7-433e-acd2-b2e8fb96e920 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:31:07.803673 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-bbdf2cea-d0f7-433e-acd2-b2e8fb96e920 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:31:07.938169 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-bbdf2cea-d0f7-433e-acd2-b2e8fb96e920 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:31:07.941750 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_cell1:SELECT=100 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:31:07.947574 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-bbdf2cea-d0f7-433e-acd2-b2e8fb96e920 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1" status: 200 len: 1737 microversion: 2.1 time: 0.157917 Sep 27 17:31:07.948178 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 383/741] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:31:07 2022] GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1 => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:31:08.972391 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-8d1787af-54bb-4def-9c26-4d761848c7f5 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:31:08.973085 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-8d1787af-54bb-4def-9c26-4d761848c7f5 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:31:08.979736 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8d1787af-54bb-4def-9c26-4d761848c7f5 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:31:08.980214 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8d1787af-54bb-4def-9c26-4d761848c7f5 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:31:08.980653 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8d1787af-54bb-4def-9c26-4d761848c7f5 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:31:08.981602 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8d1787af-54bb-4def-9c26-4d761848c7f5 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:31:08.982053 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8d1787af-54bb-4def-9c26-4d761848c7f5 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:31:08.982504 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8d1787af-54bb-4def-9c26-4d761848c7f5 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:31:09.110609 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-8d1787af-54bb-4def-9c26-4d761848c7f5 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:31:09.119221 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-8d1787af-54bb-4def-9c26-4d761848c7f5 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1" status: 200 len: 1737 microversion: 2.1 time: 0.151750 Sep 27 17:31:09.119779 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 359/742] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:31:08 2022] GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:31:10.142722 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-d7c9cf40-77b9-4e71-8810-43b3c9c21d41 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:31:10.143357 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-d7c9cf40-77b9-4e71-8810-43b3c9c21d41 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:31:10.149700 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d7c9cf40-77b9-4e71-8810-43b3c9c21d41 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:31:10.150219 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d7c9cf40-77b9-4e71-8810-43b3c9c21d41 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:31:10.150659 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d7c9cf40-77b9-4e71-8810-43b3c9c21d41 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:31:10.151352 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d7c9cf40-77b9-4e71-8810-43b3c9c21d41 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:31:10.151807 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d7c9cf40-77b9-4e71-8810-43b3c9c21d41 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:31:10.152232 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d7c9cf40-77b9-4e71-8810-43b3c9c21d41 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:31:10.280368 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-d7c9cf40-77b9-4e71-8810-43b3c9c21d41 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:31:10.289029 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-d7c9cf40-77b9-4e71-8810-43b3c9c21d41 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1" status: 200 len: 1737 microversion: 2.1 time: 0.149593 Sep 27 17:31:10.289593 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 384/743] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:31:10 2022] GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1 => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:31:11.312389 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-a32a4527-0e1f-417b-b8f4-bb758b105915 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:31:11.312913 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-a32a4527-0e1f-417b-b8f4-bb758b105915 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:31:11.320063 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a32a4527-0e1f-417b-b8f4-bb758b105915 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:31:11.320537 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a32a4527-0e1f-417b-b8f4-bb758b105915 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:31:11.320970 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a32a4527-0e1f-417b-b8f4-bb758b105915 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:31:11.321671 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a32a4527-0e1f-417b-b8f4-bb758b105915 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:31:11.322133 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a32a4527-0e1f-417b-b8f4-bb758b105915 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:31:11.322550 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a32a4527-0e1f-417b-b8f4-bb758b105915 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:31:11.448814 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-a32a4527-0e1f-417b-b8f4-bb758b105915 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:31:11.456912 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-a32a4527-0e1f-417b-b8f4-bb758b105915 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1" status: 200 len: 1737 microversion: 2.1 time: 0.148496 Sep 27 17:31:11.457487 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 360/744] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:31:11 2022] GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1 => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:31:12.480695 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-d7788b17-0273-4bc1-96c6-bedb1bfad5d7 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:31:12.481587 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-d7788b17-0273-4bc1-96c6-bedb1bfad5d7 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:31:12.487584 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d7788b17-0273-4bc1-96c6-bedb1bfad5d7 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:31:12.488068 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d7788b17-0273-4bc1-96c6-bedb1bfad5d7 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:31:12.488502 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d7788b17-0273-4bc1-96c6-bedb1bfad5d7 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:31:12.489198 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d7788b17-0273-4bc1-96c6-bedb1bfad5d7 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:31:12.489649 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d7788b17-0273-4bc1-96c6-bedb1bfad5d7 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:31:12.490124 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d7788b17-0273-4bc1-96c6-bedb1bfad5d7 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:31:12.614092 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-d7788b17-0273-4bc1-96c6-bedb1bfad5d7 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:31:12.622285 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-d7788b17-0273-4bc1-96c6-bedb1bfad5d7 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1" status: 200 len: 1737 microversion: 2.1 time: 0.145985 Sep 27 17:31:12.622849 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 385/745] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:31:12 2022] GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1 => generated 1737 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:31:13.645475 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-28451306-1c2d-4386-90ae-894421645201 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:31:13.646097 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-28451306-1c2d-4386-90ae-894421645201 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:31:13.652954 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-28451306-1c2d-4386-90ae-894421645201 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:31:13.653427 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-28451306-1c2d-4386-90ae-894421645201 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:31:13.653858 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-28451306-1c2d-4386-90ae-894421645201 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:31:13.654588 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-28451306-1c2d-4386-90ae-894421645201 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:31:13.655040 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-28451306-1c2d-4386-90ae-894421645201 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:31:13.655460 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-28451306-1c2d-4386-90ae-894421645201 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:31:13.783221 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-28451306-1c2d-4386-90ae-894421645201 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:31:13.792083 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-28451306-1c2d-4386-90ae-894421645201 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1" status: 200 len: 1737 microversion: 2.1 time: 0.150499 Sep 27 17:31:13.792643 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 361/746] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:31:13 2022] GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1 => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:31:14.815352 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-6bb36fa7-1d01-454c-90c3-8d6256852580 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:31:14.815962 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-6bb36fa7-1d01-454c-90c3-8d6256852580 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:31:14.822476 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6bb36fa7-1d01-454c-90c3-8d6256852580 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:31:14.822953 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6bb36fa7-1d01-454c-90c3-8d6256852580 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:31:14.823380 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6bb36fa7-1d01-454c-90c3-8d6256852580 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:31:14.824056 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6bb36fa7-1d01-454c-90c3-8d6256852580 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:31:14.824502 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6bb36fa7-1d01-454c-90c3-8d6256852580 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:31:14.824920 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6bb36fa7-1d01-454c-90c3-8d6256852580 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:31:14.948380 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-6bb36fa7-1d01-454c-90c3-8d6256852580 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:31:14.956538 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-6bb36fa7-1d01-454c-90c3-8d6256852580 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1" status: 200 len: 1737 microversion: 2.1 time: 0.145035 Sep 27 17:31:14.957103 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 386/747] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:31:14 2022] GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1 => generated 1737 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:31:15.980951 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-178f069b-d210-4909-b885-74f713ec0ab9 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:31:15.981864 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-178f069b-d210-4909-b885-74f713ec0ab9 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:31:15.988168 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-178f069b-d210-4909-b885-74f713ec0ab9 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:31:15.988674 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-178f069b-d210-4909-b885-74f713ec0ab9 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:31:15.989108 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-178f069b-d210-4909-b885-74f713ec0ab9 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:31:15.989786 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-178f069b-d210-4909-b885-74f713ec0ab9 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:31:15.990266 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-178f069b-d210-4909-b885-74f713ec0ab9 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:31:15.990687 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-178f069b-d210-4909-b885-74f713ec0ab9 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:31:16.120177 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-178f069b-d210-4909-b885-74f713ec0ab9 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:31:16.128394 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-178f069b-d210-4909-b885-74f713ec0ab9 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1" status: 200 len: 1737 microversion: 2.1 time: 0.151303 Sep 27 17:31:16.128965 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 362/748] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:31:15 2022] GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:31:17.152947 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-d7add8c4-339a-4007-b517-489e8739df27 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:31:17.153549 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-d7add8c4-339a-4007-b517-489e8739df27 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:31:17.159717 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d7add8c4-339a-4007-b517-489e8739df27 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:31:17.160202 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d7add8c4-339a-4007-b517-489e8739df27 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:31:17.160631 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d7add8c4-339a-4007-b517-489e8739df27 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:31:17.161315 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d7add8c4-339a-4007-b517-489e8739df27 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:31:17.161762 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d7add8c4-339a-4007-b517-489e8739df27 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:31:17.162219 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d7add8c4-339a-4007-b517-489e8739df27 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:31:17.288271 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-d7add8c4-339a-4007-b517-489e8739df27 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:31:17.296262 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-d7add8c4-339a-4007-b517-489e8739df27 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1" status: 200 len: 1737 microversion: 2.1 time: 0.147766 Sep 27 17:31:17.296822 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 387/749] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:31:17 2022] GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1 => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:31:18.320213 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-2ab36466-325f-4ffb-8af5-87b1a25a0931 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:31:18.320819 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-2ab36466-325f-4ffb-8af5-87b1a25a0931 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:31:18.327350 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2ab36466-325f-4ffb-8af5-87b1a25a0931 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:31:18.327834 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2ab36466-325f-4ffb-8af5-87b1a25a0931 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:31:18.328266 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2ab36466-325f-4ffb-8af5-87b1a25a0931 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:31:18.328949 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2ab36466-325f-4ffb-8af5-87b1a25a0931 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:31:18.329403 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2ab36466-325f-4ffb-8af5-87b1a25a0931 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:31:18.329829 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2ab36466-325f-4ffb-8af5-87b1a25a0931 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:31:18.457914 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-2ab36466-325f-4ffb-8af5-87b1a25a0931 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:31:18.466842 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-2ab36466-325f-4ffb-8af5-87b1a25a0931 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1" status: 200 len: 1737 microversion: 2.1 time: 0.150544 Sep 27 17:31:18.467413 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 363/750] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:31:18 2022] GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1 => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:31:19.490985 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-77b8381b-fd17-4491-9d85-98c487efc19d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:31:19.491535 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-77b8381b-fd17-4491-9d85-98c487efc19d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:31:19.498101 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-77b8381b-fd17-4491-9d85-98c487efc19d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:31:19.498597 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-77b8381b-fd17-4491-9d85-98c487efc19d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:31:19.499035 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-77b8381b-fd17-4491-9d85-98c487efc19d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:31:19.499725 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-77b8381b-fd17-4491-9d85-98c487efc19d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:31:19.500183 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-77b8381b-fd17-4491-9d85-98c487efc19d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:31:19.500609 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-77b8381b-fd17-4491-9d85-98c487efc19d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:31:19.624825 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-77b8381b-fd17-4491-9d85-98c487efc19d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:31:19.632890 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-77b8381b-fd17-4491-9d85-98c487efc19d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1" status: 200 len: 1737 microversion: 2.1 time: 0.145957 Sep 27 17:31:19.633455 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 388/751] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:31:19 2022] GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1 => generated 1737 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:31:20.656045 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-227297d6-de95-4cc6-98c5-31c505548495 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:31:20.656656 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-227297d6-de95-4cc6-98c5-31c505548495 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:31:20.663127 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-227297d6-de95-4cc6-98c5-31c505548495 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:31:20.663609 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-227297d6-de95-4cc6-98c5-31c505548495 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:31:20.664047 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-227297d6-de95-4cc6-98c5-31c505548495 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:31:20.665371 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-227297d6-de95-4cc6-98c5-31c505548495 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:31:20.665828 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-227297d6-de95-4cc6-98c5-31c505548495 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:31:20.666281 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-227297d6-de95-4cc6-98c5-31c505548495 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:31:20.802232 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-227297d6-de95-4cc6-98c5-31c505548495 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:31:20.810401 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-227297d6-de95-4cc6-98c5-31c505548495 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1" status: 200 len: 1737 microversion: 2.1 time: 0.158200 Sep 27 17:31:20.810974 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 364/752] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:31:20 2022] GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1 => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:31:21.835222 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-68bf8958-6132-4986-b071-9ce3a4a77f2f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:31:21.836022 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-68bf8958-6132-4986-b071-9ce3a4a77f2f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:31:21.842631 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-68bf8958-6132-4986-b071-9ce3a4a77f2f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:31:21.843112 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-68bf8958-6132-4986-b071-9ce3a4a77f2f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:31:21.843547 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-68bf8958-6132-4986-b071-9ce3a4a77f2f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:31:21.844255 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-68bf8958-6132-4986-b071-9ce3a4a77f2f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:31:21.844701 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-68bf8958-6132-4986-b071-9ce3a4a77f2f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:31:21.845117 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-68bf8958-6132-4986-b071-9ce3a4a77f2f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:31:21.978489 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-68bf8958-6132-4986-b071-9ce3a4a77f2f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:31:21.986995 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-68bf8958-6132-4986-b071-9ce3a4a77f2f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1" status: 200 len: 1717 microversion: 2.1 time: 0.156469 Sep 27 17:31:21.987553 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 389/753] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:31:21 2022] GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1 => generated 1717 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:31:22.051051 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-623f6f8e-ef97-4772-9c6f-21da11f15d78 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:31:22.051584 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-623f6f8e-ef97-4772-9c6f-21da11f15d78 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:31:22.057945 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-623f6f8e-ef97-4772-9c6f-21da11f15d78 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:31:22.058458 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-623f6f8e-ef97-4772-9c6f-21da11f15d78 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:31:22.058893 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-623f6f8e-ef97-4772-9c6f-21da11f15d78 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:31:22.059569 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-623f6f8e-ef97-4772-9c6f-21da11f15d78 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:31:22.060020 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-623f6f8e-ef97-4772-9c6f-21da11f15d78 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:31:22.060440 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-623f6f8e-ef97-4772-9c6f-21da11f15d78 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:31:22.139968 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.wsgi [None req-623f6f8e-ef97-4772-9c6f-21da11f15d78 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] HTTP exception thrown: Cannot 'detach_volume' instance ca74fda8-afd6-41f2-8c93-5e8971c645f1 while it is in vm_state rescued Sep 27 17:31:22.141572 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-623f6f8e-ef97-4772-9c6f-21da11f15d78 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Request method failure captured: Sep 27 17:31:22.141572 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: request: DELETE /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1/os-volume_attachments/1fff520c-19e5-4d3a-9712-154acb0ecb10 HTTP/1.1 Sep 27 17:31:22.141572 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Accept: application/json Sep 27 17:31:22.141572 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Accept-Encoding: identity Sep 27 17:31:22.141572 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Connection: close Sep 27 17:31:22.141572 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Content-Length: 0 Sep 27 17:31:22.141572 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Content-Type: application/json Sep 27 17:31:22.141572 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Host: 10.222.0.55 Sep 27 17:31:22.141572 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Openstack-System-Scope: None Sep 27 17:31:22.141572 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: User-Agent: python-urllib3/1.26.12 Sep 27 17:31:22.141572 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Auth-Token: gAAAAABjMzG_oYsxxnSJCNk_tQmKplbiP8h3imjUWos1S01buLQp6CXEw5BhuA_PsGqwDIqMw-PI9rCZuq5MdQs4oib-fTI5tt7xrSk-xzMiyY02qpRv4aq4oNkQg1Pn7OKJFQCc5SdwkX3vwqfdurESDHgoSkrIRuwNUUO4Aup43BAcJ7MoD5U Sep 27 17:31:22.141572 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Domain-Id: None Sep 27 17:31:22.141572 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Domain-Name: None Sep 27 17:31:22.141572 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Identity-Status: Confirmed Sep 27 17:31:22.141572 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Is-Admin-Project: True Sep 27 17:31:22.141572 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Domain-Id: default Sep 27 17:31:22.141572 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Domain-Name: Default Sep 27 17:31:22.141572 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Id: fd5caa5782e74721a4c2991524182668 Sep 27 17:31:22.141572 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1705185754 Sep 27 17:31:22.141572 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Role: reader,member Sep 27 17:31:22.141572 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Roles: reader,member Sep 27 17:31:22.143278 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/fd5caa5782e74721a4c2991524182668"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_fd5caa5782e74721a4c2991524182668", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/fd5caa5782e74721a4c2991524182668"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/fd5caa5782e74721a4c2991524182668"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 27 17:31:22.143278 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1705185754 Sep 27 17:31:22.143278 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Tenant-Id: fd5caa5782e74721a4c2991524182668 Sep 27 17:31:22.143278 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1705185754 Sep 27 17:31:22.143278 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User: tempest-ServerRescueNegativeTestJSON-1705185754-project Sep 27 17:31:22.143278 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Domain-Id: default Sep 27 17:31:22.143278 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Domain-Name: Default Sep 27 17:31:22.143278 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Id: d23a498bde00483c8fdd68dcde975e5d Sep 27 17:31:22.143278 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1705185754-project Sep 27 17:31:22.143278 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: method: > Sep 27 17:31:22.143278 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: exception: Cannot 'detach_volume' instance ca74fda8-afd6-41f2-8c93-5e8971c645f1 while it is in vm_state rescued Sep 27 17:31:22.144245 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: action_args: {'server_id': 'ca74fda8-afd6-41f2-8c93-5e8971c645f1', 'id': '1fff520c-19e5-4d3a-9712-154acb0ecb10'} Sep 27 17:31:22.144245 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 17:31:22.144245 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:31:22.144245 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 27 17:31:22.144245 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 27 17:31:22.144245 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 27 17:31:22.144245 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 27 17:31:22.144245 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 27 17:31:22.144245 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 27 17:31:22.144245 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ca74fda8-afd6-41f2-8c93-5e8971c645f1 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 27 17:31:22.144245 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:31:22.144245 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:31:22.144245 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:31:22.144245 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:31:22.144245 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:31:22.144245 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:31:22.144245 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 17:31:22.144245 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 17:31:22.144245 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 17:31:22.144245 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 17:31:22.145796 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 27 17:31:22.145796 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 27 17:31:22.145796 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 27 17:31:22.145796 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 27 17:31:22.145796 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance ca74fda8-afd6-41f2-8c93-5e8971c645f1 while it is in vm_state rescued Sep 27 17:31:22.145796 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:31:22.145796 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:31:22.145796 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:31:22.145796 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:31:22.145796 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:31:22.145796 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:31:22.145796 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 17:31:22.145796 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 17:31:22.145796 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance ca74fda8-afd6-41f2-8c93-5e8971c645f1 while it is in vm_state rescued Sep 27 17:31:22.145796 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:31:22.145796 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-623f6f8e-ef97-4772-9c6f-21da11f15d78 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Returning 409 to user: Cannot 'detach_volume' instance ca74fda8-afd6-41f2-8c93-5e8971c645f1 while it is in vm_state rescued {{(pid=120415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 17:31:22.147420 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-623f6f8e-ef97-4772-9c6f-21da11f15d78 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "DELETE /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1/os-volume_attachments/1fff520c-19e5-4d3a-9712-154acb0ecb10" status: 409 len: 152 microversion: 2.1 time: 0.095924 Sep 27 17:31:22.147420 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 365/754] 10.222.0.55 () {58 vars in 1416 bytes} [Tue Sep 27 17:31:22 2022] DELETE /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1/os-volume_attachments/1fff520c-19e5-4d3a-9712-154acb0ecb10 => generated 152 bytes in 97 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 27 17:31:22.152278 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-6d92b057-1759-402a-a5c3-3cfcfce29814 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:31:22.152805 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-6d92b057-1759-402a-a5c3-3cfcfce29814 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:31:22.158682 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6d92b057-1759-402a-a5c3-3cfcfce29814 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:31:22.159162 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6d92b057-1759-402a-a5c3-3cfcfce29814 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:31:22.159833 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6d92b057-1759-402a-a5c3-3cfcfce29814 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:31:22.160737 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6d92b057-1759-402a-a5c3-3cfcfce29814 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:31:22.161378 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6d92b057-1759-402a-a5c3-3cfcfce29814 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:31:22.161992 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6d92b057-1759-402a-a5c3-3cfcfce29814 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:31:22.228200 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-6d92b057-1759-402a-a5c3-3cfcfce29814 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "POST /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1/action" status: 202 len: 0 microversion: 2.1 time: 0.079934 Sep 27 17:31:22.228740 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 390/755] 10.222.0.55 () {60 vars in 1278 bytes} [Tue Sep 27 17:31:22 2022] POST /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 17:31:22.237057 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-41d220ed-4184-4064-9b43-6218075d2117 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:31:22.237656 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-41d220ed-4184-4064-9b43-6218075d2117 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:31:22.243910 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-41d220ed-4184-4064-9b43-6218075d2117 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:31:22.244382 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-41d220ed-4184-4064-9b43-6218075d2117 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:31:22.244806 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-41d220ed-4184-4064-9b43-6218075d2117 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:31:22.245476 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-41d220ed-4184-4064-9b43-6218075d2117 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:31:22.245921 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-41d220ed-4184-4064-9b43-6218075d2117 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:31:22.246363 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-41d220ed-4184-4064-9b43-6218075d2117 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:31:22.388343 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-41d220ed-4184-4064-9b43-6218075d2117 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:31:22.396777 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-41d220ed-4184-4064-9b43-6218075d2117 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1" status: 200 len: 1725 microversion: 2.1 time: 0.163527 Sep 27 17:31:22.397350 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 366/756] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:31:22 2022] GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1 => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:31:23.422334 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-56d30f0b-e499-4edb-a9b6-0a6de3ae0e19 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:31:23.422979 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-56d30f0b-e499-4edb-a9b6-0a6de3ae0e19 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:31:23.429149 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-56d30f0b-e499-4edb-a9b6-0a6de3ae0e19 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:31:23.429632 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-56d30f0b-e499-4edb-a9b6-0a6de3ae0e19 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:31:23.430087 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-56d30f0b-e499-4edb-a9b6-0a6de3ae0e19 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:31:23.430778 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-56d30f0b-e499-4edb-a9b6-0a6de3ae0e19 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:31:23.431236 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-56d30f0b-e499-4edb-a9b6-0a6de3ae0e19 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:31:23.431663 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-56d30f0b-e499-4edb-a9b6-0a6de3ae0e19 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:31:23.561927 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-56d30f0b-e499-4edb-a9b6-0a6de3ae0e19 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:31:23.570202 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-56d30f0b-e499-4edb-a9b6-0a6de3ae0e19 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1" status: 200 len: 1725 microversion: 2.1 time: 0.152292 Sep 27 17:31:23.570763 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 391/757] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:31:23 2022] GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:31:24.594548 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-aa3af7c4-93f9-443c-9000-1722c8a73393 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:31:24.595163 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-aa3af7c4-93f9-443c-9000-1722c8a73393 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:31:24.601552 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-aa3af7c4-93f9-443c-9000-1722c8a73393 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:31:24.602031 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-aa3af7c4-93f9-443c-9000-1722c8a73393 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:31:24.602512 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-aa3af7c4-93f9-443c-9000-1722c8a73393 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:31:24.603202 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-aa3af7c4-93f9-443c-9000-1722c8a73393 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:31:24.603657 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-aa3af7c4-93f9-443c-9000-1722c8a73393 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:31:24.604082 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-aa3af7c4-93f9-443c-9000-1722c8a73393 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:31:24.732433 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-aa3af7c4-93f9-443c-9000-1722c8a73393 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:31:24.734724 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell1:SELECT=100 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:31:24.741666 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-aa3af7c4-93f9-443c-9000-1722c8a73393 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1" status: 200 len: 1725 microversion: 2.1 time: 0.151000 Sep 27 17:31:24.742269 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 367/758] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:31:24 2022] GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:31:25.765584 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-86f235ea-7d53-4d30-8ff1-2457e8b0e643 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:31:25.766222 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-86f235ea-7d53-4d30-8ff1-2457e8b0e643 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:31:25.772206 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-86f235ea-7d53-4d30-8ff1-2457e8b0e643 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:31:25.772678 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-86f235ea-7d53-4d30-8ff1-2457e8b0e643 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:31:25.773105 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-86f235ea-7d53-4d30-8ff1-2457e8b0e643 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:31:25.774309 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-86f235ea-7d53-4d30-8ff1-2457e8b0e643 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:31:25.774761 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-86f235ea-7d53-4d30-8ff1-2457e8b0e643 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:31:25.775175 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-86f235ea-7d53-4d30-8ff1-2457e8b0e643 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:31:25.907356 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-86f235ea-7d53-4d30-8ff1-2457e8b0e643 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:31:25.918101 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-86f235ea-7d53-4d30-8ff1-2457e8b0e643 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1" status: 200 len: 1725 microversion: 2.1 time: 0.156228 Sep 27 17:31:25.918678 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 392/759] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:31:25 2022] GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:31:26.940924 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-d475bd8e-a0cd-471d-9408-21193419208d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:31:26.941462 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-d475bd8e-a0cd-471d-9408-21193419208d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:31:26.947820 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d475bd8e-a0cd-471d-9408-21193419208d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:31:26.948305 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d475bd8e-a0cd-471d-9408-21193419208d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:31:26.948746 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d475bd8e-a0cd-471d-9408-21193419208d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:31:26.949435 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d475bd8e-a0cd-471d-9408-21193419208d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:31:26.949890 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d475bd8e-a0cd-471d-9408-21193419208d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:31:26.950345 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d475bd8e-a0cd-471d-9408-21193419208d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:31:27.076448 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-d475bd8e-a0cd-471d-9408-21193419208d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:31:27.084480 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-d475bd8e-a0cd-471d-9408-21193419208d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1" status: 200 len: 1731 microversion: 2.1 time: 0.147533 Sep 27 17:31:27.085045 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 368/760] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:31:26 2022] GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1 => generated 1731 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:31:27.107970 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-86b23811-0400-4a1f-b72f-04b03485af4a tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:31:27.108476 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-86b23811-0400-4a1f-b72f-04b03485af4a tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:31:27.114205 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-86b23811-0400-4a1f-b72f-04b03485af4a tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:31:27.114676 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-86b23811-0400-4a1f-b72f-04b03485af4a tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:31:27.115105 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-86b23811-0400-4a1f-b72f-04b03485af4a tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:31:27.115775 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-86b23811-0400-4a1f-b72f-04b03485af4a tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:31:27.116218 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-86b23811-0400-4a1f-b72f-04b03485af4a tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:31:27.116630 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-86b23811-0400-4a1f-b72f-04b03485af4a tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:31:27.192001 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-86b23811-0400-4a1f-b72f-04b03485af4a tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.087981 Sep 27 17:31:27.192540 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 393/761] 10.222.0.55 () {58 vars in 1275 bytes} [Tue Sep 27 17:31:27 2022] GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 17:31:28.056566 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [req-3436684c-6486-40fe-a3c1-778a635e657f req-a34171ef-b866-4ad1-8705-63ff14feeb03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca74fda8-afd6-41f2-8c93-5e8971c645f1", "tag": "4f5f0e59-cdc1-4e3d-9aac-a193fec519cd"}]} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:31:28.069563 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-3436684c-6486-40fe-a3c1-778a635e657f req-a34171ef-b866-4ad1-8705-63ff14feeb03 service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:31:28.070170 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-3436684c-6486-40fe-a3c1-778a635e657f req-a34171ef-b866-4ad1-8705-63ff14feeb03 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:31:28.070673 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-3436684c-6486-40fe-a3c1-778a635e657f req-a34171ef-b866-4ad1-8705-63ff14feeb03 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:31:28.082831 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.compute.server_external_events [req-3436684c-6486-40fe-a3c1-778a635e657f req-a34171ef-b866-4ad1-8705-63ff14feeb03 service nova] Creating event network-changed:4f5f0e59-cdc1-4e3d-9aac-a193fec519cd for instance ca74fda8-afd6-41f2-8c93-5e8971c645f1 on hv-cinder-84914 Sep 27 17:31:28.087936 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [req-3436684c-6486-40fe-a3c1-778a635e657f req-a34171ef-b866-4ad1-8705-63ff14feeb03 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035694 Sep 27 17:31:28.088577 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 369/762] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:31:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:31:30.101961 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [req-3b45d777-9c19-4f23-81da-71815b2903db req-9ab7b273-fba1-4486-bf6c-8ee07930870b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca74fda8-afd6-41f2-8c93-5e8971c645f1", "tag": "4f5f0e59-cdc1-4e3d-9aac-a193fec519cd"}]} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:31:30.112234 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-3b45d777-9c19-4f23-81da-71815b2903db req-9ab7b273-fba1-4486-bf6c-8ee07930870b service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:31:30.112711 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-3b45d777-9c19-4f23-81da-71815b2903db req-9ab7b273-fba1-4486-bf6c-8ee07930870b service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:31:30.113145 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-3b45d777-9c19-4f23-81da-71815b2903db req-9ab7b273-fba1-4486-bf6c-8ee07930870b service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:31:30.124008 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.compute.server_external_events [req-3b45d777-9c19-4f23-81da-71815b2903db req-9ab7b273-fba1-4486-bf6c-8ee07930870b service nova] Creating event network-changed:4f5f0e59-cdc1-4e3d-9aac-a193fec519cd for instance ca74fda8-afd6-41f2-8c93-5e8971c645f1 on hv-cinder-84914 Sep 27 17:31:30.129064 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [req-3b45d777-9c19-4f23-81da-71815b2903db req-9ab7b273-fba1-4486-bf6c-8ee07930870b service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030748 Sep 27 17:31:30.129704 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 394/763] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:31:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:32:14.394264 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_api:SELECT=43 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:32:14.395086 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell1:SELECT=9 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:32:14.400669 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-d551d09b-fdf8-4c74-8a27-3db1a0badd6a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:32:14.401397 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-d551d09b-fdf8-4c74-8a27-3db1a0badd6a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:32:14.409573 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d551d09b-fdf8-4c74-8a27-3db1a0badd6a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:14.410098 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d551d09b-fdf8-4c74-8a27-3db1a0badd6a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:14.410524 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d551d09b-fdf8-4c74-8a27-3db1a0badd6a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:14.411228 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d551d09b-fdf8-4c74-8a27-3db1a0badd6a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:14.411671 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d551d09b-fdf8-4c74-8a27-3db1a0badd6a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:14.412097 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d551d09b-fdf8-4c74-8a27-3db1a0badd6a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:14.445399 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-d551d09b-fdf8-4c74-8a27-3db1a0badd6a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee/os-volume_attachments/fa867908-9194-4f19-90c5-c3c4802039fc" status: 200 len: 194 microversion: 2.20 time: 0.052964 Sep 27 17:32:14.445954 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 370/764] 10.222.0.55 () {60 vars in 1454 bytes} [Tue Sep 27 17:32:14 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee/os-volume_attachments/fa867908-9194-4f19-90c5-c3c4802039fc => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 17:32:14.512878 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_api:SELECT=35 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:32:14.514364 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:32:14.515706 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 27 17:32:14.515871 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Tue Sep 27 17:32:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee/os-volume_attachments/fa867908-9194-4f19-90c5-c3c4802039fc (ip 10.222.0.55) !!! Sep 27 17:32:14.520631 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-77186c5d-f57d-43ca-aec0-6b8a44c2f619 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:32:14.521215 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-77186c5d-f57d-43ca-aec0-6b8a44c2f619 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:32:14.529971 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-77186c5d-f57d-43ca-aec0-6b8a44c2f619 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:14.530486 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-77186c5d-f57d-43ca-aec0-6b8a44c2f619 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:14.530953 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-77186c5d-f57d-43ca-aec0-6b8a44c2f619 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:14.531645 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-77186c5d-f57d-43ca-aec0-6b8a44c2f619 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:14.532101 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-77186c5d-f57d-43ca-aec0-6b8a44c2f619 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:14.532525 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-77186c5d-f57d-43ca-aec0-6b8a44c2f619 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:14.664666 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.objects.instance [None req-77186c5d-f57d-43ca-aec0-6b8a44c2f619 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lazy-loading 'services' on Instance uuid d209f2ce-43c8-422a-a703-cdc9a9fb5cee {{(pid=120416) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 17:32:14.782296 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-77186c5d-f57d-43ca-aec0-6b8a44c2f619 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "DELETE /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee/os-volume_attachments/fa867908-9194-4f19-90c5-c3c4802039fc" status: 202 len: 0 microversion: 2.20 time: 0.270258 Sep 27 17:32:14.782947 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 395/765] 10.222.0.55 () {60 vars in 1457 bytes} [Tue Sep 27 17:32:14 2022] DELETE /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee/os-volume_attachments/fa867908-9194-4f19-90c5-c3c4802039fc => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 27 17:32:14.793057 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-952ead7b-d94d-4c83-a200-740bac40dbb9 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:32:14.796557 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-952ead7b-d94d-4c83-a200-740bac40dbb9 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:32:14.804502 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-952ead7b-d94d-4c83-a200-740bac40dbb9 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:14.805004 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-952ead7b-d94d-4c83-a200-740bac40dbb9 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:14.805653 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-952ead7b-d94d-4c83-a200-740bac40dbb9 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:14.806554 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-952ead7b-d94d-4c83-a200-740bac40dbb9 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:14.807003 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-952ead7b-d94d-4c83-a200-740bac40dbb9 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:14.807567 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-952ead7b-d94d-4c83-a200-740bac40dbb9 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:14.843636 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-952ead7b-d94d-4c83-a200-740bac40dbb9 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055588 Sep 27 17:32:14.844469 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 371/766] 10.222.0.55 () {60 vars in 1343 bytes} [Tue Sep 27 17:32:14 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 17:32:15.857792 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-dc22e996-e7a1-4ca6-84f0-73101ac94083 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:32:15.860695 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-dc22e996-e7a1-4ca6-84f0-73101ac94083 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:32:15.866773 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-dc22e996-e7a1-4ca6-84f0-73101ac94083 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:15.867320 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-dc22e996-e7a1-4ca6-84f0-73101ac94083 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:15.867766 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-dc22e996-e7a1-4ca6-84f0-73101ac94083 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:15.868503 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-dc22e996-e7a1-4ca6-84f0-73101ac94083 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:15.868947 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-dc22e996-e7a1-4ca6-84f0-73101ac94083 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:15.869381 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-dc22e996-e7a1-4ca6-84f0-73101ac94083 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:15.898662 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-dc22e996-e7a1-4ca6-84f0-73101ac94083 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045887 Sep 27 17:32:15.899195 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 396/767] 10.222.0.55 () {60 vars in 1343 bytes} [Tue Sep 27 17:32:15 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 17:32:16.911077 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-f3f606a0-78db-4016-96f3-a42012cc4726 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:32:16.913210 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-f3f606a0-78db-4016-96f3-a42012cc4726 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:32:16.919535 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f3f606a0-78db-4016-96f3-a42012cc4726 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:16.920010 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f3f606a0-78db-4016-96f3-a42012cc4726 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:16.920441 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f3f606a0-78db-4016-96f3-a42012cc4726 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:16.921640 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f3f606a0-78db-4016-96f3-a42012cc4726 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:16.922102 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f3f606a0-78db-4016-96f3-a42012cc4726 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:16.922540 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f3f606a0-78db-4016-96f3-a42012cc4726 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:16.950652 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-f3f606a0-78db-4016-96f3-a42012cc4726 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043519 Sep 27 17:32:16.951189 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 372/768] 10.222.0.55 () {60 vars in 1343 bytes} [Tue Sep 27 17:32:16 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:32:17.019850 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-5ccf30f4-240a-4e61-9092-2610ec26514e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:32:17.020410 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-5ccf30f4-240a-4e61-9092-2610ec26514e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:32:17.026369 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5ccf30f4-240a-4e61-9092-2610ec26514e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:17.026851 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5ccf30f4-240a-4e61-9092-2610ec26514e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:17.027294 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5ccf30f4-240a-4e61-9092-2610ec26514e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:17.027980 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5ccf30f4-240a-4e61-9092-2610ec26514e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:17.028433 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5ccf30f4-240a-4e61-9092-2610ec26514e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:17.028857 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5ccf30f4-240a-4e61-9092-2610ec26514e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:17.056141 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-5ccf30f4-240a-4e61-9092-2610ec26514e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Going to try to terminate instance {{(pid=120416) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 17:32:17.141472 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-5ccf30f4-240a-4e61-9092-2610ec26514e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "DELETE /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 204 len: 0 microversion: 2.20 time: 0.125350 Sep 27 17:32:17.142295 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 397/769] 10.222.0.55 () {60 vars in 1280 bytes} [Tue Sep 27 17:32:17 2022] DELETE /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 27 17:32:17.150569 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-f67ad689-d325-435a-ad92-ebeecf1efe47 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:32:17.151261 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-f67ad689-d325-435a-ad92-ebeecf1efe47 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:32:17.157652 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f67ad689-d325-435a-ad92-ebeecf1efe47 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:17.158155 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f67ad689-d325-435a-ad92-ebeecf1efe47 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:17.158600 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f67ad689-d325-435a-ad92-ebeecf1efe47 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:17.159280 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f67ad689-d325-435a-ad92-ebeecf1efe47 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:17.159729 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f67ad689-d325-435a-ad92-ebeecf1efe47 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:17.160568 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f67ad689-d325-435a-ad92-ebeecf1efe47 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:17.292195 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-f67ad689-d325-435a-ad92-ebeecf1efe47 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:32:17.300883 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-f67ad689-d325-435a-ad92-ebeecf1efe47 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:32:17.302410 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-f67ad689-d325-435a-ad92-ebeecf1efe47 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:32:17.303578 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-f67ad689-d325-435a-ad92-ebeecf1efe47 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1722 microversion: 2.20 time: 0.156992 Sep 27 17:32:17.304136 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 373/770] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:32:17 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 17:32:18.329795 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-20d9edd7-4009-42f7-a713-c1abb69cad74 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:32:18.330518 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-20d9edd7-4009-42f7-a713-c1abb69cad74 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:32:18.336361 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-20d9edd7-4009-42f7-a713-c1abb69cad74 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:18.336831 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-20d9edd7-4009-42f7-a713-c1abb69cad74 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:18.337254 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-20d9edd7-4009-42f7-a713-c1abb69cad74 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:18.337929 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-20d9edd7-4009-42f7-a713-c1abb69cad74 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:18.338415 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-20d9edd7-4009-42f7-a713-c1abb69cad74 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:18.338827 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-20d9edd7-4009-42f7-a713-c1abb69cad74 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:18.464651 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-20d9edd7-4009-42f7-a713-c1abb69cad74 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:32:18.472609 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-20d9edd7-4009-42f7-a713-c1abb69cad74 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:32:18.474065 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-20d9edd7-4009-42f7-a713-c1abb69cad74 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:32:18.475236 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-20d9edd7-4009-42f7-a713-c1abb69cad74 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1722 microversion: 2.20 time: 0.149695 Sep 27 17:32:18.475795 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 398/771] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:32:18 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:32:19.500907 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-f9d9ea2e-2ec3-42de-91d1-f29ac7548b0c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:32:19.502167 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-f9d9ea2e-2ec3-42de-91d1-f29ac7548b0c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:32:19.508807 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f9d9ea2e-2ec3-42de-91d1-f29ac7548b0c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:19.509298 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f9d9ea2e-2ec3-42de-91d1-f29ac7548b0c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:19.510285 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f9d9ea2e-2ec3-42de-91d1-f29ac7548b0c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:19.510575 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f9d9ea2e-2ec3-42de-91d1-f29ac7548b0c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:19.511035 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f9d9ea2e-2ec3-42de-91d1-f29ac7548b0c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:19.511455 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f9d9ea2e-2ec3-42de-91d1-f29ac7548b0c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:19.720572 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-f9d9ea2e-2ec3-42de-91d1-f29ac7548b0c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:32:19.728563 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-f9d9ea2e-2ec3-42de-91d1-f29ac7548b0c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:32:19.730019 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-f9d9ea2e-2ec3-42de-91d1-f29ac7548b0c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:32:19.731461 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-f9d9ea2e-2ec3-42de-91d1-f29ac7548b0c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1722 microversion: 2.20 time: 0.234370 Sep 27 17:32:19.732020 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 374/772] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:32:19 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1722 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:32:20.622454 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [req-b657c74c-32b7-41ad-829c-4ae580c4e4dc req-c203c24e-7461-4628-b61b-2d2fe6071806 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d209f2ce-43c8-422a-a703-cdc9a9fb5cee", "name": "network-vif-deleted", "tag": "5a5276d6-632d-4adb-a46b-8471fb0bf332"}]} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:32:20.633346 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-b657c74c-32b7-41ad-829c-4ae580c4e4dc req-c203c24e-7461-4628-b61b-2d2fe6071806 service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:20.634187 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-b657c74c-32b7-41ad-829c-4ae580c4e4dc req-c203c24e-7461-4628-b61b-2d2fe6071806 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:20.634828 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-b657c74c-32b7-41ad-829c-4ae580c4e4dc req-c203c24e-7461-4628-b61b-2d2fe6071806 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:20.650366 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.compute.server_external_events [req-b657c74c-32b7-41ad-829c-4ae580c4e4dc req-c203c24e-7461-4628-b61b-2d2fe6071806 service nova] Creating event network-vif-deleted:5a5276d6-632d-4adb-a46b-8471fb0bf332 for instance d209f2ce-43c8-422a-a703-cdc9a9fb5cee on hv-cinder-84914 Sep 27 17:32:20.656724 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [req-b657c74c-32b7-41ad-829c-4ae580c4e4dc req-c203c24e-7461-4628-b61b-2d2fe6071806 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037754 Sep 27 17:32:20.657774 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 399/773] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:32:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:32:20.759837 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-785a4eed-5832-4134-979a-0e01d2ec83d2 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:32:20.761213 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-785a4eed-5832-4134-979a-0e01d2ec83d2 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:32:20.770055 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-785a4eed-5832-4134-979a-0e01d2ec83d2 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:20.770922 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-785a4eed-5832-4134-979a-0e01d2ec83d2 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:20.771649 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-785a4eed-5832-4134-979a-0e01d2ec83d2 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:20.772475 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-785a4eed-5832-4134-979a-0e01d2ec83d2 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:20.773139 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-785a4eed-5832-4134-979a-0e01d2ec83d2 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:20.773765 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-785a4eed-5832-4134-979a-0e01d2ec83d2 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:20.825767 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-785a4eed-5832-4134-979a-0e01d2ec83d2 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:20.826660 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-785a4eed-5832-4134-979a-0e01d2ec83d2 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:20.828168 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-785a4eed-5832-4134-979a-0e01d2ec83d2 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:20.828929 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.objects.instance [None req-785a4eed-5832-4134-979a-0e01d2ec83d2 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lazy-loading 'fault' on Instance uuid d209f2ce-43c8-422a-a703-cdc9a9fb5cee {{(pid=120415) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 17:32:20.878906 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-785a4eed-5832-4134-979a-0e01d2ec83d2 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:32:20.888184 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-785a4eed-5832-4134-979a-0e01d2ec83d2 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:32:20.890612 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-785a4eed-5832-4134-979a-0e01d2ec83d2 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:32:20.892004 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-785a4eed-5832-4134-979a-0e01d2ec83d2 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 200 len: 1371 microversion: 2.20 time: 0.138044 Sep 27 17:32:20.892736 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 375/774] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:32:20 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 1371 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:32:21.918906 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-ca9b0c8f-c3ed-46e0-8c92-6aef602439bc tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:32:21.919609 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-ca9b0c8f-c3ed-46e0-8c92-6aef602439bc tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:32:21.925990 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ca9b0c8f-c3ed-46e0-8c92-6aef602439bc tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:21.926505 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ca9b0c8f-c3ed-46e0-8c92-6aef602439bc tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:21.926941 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ca9b0c8f-c3ed-46e0-8c92-6aef602439bc tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:21.927630 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ca9b0c8f-c3ed-46e0-8c92-6aef602439bc tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:21.928083 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ca9b0c8f-c3ed-46e0-8c92-6aef602439bc tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:21.928522 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ca9b0c8f-c3ed-46e0-8c92-6aef602439bc tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:21.944617 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.wsgi [None req-ca9b0c8f-c3ed-46e0-8c92-6aef602439bc tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] HTTP exception thrown: Instance d209f2ce-43c8-422a-a703-cdc9a9fb5cee could not be found. Sep 27 17:32:21.946274 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-ca9b0c8f-c3ed-46e0-8c92-6aef602439bc tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Request method failure captured: Sep 27 17:32:21.946274 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: request: GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee HTTP/1.1 Sep 27 17:32:21.946274 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Accept: application/json Sep 27 17:32:21.946274 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Accept-Encoding: identity Sep 27 17:32:21.946274 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Connection: close Sep 27 17:32:21.946274 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Content-Length: 0 Sep 27 17:32:21.946274 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Content-Type: application/json Sep 27 17:32:21.946274 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Host: 10.222.0.55 Sep 27 17:32:21.946274 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Openstack-System-Scope: None Sep 27 17:32:21.946274 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: User-Agent: python-urllib3/1.26.12 Sep 27 17:32:21.946274 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Auth-Token: gAAAAABjMzHAUiO-mPVUnCvy6QI7Oq1nDlIAD_-_evMkfe_qxqArGHJxRGlzShHUdps_laFtBISooFJxpfzb2M3mHoK6u-tIvYODDQoBNgF0Mt4SBb9l9NLNg2qWl-CrRmghfQ7kn6fXQei6ULZGIWjiGAHEMPr7t58rdN50BvMp8i3LNg7Gytw Sep 27 17:32:21.946274 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Domain-Id: None Sep 27 17:32:21.946274 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Domain-Name: None Sep 27 17:32:21.946274 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Identity-Status: Confirmed Sep 27 17:32:21.946274 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Is-Admin-Project: True Sep 27 17:32:21.946274 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Openstack-Nova-Api-Version: 2.20 Sep 27 17:32:21.946274 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Domain-Id: default Sep 27 17:32:21.946274 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Domain-Name: Default Sep 27 17:32:21.946274 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Id: 37e99b06d94d4893963a88cd5333ec5b Sep 27 17:32:21.946274 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1168253535 Sep 27 17:32:21.946274 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Role: reader,member Sep 27 17:32:21.946274 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Roles: reader,member Sep 27 17:32:21.948066 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/37e99b06d94d4893963a88cd5333ec5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_37e99b06d94d4893963a88cd5333ec5b", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/37e99b06d94d4893963a88cd5333ec5b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/37e99b06d94d4893963a88cd5333ec5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 27 17:32:21.948066 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1168253535 Sep 27 17:32:21.948066 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Tenant-Id: 37e99b06d94d4893963a88cd5333ec5b Sep 27 17:32:21.948066 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1168253535 Sep 27 17:32:21.948066 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User: tempest-AttachVolumeShelveTestJSON-1168253535-project Sep 27 17:32:21.948066 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Domain-Id: default Sep 27 17:32:21.948066 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Domain-Name: Default Sep 27 17:32:21.948066 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Id: 1dde550901f04ea695b85db4e41d9628 Sep 27 17:32:21.948066 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1168253535-project Sep 27 17:32:21.948066 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: method: > Sep 27 17:32:21.948066 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: exception: Instance d209f2ce-43c8-422a-a703-cdc9a9fb5cee could not be found. Sep 27 17:32:21.948066 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: action_args: {'id': 'd209f2ce-43c8-422a-a703-cdc9a9fb5cee'} Sep 27 17:32:21.949028 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 17:32:21.949028 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:32:21.949028 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 17:32:21.949028 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 17:32:21.949028 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 17:32:21.949028 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 17:32:21.949028 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 17:32:21.949028 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 17:32:21.949028 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 17:32:21.949028 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 17:32:21.949028 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d209f2ce-43c8-422a-a703-cdc9a9fb5cee could not be found. Sep 27 17:32:21.949028 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:32:21.949028 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:32:21.949028 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:32:21.949028 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:32:21.949028 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:32:21.949028 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:32:21.949028 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 17:32:21.949028 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 17:32:21.949028 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 17:32:21.951038 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 17:32:21.951038 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 17:32:21.951038 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 17:32:21.951038 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 17:32:21.951038 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 17:32:21.951038 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 17:32:21.951038 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 17:32:21.951038 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d209f2ce-43c8-422a-a703-cdc9a9fb5cee could not be found. Sep 27 17:32:21.951038 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:32:21.951038 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:32:21.951038 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:32:21.951038 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:32:21.951038 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:32:21.951038 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:32:21.951038 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 17:32:21.951038 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 17:32:21.951038 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d209f2ce-43c8-422a-a703-cdc9a9fb5cee could not be found. Sep 27 17:32:21.951038 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:32:21.953154 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-ca9b0c8f-c3ed-46e0-8c92-6aef602439bc tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Returning 404 to user: Instance d209f2ce-43c8-422a-a703-cdc9a9fb5cee could not be found. {{(pid=120416) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 17:32:21.953154 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-ca9b0c8f-c3ed-46e0-8c92-6aef602439bc tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 404 len: 111 microversion: 2.20 time: 0.033212 Sep 27 17:32:21.953154 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 400/775] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:32:21 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 27 17:32:21.959172 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-4c9d8d2c-2cc1-4d5a-b6b7-7c96c2d1c393 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '.version_select at 0x7fe72497f820>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:32:21.978807 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-4c9d8d2c-2cc1-4d5a-b6b7-7c96c2d1c393 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-644058286" status: 204 len: 0 microversion: 2.20 time: 0.023892 Sep 27 17:32:21.979369 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 376/776] 10.222.0.55 () {60 vars in 1259 bytes} [Tue Sep 27 17:32:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-644058286 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 27 17:32:22.635440 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-6f8710be-637a-419d-8d31-0cc47655d252 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Action: 'create', calling method: .version_select at 0x7fe724db2c10>, body: {"keypair": {"name": "tempest-keypair-2115451150", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMv/Q/pSZWDj00AtsA9vvZagjmAzYxLxdvbfTnMtFB8r1LJWKKUnzA0GrwA7ndfoy0X1/+ez2TpuDXwW/FbwQbcUoYh8aiXTbyYQiBjFFy7VHrqrDAC01995B/v19N0Xyw=="}} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:32:22.650679 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.quota [None req-6f8710be-637a-419d-8d31-0cc47655d252 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Getting quotas for project 37e99b06d94d4893963a88cd5333ec5b. Resources: {'key_pairs'} {{(pid=120416) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 17:32:22.654444 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.quota [None req-6f8710be-637a-419d-8d31-0cc47655d252 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Getting quotas for user 1dde550901f04ea695b85db4e41d9628 and project 37e99b06d94d4893963a88cd5333ec5b. Resources: {'key_pairs'} {{(pid=120416) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 17:32:22.680879 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-6f8710be-637a-419d-8d31-0cc47655d252 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.049357 Sep 27 17:32:22.681474 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 401/777] 10.222.0.55 () {62 vars in 1200 bytes} [Tue Sep 27 17:32:22 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 51 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 27 17:32:23.948023 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-1d55eead-be82-4e4e-98d6-273edb2f6e40 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1653620465", "imageRef": "9355bd92-0a49-42cd-b079-ff9f0d54b91b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "39cd2f9e-bd9d-49da-a5a0-71ace359ff57"}], "security_groups": [{"name": "tempest-securitygroup--535122076"}], "key_name": "tempest-keypair-2115451150", "user_data": "}} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:32:24.053145 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.network.neutron [None req-1d55eead-be82-4e4e-98d6-273edb2f6e40 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] validate_networks() for [('39cd2f9e-bd9d-49da-a5a0-71ace359ff57', None, None, None, None, None)] {{(pid=120415) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 17:32:24.419329 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-1d55eead-be82-4e4e-98d6-273edb2f6e40 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Flavor limits 0:0:0 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 17:32:24.419752 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-1d55eead-be82-4e4e-98d6-273edb2f6e40 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Image limits 0:0:0 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 17:32:24.420255 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-1d55eead-be82-4e4e-98d6-273edb2f6e40 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Flavor pref 0:0:0 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 17:32:24.420661 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-1d55eead-be82-4e4e-98d6-273edb2f6e40 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Image pref 0:0:0 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 17:32:24.421067 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-1d55eead-be82-4e4e-98d6-273edb2f6e40 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 17:32:24.429657 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1d55eead-be82-4e4e-98d6-273edb2f6e40 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:24.430159 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1d55eead-be82-4e4e-98d6-273edb2f6e40 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:24.430593 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1d55eead-be82-4e4e-98d6-273edb2f6e40 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:24.431311 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1d55eead-be82-4e4e-98d6-273edb2f6e40 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:24.431760 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1d55eead-be82-4e4e-98d6-273edb2f6e40 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:24.432179 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1d55eead-be82-4e4e-98d6-273edb2f6e40 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:24.450829 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.quota [None req-1d55eead-be82-4e4e-98d6-273edb2f6e40 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Getting quotas for project 37e99b06d94d4893963a88cd5333ec5b. Resources: {'cores', 'ram', 'instances'} {{(pid=120415) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 17:32:24.455231 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.quota [None req-1d55eead-be82-4e4e-98d6-273edb2f6e40 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Getting quotas for user 1dde550901f04ea695b85db4e41d9628 and project 37e99b06d94d4893963a88cd5333ec5b. Resources: {'cores', 'ram', 'instances'} {{(pid=120415) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 17:32:24.465951 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-1d55eead-be82-4e4e-98d6-273edb2f6e40 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Going to run 1 instances... {{(pid=120415) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 17:32:24.468857 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-1d55eead-be82-4e4e-98d6-273edb2f6e40 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: f84aa405-baed-4bb8-84db-ab3592929c8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9355bd92-0a49-42cd-b079-ff9f0d54b91b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120415) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 17:32:24.515634 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-1d55eead-be82-4e4e-98d6-273edb2f6e40 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.572469 Sep 27 17:32:24.516280 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 377/778] 10.222.0.55 () {62 vars in 1188 bytes} [Tue Sep 27 17:32:23 2022] POST /compute/v2.1/servers => generated 401 bytes in 574 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 27 17:32:24.527648 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-92597e3b-89db-499c-b76e-47f10cd8cb64 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:32:24.528299 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-92597e3b-89db-499c-b76e-47f10cd8cb64 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: f84aa405-baed-4bb8-84db-ab3592929c8a] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:32:24.582340 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-92597e3b-89db-499c-b76e-47f10cd8cb64 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:32:24.589704 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-92597e3b-89db-499c-b76e-47f10cd8cb64 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:32:24.591182 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-92597e3b-89db-499c-b76e-47f10cd8cb64 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:32:24.592285 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-92597e3b-89db-499c-b76e-47f10cd8cb64 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a" status: 200 len: 1282 microversion: 2.20 time: 0.068605 Sep 27 17:32:24.593410 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 402/779] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:32:24 2022] GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a => generated 1282 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:32:25.617150 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-d95838ef-429f-47c9-95c2-a2583d8ec5d7 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:32:25.617760 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-d95838ef-429f-47c9-95c2-a2583d8ec5d7 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: f84aa405-baed-4bb8-84db-ab3592929c8a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:32:25.624344 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d95838ef-429f-47c9-95c2-a2583d8ec5d7 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:25.624825 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d95838ef-429f-47c9-95c2-a2583d8ec5d7 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:25.625262 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d95838ef-429f-47c9-95c2-a2583d8ec5d7 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:25.625953 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d95838ef-429f-47c9-95c2-a2583d8ec5d7 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:25.626440 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d95838ef-429f-47c9-95c2-a2583d8ec5d7 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:25.626865 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d95838ef-429f-47c9-95c2-a2583d8ec5d7 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:25.690343 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-d95838ef-429f-47c9-95c2-a2583d8ec5d7 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:32:25.698602 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-d95838ef-429f-47c9-95c2-a2583d8ec5d7 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:32:25.700076 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-d95838ef-429f-47c9-95c2-a2583d8ec5d7 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:32:25.701181 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-d95838ef-429f-47c9-95c2-a2583d8ec5d7 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a" status: 200 len: 1334 microversion: 2.20 time: 0.088523 Sep 27 17:32:25.702380 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 378/780] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:32:25 2022] GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a => generated 1334 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:32:26.339252 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-efc71aed-2808-4a67-9a2c-348a28560b6b tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2145868438"}} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:32:26.339786 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-efc71aed-2808-4a67-9a2c-348a28560b6b tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:32:26.346217 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-efc71aed-2808-4a67-9a2c-348a28560b6b tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:26.346700 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-efc71aed-2808-4a67-9a2c-348a28560b6b tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:26.347137 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-efc71aed-2808-4a67-9a2c-348a28560b6b tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:26.347822 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-efc71aed-2808-4a67-9a2c-348a28560b6b tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:26.348419 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-efc71aed-2808-4a67-9a2c-348a28560b6b tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:26.348843 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-efc71aed-2808-4a67-9a2c-348a28560b6b tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:26.484126 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.network.security_group_api [None req-efc71aed-2808-4a67-9a2c-348a28560b6b tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Removing security group e90abd20-a7d9-4a96-ad13-61546a82ff29 from port 9d1590c2-6fed-40c4-8aca-ed18ef3c13df Sep 27 17:32:26.727409 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-83a17388-98a0-42c1-ad8c-122076b0d2bf tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:32:26.728849 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-83a17388-98a0-42c1-ad8c-122076b0d2bf tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: f84aa405-baed-4bb8-84db-ab3592929c8a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:32:26.738222 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-83a17388-98a0-42c1-ad8c-122076b0d2bf tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:26.738781 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-83a17388-98a0-42c1-ad8c-122076b0d2bf tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:26.739426 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-83a17388-98a0-42c1-ad8c-122076b0d2bf tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:26.740763 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-83a17388-98a0-42c1-ad8c-122076b0d2bf tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:26.741364 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-83a17388-98a0-42c1-ad8c-122076b0d2bf tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:26.741925 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-83a17388-98a0-42c1-ad8c-122076b0d2bf tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:26.824689 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-efc71aed-2808-4a67-9a2c-348a28560b6b tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "POST /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b/action" status: 202 len: 0 microversion: 2.1 time: 0.616215 Sep 27 17:32:26.825719 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 403/781] 10.222.0.55 () {60 vars in 1278 bytes} [Tue Sep 27 17:32:26 2022] POST /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b/action => generated 0 bytes in 618 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 17:32:26.892100 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [req-e5486e20-ab95-4fb3-bf2c-11c52fb061a4 req-05f41be1-7a41-4192-b78a-6d939c6bca90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7c9bb60-e05b-4527-aa2f-bc6a3c55306b", "tag": "9d1590c2-6fed-40c4-8aca-ed18ef3c13df"}]} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:32:26.914347 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-e5486e20-ab95-4fb3-bf2c-11c52fb061a4 req-05f41be1-7a41-4192-b78a-6d939c6bca90 service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:26.914844 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-e5486e20-ab95-4fb3-bf2c-11c52fb061a4 req-05f41be1-7a41-4192-b78a-6d939c6bca90 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:26.915666 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-e5486e20-ab95-4fb3-bf2c-11c52fb061a4 req-05f41be1-7a41-4192-b78a-6d939c6bca90 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:26.937626 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.compute.server_external_events [req-e5486e20-ab95-4fb3-bf2c-11c52fb061a4 req-05f41be1-7a41-4192-b78a-6d939c6bca90 service nova] Creating event network-changed:9d1590c2-6fed-40c4-8aca-ed18ef3c13df for instance d7c9bb60-e05b-4527-aa2f-bc6a3c55306b on hv-cinder-84914 Sep 27 17:32:26.956288 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [req-e5486e20-ab95-4fb3-bf2c-11c52fb061a4 req-05f41be1-7a41-4192-b78a-6d939c6bca90 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064987 Sep 27 17:32:26.957577 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 404/782] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:32:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:32:27.010038 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-83a17388-98a0-42c1-ad8c-122076b0d2bf tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:32:27.021445 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-83a17388-98a0-42c1-ad8c-122076b0d2bf tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:32:27.023549 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-83a17388-98a0-42c1-ad8c-122076b0d2bf tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:32:27.024928 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-83a17388-98a0-42c1-ad8c-122076b0d2bf tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a" status: 200 len: 1407 microversion: 2.20 time: 0.302101 Sep 27 17:32:27.034562 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 379/783] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:32:26 2022] GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a => generated 1407 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:32:27.650596 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [req-be0088a0-8350-4722-ae62-1dcc67bdcae2 req-d10e99d0-4750-47e6-be32-9d564535fc22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f84aa405-baed-4bb8-84db-ab3592929c8a", "tag": "44bdfd6c-6234-47ec-8359-4819b713d0a5"}]} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:32:27.663882 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-be0088a0-8350-4722-ae62-1dcc67bdcae2 req-d10e99d0-4750-47e6-be32-9d564535fc22 service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:27.664433 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-be0088a0-8350-4722-ae62-1dcc67bdcae2 req-d10e99d0-4750-47e6-be32-9d564535fc22 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:27.664916 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-be0088a0-8350-4722-ae62-1dcc67bdcae2 req-d10e99d0-4750-47e6-be32-9d564535fc22 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:27.679930 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.compute.server_external_events [req-be0088a0-8350-4722-ae62-1dcc67bdcae2 req-d10e99d0-4750-47e6-be32-9d564535fc22 service nova] Creating event network-changed:44bdfd6c-6234-47ec-8359-4819b713d0a5 for instance f84aa405-baed-4bb8-84db-ab3592929c8a on hv-cinder-84914 Sep 27 17:32:27.685148 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [req-be0088a0-8350-4722-ae62-1dcc67bdcae2 req-d10e99d0-4750-47e6-be32-9d564535fc22 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040184 Sep 27 17:32:27.686559 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 405/784] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:32:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:32:28.051939 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-46272df1-f338-4fd8-bad7-01949c1b14a4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:32:28.052561 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-46272df1-f338-4fd8-bad7-01949c1b14a4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: f84aa405-baed-4bb8-84db-ab3592929c8a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:32:28.059583 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-46272df1-f338-4fd8-bad7-01949c1b14a4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:28.060073 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-46272df1-f338-4fd8-bad7-01949c1b14a4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:28.060507 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-46272df1-f338-4fd8-bad7-01949c1b14a4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:28.061803 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-46272df1-f338-4fd8-bad7-01949c1b14a4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:28.062483 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-46272df1-f338-4fd8-bad7-01949c1b14a4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:28.062909 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-46272df1-f338-4fd8-bad7-01949c1b14a4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:28.319430 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-46272df1-f338-4fd8-bad7-01949c1b14a4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:32:28.327977 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-46272df1-f338-4fd8-bad7-01949c1b14a4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:32:28.329531 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-46272df1-f338-4fd8-bad7-01949c1b14a4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:32:28.330776 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-46272df1-f338-4fd8-bad7-01949c1b14a4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a" status: 200 len: 1407 microversion: 2.20 time: 0.283420 Sep 27 17:32:28.331583 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 380/785] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:32:28 2022] GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a => generated 1407 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:32:28.521708 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-23df9817-1f76-47f8-b98c-44e5dca67b08 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:32:28.522408 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-23df9817-1f76-47f8-b98c-44e5dca67b08 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:32:28.528843 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-23df9817-1f76-47f8-b98c-44e5dca67b08 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:28.529325 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-23df9817-1f76-47f8-b98c-44e5dca67b08 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:28.530318 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-23df9817-1f76-47f8-b98c-44e5dca67b08 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:28.531101 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-23df9817-1f76-47f8-b98c-44e5dca67b08 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:28.531617 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-23df9817-1f76-47f8-b98c-44e5dca67b08 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:28.532046 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-23df9817-1f76-47f8-b98c-44e5dca67b08 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:28.613299 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.objects.instance [None req-23df9817-1f76-47f8-b98c-44e5dca67b08 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lazy-loading 'services' on Instance uuid d7c9bb60-e05b-4527-aa2f-bc6a3c55306b {{(pid=120416) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 17:32:28.688112 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-23df9817-1f76-47f8-b98c-44e5dca67b08 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "DELETE /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b/os-volume_attachments/620667b6-601e-4daa-8d0b-03fd03f9971b" status: 202 len: 0 microversion: 2.1 time: 0.170531 Sep 27 17:32:28.691983 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 406/786] 10.222.0.55 () {58 vars in 1416 bytes} [Tue Sep 27 17:32:28 2022] DELETE /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b/os-volume_attachments/620667b6-601e-4daa-8d0b-03fd03f9971b => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 17:32:28.697140 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-d6825a4b-0e6a-4b6f-9268-76350343b269 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:32:28.699624 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-d6825a4b-0e6a-4b6f-9268-76350343b269 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:32:28.705750 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d6825a4b-0e6a-4b6f-9268-76350343b269 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:28.706334 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d6825a4b-0e6a-4b6f-9268-76350343b269 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:28.706898 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d6825a4b-0e6a-4b6f-9268-76350343b269 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:28.707653 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d6825a4b-0e6a-4b6f-9268-76350343b269 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:28.708180 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d6825a4b-0e6a-4b6f-9268-76350343b269 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:28.708674 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d6825a4b-0e6a-4b6f-9268-76350343b269 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:28.739500 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-d6825a4b-0e6a-4b6f-9268-76350343b269 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046283 Sep 27 17:32:28.740168 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 381/787] 10.222.0.55 () {58 vars in 1302 bytes} [Tue Sep 27 17:32:28 2022] GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:32:28.980596 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [req-78d7c997-dbee-4136-9821-045608be0a1b req-be41ef73-5f49-42fb-9f99-ea89f54bd2ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7c9bb60-e05b-4527-aa2f-bc6a3c55306b", "tag": "9d1590c2-6fed-40c4-8aca-ed18ef3c13df"}]} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:32:28.990888 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-78d7c997-dbee-4136-9821-045608be0a1b req-be41ef73-5f49-42fb-9f99-ea89f54bd2ff service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:28.991303 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-78d7c997-dbee-4136-9821-045608be0a1b req-be41ef73-5f49-42fb-9f99-ea89f54bd2ff service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:28.991735 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-78d7c997-dbee-4136-9821-045608be0a1b req-be41ef73-5f49-42fb-9f99-ea89f54bd2ff service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:29.002925 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.compute.server_external_events [req-78d7c997-dbee-4136-9821-045608be0a1b req-be41ef73-5f49-42fb-9f99-ea89f54bd2ff service nova] Creating event network-changed:9d1590c2-6fed-40c4-8aca-ed18ef3c13df for instance d7c9bb60-e05b-4527-aa2f-bc6a3c55306b on hv-cinder-84914 Sep 27 17:32:29.007710 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [req-78d7c997-dbee-4136-9821-045608be0a1b req-be41ef73-5f49-42fb-9f99-ea89f54bd2ff service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031096 Sep 27 17:32:29.008285 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 407/788] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:32:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:32:29.356937 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-360b0644-0476-493a-a08f-219c66816249 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:32:29.357646 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-360b0644-0476-493a-a08f-219c66816249 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: f84aa405-baed-4bb8-84db-ab3592929c8a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:32:29.364111 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-360b0644-0476-493a-a08f-219c66816249 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:29.364532 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-360b0644-0476-493a-a08f-219c66816249 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:29.364962 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-360b0644-0476-493a-a08f-219c66816249 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:29.365642 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-360b0644-0476-493a-a08f-219c66816249 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:29.366121 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-360b0644-0476-493a-a08f-219c66816249 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:29.366546 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-360b0644-0476-493a-a08f-219c66816249 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:29.495973 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-360b0644-0476-493a-a08f-219c66816249 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:32:29.503958 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-360b0644-0476-493a-a08f-219c66816249 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:32:29.505449 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-360b0644-0476-493a-a08f-219c66816249 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:32:29.506662 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-360b0644-0476-493a-a08f-219c66816249 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a" status: 200 len: 1407 microversion: 2.20 time: 0.153929 Sep 27 17:32:29.507219 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 382/789] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:32:29 2022] GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:32:29.752189 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-ffb98872-a669-42a6-89b8-9da8b065a700 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:32:29.754430 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-ffb98872-a669-42a6-89b8-9da8b065a700 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:32:29.760480 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ffb98872-a669-42a6-89b8-9da8b065a700 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:29.760958 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ffb98872-a669-42a6-89b8-9da8b065a700 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:29.761392 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ffb98872-a669-42a6-89b8-9da8b065a700 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:29.762096 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ffb98872-a669-42a6-89b8-9da8b065a700 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:29.762565 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ffb98872-a669-42a6-89b8-9da8b065a700 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:29.762991 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ffb98872-a669-42a6-89b8-9da8b065a700 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:29.792104 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-ffb98872-a669-42a6-89b8-9da8b065a700 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044255 Sep 27 17:32:29.792638 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 408/790] 10.222.0.55 () {58 vars in 1302 bytes} [Tue Sep 27 17:32:29 2022] GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:32:30.533165 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-58a4a40d-f519-4336-a92a-01a174f03e93 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:32:30.533780 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-58a4a40d-f519-4336-a92a-01a174f03e93 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: f84aa405-baed-4bb8-84db-ab3592929c8a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:32:30.540162 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-58a4a40d-f519-4336-a92a-01a174f03e93 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:30.540644 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-58a4a40d-f519-4336-a92a-01a174f03e93 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:30.541080 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-58a4a40d-f519-4336-a92a-01a174f03e93 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:30.541762 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-58a4a40d-f519-4336-a92a-01a174f03e93 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:30.542255 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-58a4a40d-f519-4336-a92a-01a174f03e93 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:30.542680 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-58a4a40d-f519-4336-a92a-01a174f03e93 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:30.675200 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-58a4a40d-f519-4336-a92a-01a174f03e93 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:32:30.683228 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-58a4a40d-f519-4336-a92a-01a174f03e93 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:32:30.684679 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-58a4a40d-f519-4336-a92a-01a174f03e93 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:32:30.685780 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-58a4a40d-f519-4336-a92a-01a174f03e93 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a" status: 200 len: 1407 microversion: 2.20 time: 0.157276 Sep 27 17:32:30.686367 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 383/791] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:32:30 2022] GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:32:30.804473 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-672804f9-c1a9-4d1a-9139-49d825e1443c tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:32:30.806607 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-672804f9-c1a9-4d1a-9139-49d825e1443c tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:32:30.812578 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-672804f9-c1a9-4d1a-9139-49d825e1443c tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:30.813052 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-672804f9-c1a9-4d1a-9139-49d825e1443c tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:30.813476 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-672804f9-c1a9-4d1a-9139-49d825e1443c tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:30.814178 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-672804f9-c1a9-4d1a-9139-49d825e1443c tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:30.814623 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-672804f9-c1a9-4d1a-9139-49d825e1443c tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:30.815035 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-672804f9-c1a9-4d1a-9139-49d825e1443c tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:30.843394 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-672804f9-c1a9-4d1a-9139-49d825e1443c tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042877 Sep 27 17:32:30.843934 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 409/792] 10.222.0.55 () {58 vars in 1302 bytes} [Tue Sep 27 17:32:30 2022] GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:32:31.715527 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-41ab176a-2cd6-4cc9-ab23-ccd239c65a18 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:32:31.716173 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-41ab176a-2cd6-4cc9-ab23-ccd239c65a18 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: f84aa405-baed-4bb8-84db-ab3592929c8a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:32:31.723472 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-41ab176a-2cd6-4cc9-ab23-ccd239c65a18 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:31.724166 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-41ab176a-2cd6-4cc9-ab23-ccd239c65a18 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:31.725046 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-41ab176a-2cd6-4cc9-ab23-ccd239c65a18 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:31.726178 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-41ab176a-2cd6-4cc9-ab23-ccd239c65a18 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:31.726969 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-41ab176a-2cd6-4cc9-ab23-ccd239c65a18 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:31.727546 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-41ab176a-2cd6-4cc9-ab23-ccd239c65a18 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:31.855113 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-b9c1115e-9cc1-4b54-8b3d-480fa3a9ebcb tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:32:31.859080 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-b9c1115e-9cc1-4b54-8b3d-480fa3a9ebcb tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:32:31.865222 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b9c1115e-9cc1-4b54-8b3d-480fa3a9ebcb tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:31.865710 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b9c1115e-9cc1-4b54-8b3d-480fa3a9ebcb tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:31.866169 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b9c1115e-9cc1-4b54-8b3d-480fa3a9ebcb tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:31.866870 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b9c1115e-9cc1-4b54-8b3d-480fa3a9ebcb tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:31.867318 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b9c1115e-9cc1-4b54-8b3d-480fa3a9ebcb tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:31.867738 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b9c1115e-9cc1-4b54-8b3d-480fa3a9ebcb tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:31.899338 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-b9c1115e-9cc1-4b54-8b3d-480fa3a9ebcb tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048208 Sep 27 17:32:31.899920 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 410/793] 10.222.0.55 () {58 vars in 1302 bytes} [Tue Sep 27 17:32:31 2022] GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 17:32:32.172802 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-41ab176a-2cd6-4cc9-ab23-ccd239c65a18 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:32:32.180762 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-41ab176a-2cd6-4cc9-ab23-ccd239c65a18 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:32:32.182238 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-41ab176a-2cd6-4cc9-ab23-ccd239c65a18 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:32:32.183336 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-41ab176a-2cd6-4cc9-ab23-ccd239c65a18 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a" status: 200 len: 1407 microversion: 2.20 time: 0.471728 Sep 27 17:32:32.183893 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 384/794] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:32:31 2022] GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a => generated 1407 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:32:32.911919 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-dff94887-1768-4088-b2ba-386ede9c5faa tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:32:32.914174 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-dff94887-1768-4088-b2ba-386ede9c5faa tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:32:32.920065 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-dff94887-1768-4088-b2ba-386ede9c5faa tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:32.921145 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-dff94887-1768-4088-b2ba-386ede9c5faa tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:32.921593 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-dff94887-1768-4088-b2ba-386ede9c5faa tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:32.922302 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-dff94887-1768-4088-b2ba-386ede9c5faa tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:32.922756 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-dff94887-1768-4088-b2ba-386ede9c5faa tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:32.923177 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-dff94887-1768-4088-b2ba-386ede9c5faa tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:32.950590 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-dff94887-1768-4088-b2ba-386ede9c5faa tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042593 Sep 27 17:32:32.951124 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 411/795] 10.222.0.55 () {58 vars in 1302 bytes} [Tue Sep 27 17:32:32 2022] GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 17:32:33.019093 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-1e5db70a-8233-46de-a154-fc7430176780 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:32:33.019684 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-1e5db70a-8233-46de-a154-fc7430176780 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:32:33.025808 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1e5db70a-8233-46de-a154-fc7430176780 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:33.026329 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1e5db70a-8233-46de-a154-fc7430176780 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:33.026768 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1e5db70a-8233-46de-a154-fc7430176780 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:33.027455 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1e5db70a-8233-46de-a154-fc7430176780 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:33.027907 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1e5db70a-8233-46de-a154-fc7430176780 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:33.028344 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1e5db70a-8233-46de-a154-fc7430176780 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:33.208037 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-8cc1ef09-5b1d-4fd9-bbc3-375c35435824 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:32:33.208668 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-8cc1ef09-5b1d-4fd9-bbc3-375c35435824 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: f84aa405-baed-4bb8-84db-ab3592929c8a] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:32:33.214425 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8cc1ef09-5b1d-4fd9-bbc3-375c35435824 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:33.214904 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8cc1ef09-5b1d-4fd9-bbc3-375c35435824 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:33.215340 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8cc1ef09-5b1d-4fd9-bbc3-375c35435824 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:33.216029 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8cc1ef09-5b1d-4fd9-bbc3-375c35435824 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:33.216485 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8cc1ef09-5b1d-4fd9-bbc3-375c35435824 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:33.216914 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8cc1ef09-5b1d-4fd9-bbc3-375c35435824 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:33.267955 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.wsgi [None req-1e5db70a-8233-46de-a154-fc7430176780 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] HTTP exception thrown: Instance d7c9bb60-e05b-4527-aa2f-bc6a3c55306b is not attached to volume 620667b6-601e-4daa-8d0b-03fd03f9971b Sep 27 17:32:33.270343 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-1e5db70a-8233-46de-a154-fc7430176780 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Request method failure captured: Sep 27 17:32:33.270343 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: request: DELETE /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b/os-volume_attachments/620667b6-601e-4daa-8d0b-03fd03f9971b HTTP/1.1 Sep 27 17:32:33.270343 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Accept: application/json Sep 27 17:32:33.270343 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Accept-Encoding: identity Sep 27 17:32:33.270343 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Connection: close Sep 27 17:32:33.270343 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Content-Length: 0 Sep 27 17:32:33.270343 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Content-Type: application/json Sep 27 17:32:33.270343 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Host: 10.222.0.55 Sep 27 17:32:33.270343 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Openstack-System-Scope: None Sep 27 17:32:33.270343 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: User-Agent: python-urllib3/1.26.12 Sep 27 17:32:33.270343 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Auth-Token: gAAAAABjMzJLeClAGqlHRuAV_SxvJD0aeI70kpG9RfGfUhZvJQRRlAA9oicjk1kuQZ033obav_9XV9bxW7vKeKgaPTp4TQzN-z-RXwNSfxV9CF3m2XhpuYNO9gwhvr3wTE25UjMMrmDtQacUeRoz9dVLtVesZTnguuUH7Qg2pMSQU8lwtF-Vofo Sep 27 17:32:33.270343 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Domain-Id: None Sep 27 17:32:33.270343 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Domain-Name: None Sep 27 17:32:33.270343 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Identity-Status: Confirmed Sep 27 17:32:33.270343 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Is-Admin-Project: True Sep 27 17:32:33.270343 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Domain-Id: default Sep 27 17:32:33.270343 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Domain-Name: Default Sep 27 17:32:33.270343 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Id: 9bf4e20a59f147afb4f036fc8d04adb2 Sep 27 17:32:33.270343 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Name: tempest-TestMinimumBasicScenario-887258868 Sep 27 17:32:33.270343 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Role: reader,member Sep 27 17:32:33.270343 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Roles: reader,member Sep 27 17:32:33.271867 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/9bf4e20a59f147afb4f036fc8d04adb2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_9bf4e20a59f147afb4f036fc8d04adb2", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/9bf4e20a59f147afb4f036fc8d04adb2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/9bf4e20a59f147afb4f036fc8d04adb2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 27 17:32:33.271867 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Tenant: tempest-TestMinimumBasicScenario-887258868 Sep 27 17:32:33.271867 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Tenant-Id: 9bf4e20a59f147afb4f036fc8d04adb2 Sep 27 17:32:33.271867 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Tenant-Name: tempest-TestMinimumBasicScenario-887258868 Sep 27 17:32:33.271867 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User: tempest-TestMinimumBasicScenario-887258868-project Sep 27 17:32:33.271867 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Domain-Id: default Sep 27 17:32:33.271867 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Domain-Name: Default Sep 27 17:32:33.271867 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Id: c3acafe7ed414c87a5ca235b96047aca Sep 27 17:32:33.271867 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Name: tempest-TestMinimumBasicScenario-887258868-project Sep 27 17:32:33.271867 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: method: > Sep 27 17:32:33.271867 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: exception: Instance d7c9bb60-e05b-4527-aa2f-bc6a3c55306b is not attached to volume 620667b6-601e-4daa-8d0b-03fd03f9971b Sep 27 17:32:33.272634 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: action_args: {'server_id': 'd7c9bb60-e05b-4527-aa2f-bc6a3c55306b', 'id': '620667b6-601e-4daa-8d0b-03fd03f9971b'} Sep 27 17:32:33.272634 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 17:32:33.272634 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:32:33.272634 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 27 17:32:33.272634 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 27 17:32:33.272634 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 27 17:32:33.272634 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 27 17:32:33.272634 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 27 17:32:33.272634 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 27 17:32:33.272634 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 620667b6-601e-4daa-8d0b-03fd03f9971b. Sep 27 17:32:33.272634 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:32:33.272634 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:32:33.272634 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:32:33.272634 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:32:33.272634 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:32:33.272634 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:32:33.272634 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 17:32:33.272634 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 17:32:33.272634 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 17:32:33.273839 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 17:32:33.273839 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 27 17:32:33.273839 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 27 17:32:33.273839 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7c9bb60-e05b-4527-aa2f-bc6a3c55306b is not attached to volume 620667b6-601e-4daa-8d0b-03fd03f9971b Sep 27 17:32:33.273839 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:32:33.273839 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:32:33.273839 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:32:33.273839 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:32:33.273839 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:32:33.273839 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:32:33.273839 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 17:32:33.273839 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 17:32:33.273839 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7c9bb60-e05b-4527-aa2f-bc6a3c55306b is not attached to volume 620667b6-601e-4daa-8d0b-03fd03f9971b Sep 27 17:32:33.273839 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:32:33.273839 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-1e5db70a-8233-46de-a154-fc7430176780 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Returning 404 to user: Instance d7c9bb60-e05b-4527-aa2f-bc6a3c55306b is not attached to volume 620667b6-601e-4daa-8d0b-03fd03f9971b {{(pid=120415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 17:32:33.274801 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-1e5db70a-8233-46de-a154-fc7430176780 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "DELETE /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b/os-volume_attachments/620667b6-601e-4daa-8d0b-03fd03f9971b" status: 404 len: 154 microversion: 2.1 time: 0.256671 Sep 27 17:32:33.274801 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 385/796] 10.222.0.55 () {58 vars in 1416 bytes} [Tue Sep 27 17:32:33 2022] DELETE /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b/os-volume_attachments/620667b6-601e-4daa-8d0b-03fd03f9971b => generated 154 bytes in 258 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 17:32:33.355725 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-8cc1ef09-5b1d-4fd9-bbc3-375c35435824 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:32:33.364578 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-8cc1ef09-5b1d-4fd9-bbc3-375c35435824 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:32:33.366024 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-8cc1ef09-5b1d-4fd9-bbc3-375c35435824 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:32:33.367188 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-8cc1ef09-5b1d-4fd9-bbc3-375c35435824 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a" status: 200 len: 1407 microversion: 2.20 time: 0.163053 Sep 27 17:32:33.367738 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 412/797] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:32:33 2022] GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 17:32:34.394329 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-ac9027ae-3566-4f3f-9ffd-b0813ac25f83 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:32:34.394995 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-ac9027ae-3566-4f3f-9ffd-b0813ac25f83 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: f84aa405-baed-4bb8-84db-ab3592929c8a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:32:34.402299 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ac9027ae-3566-4f3f-9ffd-b0813ac25f83 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:34.403106 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ac9027ae-3566-4f3f-9ffd-b0813ac25f83 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:34.403667 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ac9027ae-3566-4f3f-9ffd-b0813ac25f83 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:34.405019 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ac9027ae-3566-4f3f-9ffd-b0813ac25f83 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:34.405487 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ac9027ae-3566-4f3f-9ffd-b0813ac25f83 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:34.406395 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ac9027ae-3566-4f3f-9ffd-b0813ac25f83 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:34.431561 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-80455950-cc4b-4056-be99-ca1d374be0b4 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:32:34.432509 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-80455950-cc4b-4056-be99-ca1d374be0b4 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:32:34.439135 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-80455950-cc4b-4056-be99-ca1d374be0b4 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:34.439757 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-80455950-cc4b-4056-be99-ca1d374be0b4 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:34.440292 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-80455950-cc4b-4056-be99-ca1d374be0b4 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:34.441095 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-80455950-cc4b-4056-be99-ca1d374be0b4 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:34.441692 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell0:SELECT=2 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:32:34.441943 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-80455950-cc4b-4056-be99-ca1d374be0b4 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:34.442368 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-80455950-cc4b-4056-be99-ca1d374be0b4 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:34.461536 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell0:SELECT=6 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:32:34.482202 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-80455950-cc4b-4056-be99-ca1d374be0b4 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Going to try to terminate instance {{(pid=120416) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 17:32:34.499040 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:32:34.549772 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-ac9027ae-3566-4f3f-9ffd-b0813ac25f83 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:32:34.558609 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-ac9027ae-3566-4f3f-9ffd-b0813ac25f83 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:32:34.560344 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-ac9027ae-3566-4f3f-9ffd-b0813ac25f83 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:32:34.561816 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-ac9027ae-3566-4f3f-9ffd-b0813ac25f83 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a" status: 200 len: 1407 microversion: 2.20 time: 0.171508 Sep 27 17:32:34.562474 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 386/798] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:32:34 2022] GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:32:34.567434 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [req-cf981d6c-41dd-4db3-8aa8-16cce0265089 req-d7045123-9a26-4c60-9043-781c1ce2136d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f84aa405-baed-4bb8-84db-ab3592929c8a", "name": "network-vif-plugged", "status": "completed", "tag": "44bdfd6c-6234-47ec-8359-4819b713d0a5"}]} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:32:34.577105 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-cf981d6c-41dd-4db3-8aa8-16cce0265089 req-d7045123-9a26-4c60-9043-781c1ce2136d service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:34.577921 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-cf981d6c-41dd-4db3-8aa8-16cce0265089 req-d7045123-9a26-4c60-9043-781c1ce2136d service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:34.578581 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-cf981d6c-41dd-4db3-8aa8-16cce0265089 req-d7045123-9a26-4c60-9043-781c1ce2136d service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:34.588462 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_cell0:SELECT=6 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:32:34.591773 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.compute.server_external_events [req-cf981d6c-41dd-4db3-8aa8-16cce0265089 req-d7045123-9a26-4c60-9043-781c1ce2136d service nova] Creating event network-vif-plugged:44bdfd6c-6234-47ec-8359-4819b713d0a5 for instance f84aa405-baed-4bb8-84db-ab3592929c8a on hv-cinder-84914 Sep 27 17:32:34.593243 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-80455950-cc4b-4056-be99-ca1d374be0b4 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "DELETE /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b" status: 204 len: 0 microversion: 2.1 time: 0.164950 Sep 27 17:32:34.594099 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 413/799] 10.222.0.55 () {58 vars in 1239 bytes} [Tue Sep 27 17:32:34 2022] DELETE /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 17:32:34.598546 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [req-cf981d6c-41dd-4db3-8aa8-16cce0265089 req-d7045123-9a26-4c60-9043-781c1ce2136d service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034573 Sep 27 17:32:34.599207 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 387/800] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:32:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:32:34.604433 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-a4dd22d1-444a-46eb-b0f6-54a5a3fd6d39 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:32:34.605210 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-a4dd22d1-444a-46eb-b0f6-54a5a3fd6d39 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:32:34.611486 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a4dd22d1-444a-46eb-b0f6-54a5a3fd6d39 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:34.611995 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a4dd22d1-444a-46eb-b0f6-54a5a3fd6d39 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:34.612420 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a4dd22d1-444a-46eb-b0f6-54a5a3fd6d39 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:34.613106 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a4dd22d1-444a-46eb-b0f6-54a5a3fd6d39 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:34.613555 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a4dd22d1-444a-46eb-b0f6-54a5a3fd6d39 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:34.613978 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a4dd22d1-444a-46eb-b0f6-54a5a3fd6d39 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:34.750559 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-a4dd22d1-444a-46eb-b0f6-54a5a3fd6d39 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acafe7ed414c87a5ca235b96047aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf4e20a59f147afb4f036fc8d04adb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:32:34.761238 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-a4dd22d1-444a-46eb-b0f6-54a5a3fd6d39 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b" status: 200 len: 1553 microversion: 2.1 time: 0.162528 Sep 27 17:32:34.761796 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 414/801] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:32:34 2022] GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b => generated 1553 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:32:35.589650 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-23d49a08-6c54-4cd2-be2b-0ff910c965ba tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:32:35.590371 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-23d49a08-6c54-4cd2-be2b-0ff910c965ba tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: f84aa405-baed-4bb8-84db-ab3592929c8a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:32:35.596927 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-23d49a08-6c54-4cd2-be2b-0ff910c965ba tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:35.597416 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-23d49a08-6c54-4cd2-be2b-0ff910c965ba tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:35.597847 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-23d49a08-6c54-4cd2-be2b-0ff910c965ba tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:35.598711 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-23d49a08-6c54-4cd2-be2b-0ff910c965ba tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:35.599429 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-23d49a08-6c54-4cd2-be2b-0ff910c965ba tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:35.599911 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-23d49a08-6c54-4cd2-be2b-0ff910c965ba tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:35.618554 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell1:SELECT=100 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:32:35.729735 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-23d49a08-6c54-4cd2-be2b-0ff910c965ba tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:32:35.738539 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-23d49a08-6c54-4cd2-be2b-0ff910c965ba tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:32:35.739979 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-23d49a08-6c54-4cd2-be2b-0ff910c965ba tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:32:35.741080 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-23d49a08-6c54-4cd2-be2b-0ff910c965ba tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a" status: 200 len: 1407 microversion: 2.20 time: 0.156143 Sep 27 17:32:35.741624 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 388/802] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:32:35 2022] GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:32:35.783745 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-3c87e7da-5a1d-4cc1-aa35-f17cc32970fe tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:32:35.784368 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-3c87e7da-5a1d-4cc1-aa35-f17cc32970fe tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:32:35.790341 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3c87e7da-5a1d-4cc1-aa35-f17cc32970fe tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:35.790826 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3c87e7da-5a1d-4cc1-aa35-f17cc32970fe tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:35.791261 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3c87e7da-5a1d-4cc1-aa35-f17cc32970fe tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:35.791943 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3c87e7da-5a1d-4cc1-aa35-f17cc32970fe tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:35.792395 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3c87e7da-5a1d-4cc1-aa35-f17cc32970fe tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:35.792813 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3c87e7da-5a1d-4cc1-aa35-f17cc32970fe tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:35.921249 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-3c87e7da-5a1d-4cc1-aa35-f17cc32970fe tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acafe7ed414c87a5ca235b96047aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf4e20a59f147afb4f036fc8d04adb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:32:35.929361 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-3c87e7da-5a1d-4cc1-aa35-f17cc32970fe tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b" status: 200 len: 1553 microversion: 2.1 time: 0.149876 Sep 27 17:32:35.929928 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 415/803] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:32:35 2022] GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b => generated 1553 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:32:36.767136 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-851c2f90-916f-405e-abaa-42d6ca353580 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:32:36.767745 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-851c2f90-916f-405e-abaa-42d6ca353580 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: f84aa405-baed-4bb8-84db-ab3592929c8a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:32:36.774288 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-851c2f90-916f-405e-abaa-42d6ca353580 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:36.774774 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-851c2f90-916f-405e-abaa-42d6ca353580 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:36.775209 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-851c2f90-916f-405e-abaa-42d6ca353580 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:36.775897 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-851c2f90-916f-405e-abaa-42d6ca353580 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:36.776352 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-851c2f90-916f-405e-abaa-42d6ca353580 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:36.776778 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-851c2f90-916f-405e-abaa-42d6ca353580 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:36.905600 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-851c2f90-916f-405e-abaa-42d6ca353580 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:32:36.913688 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-851c2f90-916f-405e-abaa-42d6ca353580 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:32:36.915176 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-851c2f90-916f-405e-abaa-42d6ca353580 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:32:36.916276 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-851c2f90-916f-405e-abaa-42d6ca353580 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a" status: 200 len: 1407 microversion: 2.20 time: 0.153664 Sep 27 17:32:36.916827 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 389/804] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:32:36 2022] GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:32:36.953251 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-70f2aeb0-99bb-43ad-aa85-b3b0d4f94117 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:32:36.954031 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-70f2aeb0-99bb-43ad-aa85-b3b0d4f94117 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:32:36.959851 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-70f2aeb0-99bb-43ad-aa85-b3b0d4f94117 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:36.960326 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-70f2aeb0-99bb-43ad-aa85-b3b0d4f94117 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:36.960757 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-70f2aeb0-99bb-43ad-aa85-b3b0d4f94117 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:36.961431 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-70f2aeb0-99bb-43ad-aa85-b3b0d4f94117 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:36.961877 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-70f2aeb0-99bb-43ad-aa85-b3b0d4f94117 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:36.962345 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-70f2aeb0-99bb-43ad-aa85-b3b0d4f94117 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:37.099536 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-70f2aeb0-99bb-43ad-aa85-b3b0d4f94117 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acafe7ed414c87a5ca235b96047aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf4e20a59f147afb4f036fc8d04adb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:32:37.107979 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-70f2aeb0-99bb-43ad-aa85-b3b0d4f94117 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b" status: 200 len: 1553 microversion: 2.1 time: 0.158715 Sep 27 17:32:37.108550 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 416/805] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:32:36 2022] GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b => generated 1553 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:32:37.941835 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-b706caf9-b4e7-4875-939a-49fcb12acc70 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:32:37.942801 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-b706caf9-b4e7-4875-939a-49fcb12acc70 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: f84aa405-baed-4bb8-84db-ab3592929c8a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:32:37.949285 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b706caf9-b4e7-4875-939a-49fcb12acc70 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:37.950011 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b706caf9-b4e7-4875-939a-49fcb12acc70 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:37.950661 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b706caf9-b4e7-4875-939a-49fcb12acc70 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:37.951390 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b706caf9-b4e7-4875-939a-49fcb12acc70 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:37.952006 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b706caf9-b4e7-4875-939a-49fcb12acc70 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:37.952471 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b706caf9-b4e7-4875-939a-49fcb12acc70 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:38.083439 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-b706caf9-b4e7-4875-939a-49fcb12acc70 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:32:38.092234 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-b706caf9-b4e7-4875-939a-49fcb12acc70 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:32:38.093787 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-b706caf9-b4e7-4875-939a-49fcb12acc70 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:32:38.095161 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-b706caf9-b4e7-4875-939a-49fcb12acc70 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a" status: 200 len: 1407 microversion: 2.20 time: 0.157292 Sep 27 17:32:38.095905 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 390/806] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:32:37 2022] GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:32:38.131601 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-3983d7ee-f0c1-4498-9c3c-40377419646c tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:32:38.132198 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-3983d7ee-f0c1-4498-9c3c-40377419646c tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:32:38.137984 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3983d7ee-f0c1-4498-9c3c-40377419646c tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:38.138561 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3983d7ee-f0c1-4498-9c3c-40377419646c tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:38.139362 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3983d7ee-f0c1-4498-9c3c-40377419646c tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:38.140058 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3983d7ee-f0c1-4498-9c3c-40377419646c tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:38.140510 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3983d7ee-f0c1-4498-9c3c-40377419646c tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:38.140934 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3983d7ee-f0c1-4498-9c3c-40377419646c tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:38.231946 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-3983d7ee-f0c1-4498-9c3c-40377419646c tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acafe7ed414c87a5ca235b96047aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf4e20a59f147afb4f036fc8d04adb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:32:38.239964 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-3983d7ee-f0c1-4498-9c3c-40377419646c tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b" status: 200 len: 1511 microversion: 2.1 time: 0.112206 Sep 27 17:32:38.240686 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 417/807] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:32:38 2022] GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b => generated 1511 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:32:38.265376 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [req-2ba7800d-6f9c-447c-a47e-eda6787ab1ff req-5d797409-8874-40a6-8c7e-dbd5988e78b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7c9bb60-e05b-4527-aa2f-bc6a3c55306b", "name": "network-vif-deleted", "tag": "9d1590c2-6fed-40c4-8aca-ed18ef3c13df"}]} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:32:38.274529 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-2ba7800d-6f9c-447c-a47e-eda6787ab1ff req-5d797409-8874-40a6-8c7e-dbd5988e78b8 service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:38.275006 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-2ba7800d-6f9c-447c-a47e-eda6787ab1ff req-5d797409-8874-40a6-8c7e-dbd5988e78b8 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:38.275438 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-2ba7800d-6f9c-447c-a47e-eda6787ab1ff req-5d797409-8874-40a6-8c7e-dbd5988e78b8 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:38.288880 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.compute.server_external_events [req-2ba7800d-6f9c-447c-a47e-eda6787ab1ff req-5d797409-8874-40a6-8c7e-dbd5988e78b8 service nova] Creating event network-vif-deleted:9d1590c2-6fed-40c4-8aca-ed18ef3c13df for instance d7c9bb60-e05b-4527-aa2f-bc6a3c55306b on hv-cinder-84914 Sep 27 17:32:38.293781 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [req-2ba7800d-6f9c-447c-a47e-eda6787ab1ff req-5d797409-8874-40a6-8c7e-dbd5988e78b8 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032683 Sep 27 17:32:38.294678 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 391/808] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:32:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:32:39.124057 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-1fb63cf2-3a0d-4bd6-8419-442eb60b8c73 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:32:39.125257 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-1fb63cf2-3a0d-4bd6-8419-442eb60b8c73 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: f84aa405-baed-4bb8-84db-ab3592929c8a] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:32:39.131287 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1fb63cf2-3a0d-4bd6-8419-442eb60b8c73 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:39.131769 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1fb63cf2-3a0d-4bd6-8419-442eb60b8c73 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:39.132314 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1fb63cf2-3a0d-4bd6-8419-442eb60b8c73 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:39.132877 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1fb63cf2-3a0d-4bd6-8419-442eb60b8c73 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:39.133332 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1fb63cf2-3a0d-4bd6-8419-442eb60b8c73 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:39.133753 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1fb63cf2-3a0d-4bd6-8419-442eb60b8c73 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:39.260440 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-1fb63cf2-3a0d-4bd6-8419-442eb60b8c73 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:32:39.265920 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-59e57c6a-f3ae-4d46-b382-afb212222a09 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:32:39.266723 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-59e57c6a-f3ae-4d46-b382-afb212222a09 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:32:39.269044 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-1fb63cf2-3a0d-4bd6-8419-442eb60b8c73 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:32:39.270503 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-1fb63cf2-3a0d-4bd6-8419-442eb60b8c73 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:32:39.271639 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-1fb63cf2-3a0d-4bd6-8419-442eb60b8c73 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a" status: 200 len: 1599 microversion: 2.20 time: 0.153545 Sep 27 17:32:39.272178 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 418/809] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:32:39 2022] GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a => generated 1599 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 17:32:39.272838 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-59e57c6a-f3ae-4d46-b382-afb212222a09 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:39.273420 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-59e57c6a-f3ae-4d46-b382-afb212222a09 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:39.273857 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-59e57c6a-f3ae-4d46-b382-afb212222a09 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:39.274577 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-59e57c6a-f3ae-4d46-b382-afb212222a09 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:39.275035 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-59e57c6a-f3ae-4d46-b382-afb212222a09 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:39.275459 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-59e57c6a-f3ae-4d46-b382-afb212222a09 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:39.296299 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-2ff964be-9811-4e4c-a7cc-4258fa3a2da1 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:32:39.296782 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-2ff964be-9811-4e4c-a7cc-4258fa3a2da1 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: f84aa405-baed-4bb8-84db-ab3592929c8a] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:32:39.302639 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-2ff964be-9811-4e4c-a7cc-4258fa3a2da1 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:39.303050 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-2ff964be-9811-4e4c-a7cc-4258fa3a2da1 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:39.303480 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-2ff964be-9811-4e4c-a7cc-4258fa3a2da1 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:39.304175 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-2ff964be-9811-4e4c-a7cc-4258fa3a2da1 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:39.304621 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-2ff964be-9811-4e4c-a7cc-4258fa3a2da1 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:39.305036 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-2ff964be-9811-4e4c-a7cc-4258fa3a2da1 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:39.307248 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-59e57c6a-f3ae-4d46-b382-afb212222a09 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:39.307915 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-59e57c6a-f3ae-4d46-b382-afb212222a09 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:39.308351 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-59e57c6a-f3ae-4d46-b382-afb212222a09 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:39.308798 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.objects.instance [None req-59e57c6a-f3ae-4d46-b382-afb212222a09 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lazy-loading 'fault' on Instance uuid d7c9bb60-e05b-4527-aa2f-bc6a3c55306b {{(pid=120415) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 17:32:39.362377 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-59e57c6a-f3ae-4d46-b382-afb212222a09 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3acafe7ed414c87a5ca235b96047aca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bf4e20a59f147afb4f036fc8d04adb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:32:39.370704 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-59e57c6a-f3ae-4d46-b382-afb212222a09 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b" status: 200 len: 1347 microversion: 2.1 time: 0.110171 Sep 27 17:32:39.371409 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 392/810] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:32:39 2022] GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b => generated 1347 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:32:39.402339 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-2ff964be-9811-4e4c-a7cc-4258fa3a2da1 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.109808 Sep 27 17:32:39.402936 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 419/811] 10.222.0.55 () {60 vars in 1316 bytes} [Tue Sep 27 17:32:39 2022] GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a/os-interface => generated 284 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 27 17:32:40.321621 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [req-9318d4ae-b874-4edf-9873-38a0bb4756fc req-64199860-e2cc-406b-a330-c6ad18a2d6fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f84aa405-baed-4bb8-84db-ab3592929c8a", "tag": "44bdfd6c-6234-47ec-8359-4819b713d0a5"}]} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:32:40.332038 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-9318d4ae-b874-4edf-9873-38a0bb4756fc req-64199860-e2cc-406b-a330-c6ad18a2d6fe service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:40.332585 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-9318d4ae-b874-4edf-9873-38a0bb4756fc req-64199860-e2cc-406b-a330-c6ad18a2d6fe service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:40.333098 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-9318d4ae-b874-4edf-9873-38a0bb4756fc req-64199860-e2cc-406b-a330-c6ad18a2d6fe service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:40.344641 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.compute.server_external_events [req-9318d4ae-b874-4edf-9873-38a0bb4756fc req-64199860-e2cc-406b-a330-c6ad18a2d6fe service nova] Creating event network-changed:44bdfd6c-6234-47ec-8359-4819b713d0a5 for instance f84aa405-baed-4bb8-84db-ab3592929c8a on hv-cinder-84914 Sep 27 17:32:40.349500 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [req-9318d4ae-b874-4edf-9873-38a0bb4756fc req-64199860-e2cc-406b-a330-c6ad18a2d6fe service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031671 Sep 27 17:32:40.350323 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 393/812] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:32:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:32:40.395970 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-2910c424-45c4-42f1-825d-22bbdb5d6e80 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:32:40.396707 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-2910c424-45c4-42f1-825d-22bbdb5d6e80 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] [instance: d7c9bb60-e05b-4527-aa2f-bc6a3c55306b] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:32:40.412889 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-2910c424-45c4-42f1-825d-22bbdb5d6e80 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:40.413381 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-2910c424-45c4-42f1-825d-22bbdb5d6e80 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:40.413806 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-2910c424-45c4-42f1-825d-22bbdb5d6e80 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:40.414532 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-2910c424-45c4-42f1-825d-22bbdb5d6e80 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:40.414980 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-2910c424-45c4-42f1-825d-22bbdb5d6e80 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:40.415397 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-2910c424-45c4-42f1-825d-22bbdb5d6e80 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:40.429827 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.wsgi [None req-2910c424-45c4-42f1-825d-22bbdb5d6e80 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] HTTP exception thrown: Instance d7c9bb60-e05b-4527-aa2f-bc6a3c55306b could not be found. Sep 27 17:32:40.431579 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-2910c424-45c4-42f1-825d-22bbdb5d6e80 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Request method failure captured: Sep 27 17:32:40.431579 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: request: GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b HTTP/1.1 Sep 27 17:32:40.431579 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Accept: application/json Sep 27 17:32:40.431579 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Accept-Encoding: identity Sep 27 17:32:40.431579 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Connection: close Sep 27 17:32:40.431579 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Content-Length: 0 Sep 27 17:32:40.431579 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Content-Type: application/json Sep 27 17:32:40.431579 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Host: 10.222.0.55 Sep 27 17:32:40.431579 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Openstack-System-Scope: None Sep 27 17:32:40.431579 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: User-Agent: python-urllib3/1.26.12 Sep 27 17:32:40.431579 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Auth-Token: gAAAAABjMzJLeClAGqlHRuAV_SxvJD0aeI70kpG9RfGfUhZvJQRRlAA9oicjk1kuQZ033obav_9XV9bxW7vKeKgaPTp4TQzN-z-RXwNSfxV9CF3m2XhpuYNO9gwhvr3wTE25UjMMrmDtQacUeRoz9dVLtVesZTnguuUH7Qg2pMSQU8lwtF-Vofo Sep 27 17:32:40.431579 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Domain-Id: None Sep 27 17:32:40.431579 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Domain-Name: None Sep 27 17:32:40.431579 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Identity-Status: Confirmed Sep 27 17:32:40.431579 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Is-Admin-Project: True Sep 27 17:32:40.431579 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Domain-Id: default Sep 27 17:32:40.431579 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Domain-Name: Default Sep 27 17:32:40.431579 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Id: 9bf4e20a59f147afb4f036fc8d04adb2 Sep 27 17:32:40.431579 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Name: tempest-TestMinimumBasicScenario-887258868 Sep 27 17:32:40.431579 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Role: reader,member Sep 27 17:32:40.431579 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Roles: reader,member Sep 27 17:32:40.433008 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/9bf4e20a59f147afb4f036fc8d04adb2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_9bf4e20a59f147afb4f036fc8d04adb2", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/9bf4e20a59f147afb4f036fc8d04adb2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/9bf4e20a59f147afb4f036fc8d04adb2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 27 17:32:40.433008 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Tenant: tempest-TestMinimumBasicScenario-887258868 Sep 27 17:32:40.433008 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Tenant-Id: 9bf4e20a59f147afb4f036fc8d04adb2 Sep 27 17:32:40.433008 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Tenant-Name: tempest-TestMinimumBasicScenario-887258868 Sep 27 17:32:40.433008 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User: tempest-TestMinimumBasicScenario-887258868-project Sep 27 17:32:40.433008 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Domain-Id: default Sep 27 17:32:40.433008 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Domain-Name: Default Sep 27 17:32:40.433008 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Id: c3acafe7ed414c87a5ca235b96047aca Sep 27 17:32:40.433008 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Name: tempest-TestMinimumBasicScenario-887258868-project Sep 27 17:32:40.433008 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: method: > Sep 27 17:32:40.433008 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: exception: Instance d7c9bb60-e05b-4527-aa2f-bc6a3c55306b could not be found. Sep 27 17:32:40.433008 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: action_args: {'id': 'd7c9bb60-e05b-4527-aa2f-bc6a3c55306b'} Sep 27 17:32:40.433773 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 17:32:40.433773 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:32:40.433773 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 17:32:40.433773 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 17:32:40.433773 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 17:32:40.433773 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 17:32:40.433773 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 17:32:40.433773 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 17:32:40.433773 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 17:32:40.433773 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 17:32:40.433773 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7c9bb60-e05b-4527-aa2f-bc6a3c55306b could not be found. Sep 27 17:32:40.433773 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:32:40.433773 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:32:40.433773 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:32:40.433773 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:32:40.433773 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:32:40.433773 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:32:40.433773 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 17:32:40.433773 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 17:32:40.433773 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 17:32:40.436093 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 17:32:40.436093 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 17:32:40.436093 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 17:32:40.436093 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 17:32:40.436093 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 17:32:40.436093 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 17:32:40.436093 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 17:32:40.436093 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7c9bb60-e05b-4527-aa2f-bc6a3c55306b could not be found. Sep 27 17:32:40.436093 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:32:40.436093 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:32:40.436093 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:32:40.436093 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:32:40.436093 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:32:40.436093 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:32:40.436093 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 17:32:40.436093 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 17:32:40.436093 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7c9bb60-e05b-4527-aa2f-bc6a3c55306b could not be found. Sep 27 17:32:40.436093 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:32:40.437702 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-2910c424-45c4-42f1-825d-22bbdb5d6e80 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Returning 404 to user: Instance d7c9bb60-e05b-4527-aa2f-bc6a3c55306b could not be found. {{(pid=120416) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 17:32:40.437702 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-2910c424-45c4-42f1-825d-22bbdb5d6e80 tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b" status: 404 len: 111 microversion: 2.1 time: 0.041287 Sep 27 17:32:40.437702 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 420/813] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:32:40 2022] GET /compute/v2.1/servers/d7c9bb60-e05b-4527-aa2f-bc6a3c55306b => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 17:32:40.443393 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-8fe2a165-f771-49cf-afb2-82c0f5ea425e tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] Calling method '.version_select at 0x7fe724837af0>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:32:40.464451 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-8fe2a165-f771-49cf-afb2-82c0f5ea425e tempest-TestMinimumBasicScenario-887258868 tempest-TestMinimumBasicScenario-887258868-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-270604046" status: 202 len: 0 microversion: 2.1 time: 0.025173 Sep 27 17:32:40.465389 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 394/814] 10.222.0.55 () {58 vars in 1269 bytes} [Tue Sep 27 17:32:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-270604046 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 17:32:41.421754 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-fdaf7086-7071-4416-b843-249ce753e1e7 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:32:41.422798 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-fdaf7086-7071-4416-b843-249ce753e1e7 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] [instance: 8b3855b6-18b1-46de-a1cc-f7a2941a42b9] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:32:41.433344 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-fdaf7086-7071-4416-b843-249ce753e1e7 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:41.434604 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-fdaf7086-7071-4416-b843-249ce753e1e7 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:41.435259 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-fdaf7086-7071-4416-b843-249ce753e1e7 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:41.436776 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-fdaf7086-7071-4416-b843-249ce753e1e7 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:41.437400 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-fdaf7086-7071-4416-b843-249ce753e1e7 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:41.437988 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-fdaf7086-7071-4416-b843-249ce753e1e7 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:41.464204 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.objects.instance [None req-fdaf7086-7071-4416-b843-249ce753e1e7 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lazy-loading 'flavor' on Instance uuid 8b3855b6-18b1-46de-a1cc-f7a2941a42b9 {{(pid=120416) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 17:32:41.544862 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-fdaf7086-7071-4416-b843-249ce753e1e7 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] 10.222.0.55 "POST /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9/action" status: 202 len: 0 microversion: 2.1 time: 0.127839 Sep 27 17:32:41.545452 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 421/815] 10.222.0.55 () {60 vars in 1278 bytes} [Tue Sep 27 17:32:41 2022] POST /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 17:32:41.554692 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-905d62a1-21e1-4fec-8128-39c37979bf30 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:32:41.557332 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-905d62a1-21e1-4fec-8128-39c37979bf30 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] [instance: 8b3855b6-18b1-46de-a1cc-f7a2941a42b9] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:32:41.568200 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-905d62a1-21e1-4fec-8128-39c37979bf30 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:41.569496 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-905d62a1-21e1-4fec-8128-39c37979bf30 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:41.570135 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-905d62a1-21e1-4fec-8128-39c37979bf30 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:41.570766 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-905d62a1-21e1-4fec-8128-39c37979bf30 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:41.571277 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-905d62a1-21e1-4fec-8128-39c37979bf30 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:41.571701 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-905d62a1-21e1-4fec-8128-39c37979bf30 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:41.795204 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-905d62a1-21e1-4fec-8128-39c37979bf30 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5bf070765946168f7e5937f2b076c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890469995c02465eb9b9ad2d1fb9ab6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:32:41.803070 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-905d62a1-21e1-4fec-8128-39c37979bf30 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] 10.222.0.55 "GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9" status: 200 len: 1567 microversion: 2.1 time: 0.253022 Sep 27 17:32:41.803635 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 395/816] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:32:41 2022] GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9 => generated 1567 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:32:42.828098 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-c6d95f0b-c395-4741-ad9a-62772e8df519 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:32:42.828730 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-c6d95f0b-c395-4741-ad9a-62772e8df519 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] [instance: 8b3855b6-18b1-46de-a1cc-f7a2941a42b9] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:32:42.835412 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c6d95f0b-c395-4741-ad9a-62772e8df519 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:42.835904 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c6d95f0b-c395-4741-ad9a-62772e8df519 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:42.836340 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c6d95f0b-c395-4741-ad9a-62772e8df519 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:42.837190 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c6d95f0b-c395-4741-ad9a-62772e8df519 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:42.837651 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c6d95f0b-c395-4741-ad9a-62772e8df519 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:42.838097 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c6d95f0b-c395-4741-ad9a-62772e8df519 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:42.973447 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-c6d95f0b-c395-4741-ad9a-62772e8df519 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5bf070765946168f7e5937f2b076c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890469995c02465eb9b9ad2d1fb9ab6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:32:42.983060 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-c6d95f0b-c395-4741-ad9a-62772e8df519 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] 10.222.0.55 "GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9" status: 200 len: 1567 microversion: 2.1 time: 0.159134 Sep 27 17:32:42.983901 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 422/817] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:32:42 2022] GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9 => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:32:44.006492 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-618e239a-b9fc-4326-ac8f-4f3b640511f3 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:32:44.007352 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-618e239a-b9fc-4326-ac8f-4f3b640511f3 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] [instance: 8b3855b6-18b1-46de-a1cc-f7a2941a42b9] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:32:44.014512 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-618e239a-b9fc-4326-ac8f-4f3b640511f3 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:44.015106 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-618e239a-b9fc-4326-ac8f-4f3b640511f3 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:44.015614 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-618e239a-b9fc-4326-ac8f-4f3b640511f3 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:44.016371 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-618e239a-b9fc-4326-ac8f-4f3b640511f3 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:44.016889 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-618e239a-b9fc-4326-ac8f-4f3b640511f3 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:44.017531 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-618e239a-b9fc-4326-ac8f-4f3b640511f3 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:44.228984 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-618e239a-b9fc-4326-ac8f-4f3b640511f3 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5bf070765946168f7e5937f2b076c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890469995c02465eb9b9ad2d1fb9ab6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:32:44.238789 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-618e239a-b9fc-4326-ac8f-4f3b640511f3 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] 10.222.0.55 "GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9" status: 200 len: 1567 microversion: 2.1 time: 0.236208 Sep 27 17:32:44.240365 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 396/818] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:32:44 2022] GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9 => generated 1567 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:32:45.077343 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-64a54a59-7a83-4149-b709-212dda221011 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:32:45.077832 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-64a54a59-7a83-4149-b709-212dda221011 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:32:45.079745 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:32:45.085681 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-64a54a59-7a83-4149-b709-212dda221011 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:45.086223 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-64a54a59-7a83-4149-b709-212dda221011 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:45.086652 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-64a54a59-7a83-4149-b709-212dda221011 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:45.087334 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-64a54a59-7a83-4149-b709-212dda221011 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:45.087776 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-64a54a59-7a83-4149-b709-212dda221011 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:45.088192 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-64a54a59-7a83-4149-b709-212dda221011 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:45.173805 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.objects.instance [None req-64a54a59-7a83-4149-b709-212dda221011 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lazy-loading 'services' on Instance uuid ca74fda8-afd6-41f2-8c93-5e8971c645f1 {{(pid=120416) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 17:32:45.257923 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-64a54a59-7a83-4149-b709-212dda221011 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "DELETE /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1/os-volume_attachments/1fff520c-19e5-4d3a-9712-154acb0ecb10" status: 202 len: 0 microversion: 2.1 time: 0.185742 Sep 27 17:32:45.261705 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 423/819] 10.222.0.55 () {58 vars in 1416 bytes} [Tue Sep 27 17:32:45 2022] DELETE /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1/os-volume_attachments/1fff520c-19e5-4d3a-9712-154acb0ecb10 => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 17:32:45.264178 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-d4cb33a7-7c3f-40eb-a445-bff36d18d4e3 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:32:45.264569 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-d4cb33a7-7c3f-40eb-a445-bff36d18d4e3 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] [instance: 8b3855b6-18b1-46de-a1cc-f7a2941a42b9] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:32:45.275185 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_api:SELECT=74,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:32:45.277068 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d4cb33a7-7c3f-40eb-a445-bff36d18d4e3 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:45.277593 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d4cb33a7-7c3f-40eb-a445-bff36d18d4e3 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:45.278146 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d4cb33a7-7c3f-40eb-a445-bff36d18d4e3 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:45.280073 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d4cb33a7-7c3f-40eb-a445-bff36d18d4e3 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:45.280073 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d4cb33a7-7c3f-40eb-a445-bff36d18d4e3 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:45.280292 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d4cb33a7-7c3f-40eb-a445-bff36d18d4e3 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:45.286724 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-adf75bc4-2862-4f6f-888a-a18fc223de24 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:32:45.289403 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-adf75bc4-2862-4f6f-888a-a18fc223de24 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:32:45.298444 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-adf75bc4-2862-4f6f-888a-a18fc223de24 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:45.298921 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-adf75bc4-2862-4f6f-888a-a18fc223de24 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:45.299363 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-adf75bc4-2862-4f6f-888a-a18fc223de24 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:45.300054 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-adf75bc4-2862-4f6f-888a-a18fc223de24 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:45.300707 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-adf75bc4-2862-4f6f-888a-a18fc223de24 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:45.301145 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-adf75bc4-2862-4f6f-888a-a18fc223de24 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:45.353042 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-adf75bc4-2862-4f6f-888a-a18fc223de24 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082725 Sep 27 17:32:45.354639 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 424/820] 10.222.0.55 () {58 vars in 1302 bytes} [Tue Sep 27 17:32:45 2022] GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:32:45.455929 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-d4cb33a7-7c3f-40eb-a445-bff36d18d4e3 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5bf070765946168f7e5937f2b076c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890469995c02465eb9b9ad2d1fb9ab6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:32:45.463769 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-d4cb33a7-7c3f-40eb-a445-bff36d18d4e3 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] 10.222.0.55 "GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9" status: 200 len: 1567 microversion: 2.1 time: 0.205032 Sep 27 17:32:45.464333 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 397/821] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:32:45 2022] GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9 => generated 1567 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:32:45.964614 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-c23ca0b2-f12f-4872-8365-88cfb11e4d6e tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:32:45.965338 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-c23ca0b2-f12f-4872-8365-88cfb11e4d6e tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: 9cd2f537-78c4-4a00-95ab-4f7b115810cd] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:32:45.971233 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c23ca0b2-f12f-4872-8365-88cfb11e4d6e tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:45.971713 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c23ca0b2-f12f-4872-8365-88cfb11e4d6e tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:45.972143 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c23ca0b2-f12f-4872-8365-88cfb11e4d6e tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:45.972826 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c23ca0b2-f12f-4872-8365-88cfb11e4d6e tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:45.973275 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c23ca0b2-f12f-4872-8365-88cfb11e4d6e tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:45.973695 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c23ca0b2-f12f-4872-8365-88cfb11e4d6e tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:46.004771 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-c23ca0b2-f12f-4872-8365-88cfb11e4d6e tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/9cd2f537-78c4-4a00-95ab-4f7b115810cd/ips" status: 200 len: 150 microversion: 2.1 time: 0.103805 Sep 27 17:32:46.005893 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 425/822] 10.222.0.55 () {58 vars in 1248 bytes} [Tue Sep 27 17:32:45 2022] GET /compute/v2.1/servers/9cd2f537-78c4-4a00-95ab-4f7b115810cd/ips => generated 150 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 17:32:46.018394 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-4c9393db-701d-48d2-9d7e-4da625fe452e tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "27b6cfd9-3384-409b-a763-5be9d5c19670"}} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:32:46.020749 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-4c9393db-701d-48d2-9d7e-4da625fe452e tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: 9cd2f537-78c4-4a00-95ab-4f7b115810cd] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:32:46.028165 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4c9393db-701d-48d2-9d7e-4da625fe452e tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:46.028654 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4c9393db-701d-48d2-9d7e-4da625fe452e tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:46.029084 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4c9393db-701d-48d2-9d7e-4da625fe452e tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:46.029774 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4c9393db-701d-48d2-9d7e-4da625fe452e tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:46.030267 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4c9393db-701d-48d2-9d7e-4da625fe452e tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:46.030683 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4c9393db-701d-48d2-9d7e-4da625fe452e tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:46.117228 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.wsgi [None req-4c9393db-701d-48d2-9d7e-4da625fe452e tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] HTTP exception thrown: Invalid volume: volume 27b6cfd9-3384-409b-a763-5be9d5c19670 is already attached to instances: fef20d9a-42bf-4605-bbcb-b673d215a5b9 Sep 27 17:32:46.119129 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-4c9393db-701d-48d2-9d7e-4da625fe452e tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Request method failure captured: Sep 27 17:32:46.119129 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: request: POST /compute/v2.1/servers/9cd2f537-78c4-4a00-95ab-4f7b115810cd/os-volume_attachments HTTP/1.1 Sep 27 17:32:46.119129 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Accept: application/json Sep 27 17:32:46.119129 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Accept-Encoding: identity Sep 27 17:32:46.119129 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Connection: close Sep 27 17:32:46.119129 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Content-Length: 74 Sep 27 17:32:46.119129 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Content-Type: application/json Sep 27 17:32:46.119129 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Host: 10.222.0.55 Sep 27 17:32:46.119129 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Openstack-System-Scope: None Sep 27 17:32:46.119129 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: User-Agent: python-urllib3/1.26.12 Sep 27 17:32:46.119129 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Auth-Token: gAAAAABjMzJLbcCEQOqdb7vUsgmB1kYoJEkf6gmC-gBv2tRXmVys19QrTRcPsWXwKEDAq84Zx8Lk9yj3l6xwznprR9KLIbGZ9V7KSdvhEmUqz6sxyX18DRVOHZ32x9KkM54n-fmW5MzSlVPgKqrw3Lvqvb4fGZ9DWc41NDKWL10YNVKBy3FY280 Sep 27 17:32:46.119129 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Domain-Id: None Sep 27 17:32:46.119129 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Domain-Name: None Sep 27 17:32:46.119129 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Identity-Status: Confirmed Sep 27 17:32:46.119129 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Is-Admin-Project: True Sep 27 17:32:46.119129 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Domain-Id: default Sep 27 17:32:46.119129 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Domain-Name: Default Sep 27 17:32:46.119129 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Id: ef13103d3d8b43e1882d4820c8d9247b Sep 27 17:32:46.119129 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Name: tempest-AttachVolumeNegativeTest-1423690367 Sep 27 17:32:46.119129 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Role: reader,member Sep 27 17:32:46.119129 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Roles: reader,member Sep 27 17:32:46.120609 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ef13103d3d8b43e1882d4820c8d9247b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_ef13103d3d8b43e1882d4820c8d9247b", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ef13103d3d8b43e1882d4820c8d9247b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/ef13103d3d8b43e1882d4820c8d9247b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 27 17:32:46.120609 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Tenant: tempest-AttachVolumeNegativeTest-1423690367 Sep 27 17:32:46.120609 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Tenant-Id: ef13103d3d8b43e1882d4820c8d9247b Sep 27 17:32:46.120609 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1423690367 Sep 27 17:32:46.120609 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User: tempest-AttachVolumeNegativeTest-1423690367-project Sep 27 17:32:46.120609 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Domain-Id: default Sep 27 17:32:46.120609 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Domain-Name: Default Sep 27 17:32:46.120609 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Id: 0b02c2ba9a0a48c294a11b42cbfe28e3 Sep 27 17:32:46.120609 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Name: tempest-AttachVolumeNegativeTest-1423690367-project Sep 27 17:32:46.120609 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Sep 27 17:32:46.120609 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: {"volumeAttachment": {"volumeId": "27b6cfd9-3384-409b-a763-5be9d5c19670"}} Sep 27 17:32:46.120609 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: method: > Sep 27 17:32:46.125229 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: exception: Invalid volume: volume 27b6cfd9-3384-409b-a763-5be9d5c19670 is already attached to instances: fef20d9a-42bf-4605-bbcb-b673d215a5b9 Sep 27 17:32:46.125229 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: action_args: {'server_id': '9cd2f537-78c4-4a00-95ab-4f7b115810cd', 'body': {'volumeAttachment': {'volumeId': '27b6cfd9-3384-409b-a763-5be9d5c19670'}}} Sep 27 17:32:46.125229 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 17:32:46.125229 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:32:46.125229 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 27 17:32:46.125229 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 27 17:32:46.125229 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 27 17:32:46.125229 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 27 17:32:46.125229 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 27 17:32:46.125229 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 27 17:32:46.125229 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 27 17:32:46.125229 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 27 17:32:46.125229 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 27 17:32:46.125229 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 27 17:32:46.125229 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 27b6cfd9-3384-409b-a763-5be9d5c19670 is already attached to instances: fef20d9a-42bf-4605-bbcb-b673d215a5b9 Sep 27 17:32:46.125229 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:32:46.125229 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:32:46.125229 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:32:46.125229 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:32:46.126729 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:32:46.126729 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:32:46.126729 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 17:32:46.126729 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 17:32:46.126729 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 17:32:46.126729 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 17:32:46.126729 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 17:32:46.126729 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 17:32:46.126729 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 17:32:46.126729 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 17:32:46.126729 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 17:32:46.126729 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 17:32:46.126729 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 27 17:32:46.126729 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 27 17:32:46.126729 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 27b6cfd9-3384-409b-a763-5be9d5c19670 is already attached to instances: fef20d9a-42bf-4605-bbcb-b673d215a5b9 Sep 27 17:32:46.126729 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:32:46.126729 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:32:46.126729 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:32:46.126729 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:32:46.126729 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:32:46.128068 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:32:46.128068 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 17:32:46.128068 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 17:32:46.128068 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 27b6cfd9-3384-409b-a763-5be9d5c19670 is already attached to instances: fef20d9a-42bf-4605-bbcb-b673d215a5b9 Sep 27 17:32:46.128068 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:32:46.128068 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-4c9393db-701d-48d2-9d7e-4da625fe452e tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Returning 400 to user: Invalid volume: volume 27b6cfd9-3384-409b-a763-5be9d5c19670 is already attached to instances: fef20d9a-42bf-4605-bbcb-b673d215a5b9 {{(pid=120415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 17:32:46.128068 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-4c9393db-701d-48d2-9d7e-4da625fe452e tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "POST /compute/v2.1/servers/9cd2f537-78c4-4a00-95ab-4f7b115810cd/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.106936 Sep 27 17:32:46.128068 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 398/823] 10.222.0.55 () {60 vars in 1323 bytes} [Tue Sep 27 17:32:46 2022] POST /compute/v2.1/servers/9cd2f537-78c4-4a00-95ab-4f7b115810cd/os-volume_attachments => generated 174 bytes in 108 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 27 17:32:46.129848 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-6a68f096-7205-4cb0-906d-a213a0aa5cbc tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:32:46.130374 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-6a68f096-7205-4cb0-906d-a213a0aa5cbc tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: 9cd2f537-78c4-4a00-95ab-4f7b115810cd] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:32:46.136158 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6a68f096-7205-4cb0-906d-a213a0aa5cbc tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:46.136640 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6a68f096-7205-4cb0-906d-a213a0aa5cbc tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:46.137075 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6a68f096-7205-4cb0-906d-a213a0aa5cbc tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:46.137761 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6a68f096-7205-4cb0-906d-a213a0aa5cbc tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:46.138246 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6a68f096-7205-4cb0-906d-a213a0aa5cbc tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:46.138727 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6a68f096-7205-4cb0-906d-a213a0aa5cbc tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:46.168215 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-6a68f096-7205-4cb0-906d-a213a0aa5cbc tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: 9cd2f537-78c4-4a00-95ab-4f7b115810cd] Going to try to terminate instance {{(pid=120416) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 17:32:46.214043 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:32:46.280671 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-6a68f096-7205-4cb0-906d-a213a0aa5cbc tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "DELETE /compute/v2.1/servers/9cd2f537-78c4-4a00-95ab-4f7b115810cd" status: 204 len: 0 microversion: 2.1 time: 0.154119 Sep 27 17:32:46.282864 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 426/824] 10.222.0.55 () {58 vars in 1239 bytes} [Tue Sep 27 17:32:46 2022] DELETE /compute/v2.1/servers/9cd2f537-78c4-4a00-95ab-4f7b115810cd => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 17:32:46.291030 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-7bcf32af-0835-4883-a8ce-a6d02288b076 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:32:46.291831 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-7bcf32af-0835-4883-a8ce-a6d02288b076 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: 9cd2f537-78c4-4a00-95ab-4f7b115810cd] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:32:46.301167 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7bcf32af-0835-4883-a8ce-a6d02288b076 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:46.306581 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7bcf32af-0835-4883-a8ce-a6d02288b076 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:46.307290 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7bcf32af-0835-4883-a8ce-a6d02288b076 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:46.308665 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7bcf32af-0835-4883-a8ce-a6d02288b076 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:46.309216 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7bcf32af-0835-4883-a8ce-a6d02288b076 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:46.309716 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7bcf32af-0835-4883-a8ce-a6d02288b076 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:46.367931 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-4c5d67f7-810e-4944-9c96-79ca812ea713 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:32:46.370924 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-4c5d67f7-810e-4944-9c96-79ca812ea713 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:32:46.378224 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4c5d67f7-810e-4944-9c96-79ca812ea713 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:46.378717 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4c5d67f7-810e-4944-9c96-79ca812ea713 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:46.379207 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4c5d67f7-810e-4944-9c96-79ca812ea713 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:46.379904 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4c5d67f7-810e-4944-9c96-79ca812ea713 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:46.380355 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4c5d67f7-810e-4944-9c96-79ca812ea713 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:46.380777 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4c5d67f7-810e-4944-9c96-79ca812ea713 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:46.415829 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-4c5d67f7-810e-4944-9c96-79ca812ea713 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052121 Sep 27 17:32:46.422302 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 427/825] 10.222.0.55 () {58 vars in 1302 bytes} [Tue Sep 27 17:32:46 2022] GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 17:32:46.476527 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-7bcf32af-0835-4883-a8ce-a6d02288b076 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b02c2ba9a0a48c294a11b42cbfe28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef13103d3d8b43e1882d4820c8d9247b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:32:46.491635 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-7bcf32af-0835-4883-a8ce-a6d02288b076 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/9cd2f537-78c4-4a00-95ab-4f7b115810cd" status: 200 len: 1681 microversion: 2.1 time: 0.205491 Sep 27 17:32:46.492110 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-0785d69c-4fd4-4caa-9405-2c173b5f360d tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:32:46.492898 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-0785d69c-4fd4-4caa-9405-2c173b5f360d tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] [instance: 8b3855b6-18b1-46de-a1cc-f7a2941a42b9] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:32:46.493175 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 399/826] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:32:46 2022] GET /compute/v2.1/servers/9cd2f537-78c4-4a00-95ab-4f7b115810cd => generated 1681 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:32:46.503256 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-0785d69c-4fd4-4caa-9405-2c173b5f360d tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:46.506547 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-0785d69c-4fd4-4caa-9405-2c173b5f360d tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:46.507195 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-0785d69c-4fd4-4caa-9405-2c173b5f360d tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:46.508290 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-0785d69c-4fd4-4caa-9405-2c173b5f360d tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:46.508923 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-0785d69c-4fd4-4caa-9405-2c173b5f360d tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:46.509569 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-0785d69c-4fd4-4caa-9405-2c173b5f360d tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:46.651644 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-0785d69c-4fd4-4caa-9405-2c173b5f360d tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5bf070765946168f7e5937f2b076c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890469995c02465eb9b9ad2d1fb9ab6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:32:46.661212 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-0785d69c-4fd4-4caa-9405-2c173b5f360d tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] 10.222.0.55 "GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9" status: 200 len: 1567 microversion: 2.1 time: 0.176436 Sep 27 17:32:46.662011 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 428/827] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:32:46 2022] GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9 => generated 1567 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:32:47.430544 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-96d9ff7e-b33e-4c7b-9c46-ffd53f518b6f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:32:47.433765 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-96d9ff7e-b33e-4c7b-9c46-ffd53f518b6f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:32:47.444165 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-96d9ff7e-b33e-4c7b-9c46-ffd53f518b6f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:47.445497 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-96d9ff7e-b33e-4c7b-9c46-ffd53f518b6f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:47.446387 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-96d9ff7e-b33e-4c7b-9c46-ffd53f518b6f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:47.448207 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-96d9ff7e-b33e-4c7b-9c46-ffd53f518b6f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:47.448762 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-96d9ff7e-b33e-4c7b-9c46-ffd53f518b6f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:47.449681 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-96d9ff7e-b33e-4c7b-9c46-ffd53f518b6f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:47.487184 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-96d9ff7e-b33e-4c7b-9c46-ffd53f518b6f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062226 Sep 27 17:32:47.487764 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 400/828] 10.222.0.55 () {58 vars in 1302 bytes} [Tue Sep 27 17:32:47 2022] GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:32:47.516115 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-871c9ac7-d4e9-4646-8a53-bf515d9b9723 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:32:47.516849 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-871c9ac7-d4e9-4646-8a53-bf515d9b9723 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: 9cd2f537-78c4-4a00-95ab-4f7b115810cd] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:32:47.523368 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-871c9ac7-d4e9-4646-8a53-bf515d9b9723 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:47.524105 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-871c9ac7-d4e9-4646-8a53-bf515d9b9723 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:47.524788 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-871c9ac7-d4e9-4646-8a53-bf515d9b9723 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:47.525587 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-871c9ac7-d4e9-4646-8a53-bf515d9b9723 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:47.526152 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-871c9ac7-d4e9-4646-8a53-bf515d9b9723 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:47.526809 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-871c9ac7-d4e9-4646-8a53-bf515d9b9723 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:47.689205 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-99c99f21-8b92-4b87-8bab-2610ba19f04c tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:32:47.689737 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-99c99f21-8b92-4b87-8bab-2610ba19f04c tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] [instance: 8b3855b6-18b1-46de-a1cc-f7a2941a42b9] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:32:47.699931 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-99c99f21-8b92-4b87-8bab-2610ba19f04c tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:47.706104 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-99c99f21-8b92-4b87-8bab-2610ba19f04c tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:47.706629 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-99c99f21-8b92-4b87-8bab-2610ba19f04c tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:47.707437 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-99c99f21-8b92-4b87-8bab-2610ba19f04c tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:47.708084 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-99c99f21-8b92-4b87-8bab-2610ba19f04c tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:47.708724 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-99c99f21-8b92-4b87-8bab-2610ba19f04c tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:47.737941 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-871c9ac7-d4e9-4646-8a53-bf515d9b9723 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b02c2ba9a0a48c294a11b42cbfe28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef13103d3d8b43e1882d4820c8d9247b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:32:47.747735 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-871c9ac7-d4e9-4646-8a53-bf515d9b9723 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/9cd2f537-78c4-4a00-95ab-4f7b115810cd" status: 200 len: 1681 microversion: 2.1 time: 0.235468 Sep 27 17:32:47.749726 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 429/829] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:32:47 2022] GET /compute/v2.1/servers/9cd2f537-78c4-4a00-95ab-4f7b115810cd => generated 1681 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:32:47.878040 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-99c99f21-8b92-4b87-8bab-2610ba19f04c tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5bf070765946168f7e5937f2b076c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890469995c02465eb9b9ad2d1fb9ab6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:32:47.886166 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-99c99f21-8b92-4b87-8bab-2610ba19f04c tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] 10.222.0.55 "GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9" status: 200 len: 1567 microversion: 2.1 time: 0.205265 Sep 27 17:32:47.891992 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 401/830] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:32:47 2022] GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9 => generated 1567 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:32:48.499349 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-ffa23d33-63cb-42dd-9031-f014a8a4bbe6 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:32:48.501861 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-ffa23d33-63cb-42dd-9031-f014a8a4bbe6 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:32:48.508909 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ffa23d33-63cb-42dd-9031-f014a8a4bbe6 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:48.509398 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ffa23d33-63cb-42dd-9031-f014a8a4bbe6 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:48.509820 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ffa23d33-63cb-42dd-9031-f014a8a4bbe6 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:48.510750 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ffa23d33-63cb-42dd-9031-f014a8a4bbe6 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:48.511197 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ffa23d33-63cb-42dd-9031-f014a8a4bbe6 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:48.511615 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ffa23d33-63cb-42dd-9031-f014a8a4bbe6 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:48.551560 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-ffa23d33-63cb-42dd-9031-f014a8a4bbe6 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056385 Sep 27 17:32:48.558037 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 430/831] 10.222.0.55 () {58 vars in 1302 bytes} [Tue Sep 27 17:32:48 2022] GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 17:32:48.677946 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-e0f3dc0e-c9aa-422a-b45d-1ff551ccf166 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:32:48.678521 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-e0f3dc0e-c9aa-422a-b45d-1ff551ccf166 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:32:48.685722 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e0f3dc0e-c9aa-422a-b45d-1ff551ccf166 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:48.686253 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e0f3dc0e-c9aa-422a-b45d-1ff551ccf166 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:48.686924 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e0f3dc0e-c9aa-422a-b45d-1ff551ccf166 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:48.688044 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e0f3dc0e-c9aa-422a-b45d-1ff551ccf166 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:48.688657 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e0f3dc0e-c9aa-422a-b45d-1ff551ccf166 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:48.689234 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e0f3dc0e-c9aa-422a-b45d-1ff551ccf166 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:48.719602 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-e0f3dc0e-c9aa-422a-b45d-1ff551ccf166 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Going to try to terminate instance {{(pid=120415) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 17:32:48.773604 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-70a8fe9e-0a88-4721-b1a1-dbb87c073636 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:32:48.774246 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-70a8fe9e-0a88-4721-b1a1-dbb87c073636 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: 9cd2f537-78c4-4a00-95ab-4f7b115810cd] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:32:48.781386 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-70a8fe9e-0a88-4721-b1a1-dbb87c073636 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:48.782188 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-70a8fe9e-0a88-4721-b1a1-dbb87c073636 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:48.782871 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-70a8fe9e-0a88-4721-b1a1-dbb87c073636 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:48.784737 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-70a8fe9e-0a88-4721-b1a1-dbb87c073636 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:48.785434 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-70a8fe9e-0a88-4721-b1a1-dbb87c073636 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:48.786149 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-70a8fe9e-0a88-4721-b1a1-dbb87c073636 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:48.814004 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-e0f3dc0e-c9aa-422a-b45d-1ff551ccf166 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "DELETE /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1" status: 204 len: 0 microversion: 2.1 time: 0.139413 Sep 27 17:32:48.816004 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 402/832] 10.222.0.55 () {58 vars in 1239 bytes} [Tue Sep 27 17:32:48 2022] DELETE /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 17:32:48.824256 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-6643f718-6160-456f-a8ea-6fd07f737e5b tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:32:48.825331 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-6643f718-6160-456f-a8ea-6fd07f737e5b tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:32:48.832266 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6643f718-6160-456f-a8ea-6fd07f737e5b tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:48.833000 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6643f718-6160-456f-a8ea-6fd07f737e5b tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:48.833610 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6643f718-6160-456f-a8ea-6fd07f737e5b tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:48.834734 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6643f718-6160-456f-a8ea-6fd07f737e5b tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:48.835356 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6643f718-6160-456f-a8ea-6fd07f737e5b tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:48.835987 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6643f718-6160-456f-a8ea-6fd07f737e5b tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:48.896225 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-70a8fe9e-0a88-4721-b1a1-dbb87c073636 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b02c2ba9a0a48c294a11b42cbfe28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef13103d3d8b43e1882d4820c8d9247b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:32:48.907085 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-70a8fe9e-0a88-4721-b1a1-dbb87c073636 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/9cd2f537-78c4-4a00-95ab-4f7b115810cd" status: 200 len: 1614 microversion: 2.1 time: 0.137260 Sep 27 17:32:48.908206 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 431/833] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:32:48 2022] GET /compute/v2.1/servers/9cd2f537-78c4-4a00-95ab-4f7b115810cd => generated 1614 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:32:48.926510 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-a625c0b8-e695-4a12-84c8-88d21335bedd tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:32:48.927402 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-a625c0b8-e695-4a12-84c8-88d21335bedd tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] [instance: 8b3855b6-18b1-46de-a1cc-f7a2941a42b9] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:32:48.934827 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a625c0b8-e695-4a12-84c8-88d21335bedd tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:48.935748 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a625c0b8-e695-4a12-84c8-88d21335bedd tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:48.936343 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a625c0b8-e695-4a12-84c8-88d21335bedd tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:48.937422 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a625c0b8-e695-4a12-84c8-88d21335bedd tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:48.938806 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a625c0b8-e695-4a12-84c8-88d21335bedd tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:48.939572 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a625c0b8-e695-4a12-84c8-88d21335bedd tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:49.080316 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-6643f718-6160-456f-a8ea-6fd07f737e5b tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:32:49.102184 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-6643f718-6160-456f-a8ea-6fd07f737e5b tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1" status: 200 len: 1691 microversion: 2.1 time: 0.271327 Sep 27 17:32:49.102184 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 403/834] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:32:48 2022] GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1 => generated 1691 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:32:49.136471 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-a625c0b8-e695-4a12-84c8-88d21335bedd tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5bf070765946168f7e5937f2b076c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890469995c02465eb9b9ad2d1fb9ab6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:32:49.145039 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-a625c0b8-e695-4a12-84c8-88d21335bedd tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] 10.222.0.55 "GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9" status: 200 len: 1567 microversion: 2.1 time: 0.235579 Sep 27 17:32:49.145766 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 432/835] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:32:48 2022] GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9 => generated 1567 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:32:49.176001 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [req-f60761c4-abee-4e5a-b80e-0582c5eafed6 req-64102749-4329-41a2-abb9-118e4f5dbe42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cd2f537-78c4-4a00-95ab-4f7b115810cd", "name": "network-vif-deleted", "tag": "a7cbab4a-ebf6-4274-83af-582db23d3344"}]} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:32:49.207292 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-f60761c4-abee-4e5a-b80e-0582c5eafed6 req-64102749-4329-41a2-abb9-118e4f5dbe42 service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:49.207964 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-f60761c4-abee-4e5a-b80e-0582c5eafed6 req-64102749-4329-41a2-abb9-118e4f5dbe42 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:49.208374 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-f60761c4-abee-4e5a-b80e-0582c5eafed6 req-64102749-4329-41a2-abb9-118e4f5dbe42 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:49.225115 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.compute.server_external_events [req-f60761c4-abee-4e5a-b80e-0582c5eafed6 req-64102749-4329-41a2-abb9-118e4f5dbe42 service nova] Creating event network-vif-deleted:a7cbab4a-ebf6-4274-83af-582db23d3344 for instance 9cd2f537-78c4-4a00-95ab-4f7b115810cd on hv-cinder-84914 Sep 27 17:32:49.232182 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [req-f60761c4-abee-4e5a-b80e-0582c5eafed6 req-64102749-4329-41a2-abb9-118e4f5dbe42 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060685 Sep 27 17:32:49.232785 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 404/836] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:32:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:32:49.936826 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-d1999ec1-0447-4467-8545-e38573e5058f tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:32:49.937436 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-d1999ec1-0447-4467-8545-e38573e5058f tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: 9cd2f537-78c4-4a00-95ab-4f7b115810cd] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:32:49.943418 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d1999ec1-0447-4467-8545-e38573e5058f tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:49.944610 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d1999ec1-0447-4467-8545-e38573e5058f tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:49.945063 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d1999ec1-0447-4467-8545-e38573e5058f tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:49.945944 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d1999ec1-0447-4467-8545-e38573e5058f tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:49.946464 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d1999ec1-0447-4467-8545-e38573e5058f tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:49.946862 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d1999ec1-0447-4467-8545-e38573e5058f tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:50.010115 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-d1999ec1-0447-4467-8545-e38573e5058f tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b02c2ba9a0a48c294a11b42cbfe28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef13103d3d8b43e1882d4820c8d9247b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:32:50.018575 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-d1999ec1-0447-4467-8545-e38573e5058f tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/9cd2f537-78c4-4a00-95ab-4f7b115810cd" status: 200 len: 1614 microversion: 2.1 time: 0.085623 Sep 27 17:32:50.019143 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 433/837] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:32:49 2022] GET /compute/v2.1/servers/9cd2f537-78c4-4a00-95ab-4f7b115810cd => generated 1614 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:32:50.118216 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-6d84ef32-a293-4640-97db-68afa23f214d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:32:50.118913 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-6d84ef32-a293-4640-97db-68afa23f214d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:32:50.125668 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6d84ef32-a293-4640-97db-68afa23f214d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:50.126190 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6d84ef32-a293-4640-97db-68afa23f214d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:50.126626 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6d84ef32-a293-4640-97db-68afa23f214d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:50.127320 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6d84ef32-a293-4640-97db-68afa23f214d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:50.127939 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6d84ef32-a293-4640-97db-68afa23f214d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:50.128364 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6d84ef32-a293-4640-97db-68afa23f214d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:50.168612 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-4faabed6-4333-437f-bee5-896425fb0a3e tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:32:50.169257 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-4faabed6-4333-437f-bee5-896425fb0a3e tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] [instance: 8b3855b6-18b1-46de-a1cc-f7a2941a42b9] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:32:50.175635 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4faabed6-4333-437f-bee5-896425fb0a3e tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:50.176221 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4faabed6-4333-437f-bee5-896425fb0a3e tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:50.176754 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4faabed6-4333-437f-bee5-896425fb0a3e tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:50.177732 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4faabed6-4333-437f-bee5-896425fb0a3e tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:50.178218 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4faabed6-4333-437f-bee5-896425fb0a3e tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:50.178804 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4faabed6-4333-437f-bee5-896425fb0a3e tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:50.321635 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-6d84ef32-a293-4640-97db-68afa23f214d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:32:50.330351 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-6d84ef32-a293-4640-97db-68afa23f214d tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1" status: 200 len: 1691 microversion: 2.1 time: 0.216792 Sep 27 17:32:50.331426 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 405/838] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:32:50 2022] GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1 => generated 1691 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:32:50.351794 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-4faabed6-4333-437f-bee5-896425fb0a3e tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5bf070765946168f7e5937f2b076c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890469995c02465eb9b9ad2d1fb9ab6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:32:50.360669 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-4faabed6-4333-437f-bee5-896425fb0a3e tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] 10.222.0.55 "GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9" status: 200 len: 1567 microversion: 2.1 time: 0.196145 Sep 27 17:32:50.361230 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 434/839] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:32:50 2022] GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9 => generated 1567 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:32:51.042598 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-b91fc912-b153-4edd-a1fd-e57ede0e7e0c tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:32:51.043203 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-b91fc912-b153-4edd-a1fd-e57ede0e7e0c tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: 9cd2f537-78c4-4a00-95ab-4f7b115810cd] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:32:51.049074 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b91fc912-b153-4edd-a1fd-e57ede0e7e0c tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:51.049557 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b91fc912-b153-4edd-a1fd-e57ede0e7e0c tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:51.049988 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b91fc912-b153-4edd-a1fd-e57ede0e7e0c tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:51.050694 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b91fc912-b153-4edd-a1fd-e57ede0e7e0c tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:51.051148 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b91fc912-b153-4edd-a1fd-e57ede0e7e0c tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:51.051567 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b91fc912-b153-4edd-a1fd-e57ede0e7e0c tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:51.055621 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:32:51.113791 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-b91fc912-b153-4edd-a1fd-e57ede0e7e0c tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b02c2ba9a0a48c294a11b42cbfe28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef13103d3d8b43e1882d4820c8d9247b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:32:51.121798 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-b91fc912-b153-4edd-a1fd-e57ede0e7e0c tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/9cd2f537-78c4-4a00-95ab-4f7b115810cd" status: 200 len: 1614 microversion: 2.1 time: 0.083079 Sep 27 17:32:51.122393 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 406/840] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:32:51 2022] GET /compute/v2.1/servers/9cd2f537-78c4-4a00-95ab-4f7b115810cd => generated 1614 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:32:51.355784 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-fe435e2a-7bc0-4c8a-81f9-f74251c164dc tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:32:51.356645 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-fe435e2a-7bc0-4c8a-81f9-f74251c164dc tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:32:51.363019 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-fe435e2a-7bc0-4c8a-81f9-f74251c164dc tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:51.363495 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-fe435e2a-7bc0-4c8a-81f9-f74251c164dc tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:51.363926 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-fe435e2a-7bc0-4c8a-81f9-f74251c164dc tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:51.364662 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-fe435e2a-7bc0-4c8a-81f9-f74251c164dc tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:51.365081 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-fe435e2a-7bc0-4c8a-81f9-f74251c164dc tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:51.365500 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-fe435e2a-7bc0-4c8a-81f9-f74251c164dc tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:51.383938 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-b5576607-a851-43f1-ad83-30cb4f3072f8 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:32:51.384584 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-b5576607-a851-43f1-ad83-30cb4f3072f8 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] [instance: 8b3855b6-18b1-46de-a1cc-f7a2941a42b9] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:32:51.390576 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b5576607-a851-43f1-ad83-30cb4f3072f8 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:51.391060 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b5576607-a851-43f1-ad83-30cb4f3072f8 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:51.391498 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b5576607-a851-43f1-ad83-30cb4f3072f8 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:51.392182 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b5576607-a851-43f1-ad83-30cb4f3072f8 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:51.392642 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b5576607-a851-43f1-ad83-30cb4f3072f8 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:51.393068 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b5576607-a851-43f1-ad83-30cb4f3072f8 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:51.545867 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-fe435e2a-7bc0-4c8a-81f9-f74251c164dc tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:32:51.553562 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-fe435e2a-7bc0-4c8a-81f9-f74251c164dc tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1" status: 200 len: 1691 microversion: 2.1 time: 0.201552 Sep 27 17:32:51.554149 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 435/841] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:32:51 2022] GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1 => generated 1691 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:32:51.570183 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-b5576607-a851-43f1-ad83-30cb4f3072f8 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5bf070765946168f7e5937f2b076c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890469995c02465eb9b9ad2d1fb9ab6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:32:51.577897 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-b5576607-a851-43f1-ad83-30cb4f3072f8 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] 10.222.0.55 "GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9" status: 200 len: 1567 microversion: 2.1 time: 0.197953 Sep 27 17:32:51.578513 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 407/842] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:32:51 2022] GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9 => generated 1567 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:32:52.145516 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-39a5576b-0752-426d-9e7f-4a31c18cc2ae tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:32:52.146154 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-39a5576b-0752-426d-9e7f-4a31c18cc2ae tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: 9cd2f537-78c4-4a00-95ab-4f7b115810cd] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:32:52.152042 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-39a5576b-0752-426d-9e7f-4a31c18cc2ae tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:52.152516 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-39a5576b-0752-426d-9e7f-4a31c18cc2ae tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:52.152949 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-39a5576b-0752-426d-9e7f-4a31c18cc2ae tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:52.153611 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-39a5576b-0752-426d-9e7f-4a31c18cc2ae tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:52.154700 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-39a5576b-0752-426d-9e7f-4a31c18cc2ae tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:52.155117 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-39a5576b-0752-426d-9e7f-4a31c18cc2ae tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:52.216011 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-39a5576b-0752-426d-9e7f-4a31c18cc2ae tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b02c2ba9a0a48c294a11b42cbfe28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef13103d3d8b43e1882d4820c8d9247b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:32:52.224241 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-39a5576b-0752-426d-9e7f-4a31c18cc2ae tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/9cd2f537-78c4-4a00-95ab-4f7b115810cd" status: 200 len: 1326 microversion: 2.1 time: 0.082692 Sep 27 17:32:52.224793 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 436/843] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:32:52 2022] GET /compute/v2.1/servers/9cd2f537-78c4-4a00-95ab-4f7b115810cd => generated 1326 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:32:52.577614 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-c2fda1cc-9d8f-4b12-bac6-7134c7b840c2 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:32:52.578204 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-c2fda1cc-9d8f-4b12-bac6-7134c7b840c2 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:32:52.584608 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c2fda1cc-9d8f-4b12-bac6-7134c7b840c2 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:52.585118 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c2fda1cc-9d8f-4b12-bac6-7134c7b840c2 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:52.585591 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c2fda1cc-9d8f-4b12-bac6-7134c7b840c2 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:52.586321 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c2fda1cc-9d8f-4b12-bac6-7134c7b840c2 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:52.586777 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c2fda1cc-9d8f-4b12-bac6-7134c7b840c2 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:52.587202 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c2fda1cc-9d8f-4b12-bac6-7134c7b840c2 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:52.600625 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-41cf06e7-9951-43b6-8554-645af30bf3bd tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:32:52.601229 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-41cf06e7-9951-43b6-8554-645af30bf3bd tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] [instance: 8b3855b6-18b1-46de-a1cc-f7a2941a42b9] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:32:52.607451 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-41cf06e7-9951-43b6-8554-645af30bf3bd tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:52.608023 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-41cf06e7-9951-43b6-8554-645af30bf3bd tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:52.608481 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-41cf06e7-9951-43b6-8554-645af30bf3bd tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:52.609193 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-41cf06e7-9951-43b6-8554-645af30bf3bd tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:52.609639 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-41cf06e7-9951-43b6-8554-645af30bf3bd tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:52.610144 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-41cf06e7-9951-43b6-8554-645af30bf3bd tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:52.788595 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-c2fda1cc-9d8f-4b12-bac6-7134c7b840c2 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:32:52.797691 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-c2fda1cc-9d8f-4b12-bac6-7134c7b840c2 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1" status: 200 len: 1691 microversion: 2.1 time: 0.224572 Sep 27 17:32:52.798658 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 408/844] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:32:52 2022] GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1 => generated 1691 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:32:52.799952 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-41cf06e7-9951-43b6-8554-645af30bf3bd tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5bf070765946168f7e5937f2b076c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890469995c02465eb9b9ad2d1fb9ab6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:32:52.809561 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-41cf06e7-9951-43b6-8554-645af30bf3bd tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] 10.222.0.55 "GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9" status: 200 len: 1567 microversion: 2.1 time: 0.212715 Sep 27 17:32:52.814112 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 437/845] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:32:52 2022] GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9 => generated 1567 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:32:53.248240 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-03df6a41-2a45-44b1-9af2-fb4af1828353 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:32:53.248861 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-03df6a41-2a45-44b1-9af2-fb4af1828353 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: 9cd2f537-78c4-4a00-95ab-4f7b115810cd] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:32:53.254946 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-03df6a41-2a45-44b1-9af2-fb4af1828353 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:53.255467 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-03df6a41-2a45-44b1-9af2-fb4af1828353 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:53.255941 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-03df6a41-2a45-44b1-9af2-fb4af1828353 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:53.256643 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-03df6a41-2a45-44b1-9af2-fb4af1828353 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:53.257100 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-03df6a41-2a45-44b1-9af2-fb4af1828353 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:53.257526 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-03df6a41-2a45-44b1-9af2-fb4af1828353 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:53.288766 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-03df6a41-2a45-44b1-9af2-fb4af1828353 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:53.289248 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-03df6a41-2a45-44b1-9af2-fb4af1828353 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:53.289681 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-03df6a41-2a45-44b1-9af2-fb4af1828353 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:53.290153 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.objects.instance [None req-03df6a41-2a45-44b1-9af2-fb4af1828353 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lazy-loading 'fault' on Instance uuid 9cd2f537-78c4-4a00-95ab-4f7b115810cd {{(pid=120415) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 17:32:53.340395 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-03df6a41-2a45-44b1-9af2-fb4af1828353 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b02c2ba9a0a48c294a11b42cbfe28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef13103d3d8b43e1882d4820c8d9247b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:32:53.349008 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-03df6a41-2a45-44b1-9af2-fb4af1828353 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/9cd2f537-78c4-4a00-95ab-4f7b115810cd" status: 200 len: 1331 microversion: 2.1 time: 0.104874 Sep 27 17:32:53.360218 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 409/846] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:32:53 2022] GET /compute/v2.1/servers/9cd2f537-78c4-4a00-95ab-4f7b115810cd => generated 1331 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:32:53.701870 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [req-720c3095-6171-4a39-831d-b670ae6e66e8 req-8f8f9dbb-02a5-46fb-8313-2fbf3b0d40b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca74fda8-afd6-41f2-8c93-5e8971c645f1", "name": "network-vif-deleted", "tag": "4f5f0e59-cdc1-4e3d-9aac-a193fec519cd"}]} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:32:53.711921 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-720c3095-6171-4a39-831d-b670ae6e66e8 req-8f8f9dbb-02a5-46fb-8313-2fbf3b0d40b1 service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:53.712334 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-720c3095-6171-4a39-831d-b670ae6e66e8 req-8f8f9dbb-02a5-46fb-8313-2fbf3b0d40b1 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:53.712817 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-720c3095-6171-4a39-831d-b670ae6e66e8 req-8f8f9dbb-02a5-46fb-8313-2fbf3b0d40b1 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:53.725009 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.compute.server_external_events [req-720c3095-6171-4a39-831d-b670ae6e66e8 req-8f8f9dbb-02a5-46fb-8313-2fbf3b0d40b1 service nova] Creating event network-vif-deleted:4f5f0e59-cdc1-4e3d-9aac-a193fec519cd for instance ca74fda8-afd6-41f2-8c93-5e8971c645f1 on hv-cinder-84914 Sep 27 17:32:53.730060 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [req-720c3095-6171-4a39-831d-b670ae6e66e8 req-8f8f9dbb-02a5-46fb-8313-2fbf3b0d40b1 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032628 Sep 27 17:32:53.730677 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 438/847] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:32:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:32:53.820914 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-1195baf0-381d-49af-8e0b-4a06ee9aa5f6 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:32:53.821711 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-1195baf0-381d-49af-8e0b-4a06ee9aa5f6 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:32:53.830978 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1195baf0-381d-49af-8e0b-4a06ee9aa5f6 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:53.831690 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1195baf0-381d-49af-8e0b-4a06ee9aa5f6 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:53.832096 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1195baf0-381d-49af-8e0b-4a06ee9aa5f6 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:53.832809 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1195baf0-381d-49af-8e0b-4a06ee9aa5f6 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:53.833253 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1195baf0-381d-49af-8e0b-4a06ee9aa5f6 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:53.833677 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1195baf0-381d-49af-8e0b-4a06ee9aa5f6 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:53.835552 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-9ce30618-b304-426f-8ebf-2c75104ce86b tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:32:53.836464 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-9ce30618-b304-426f-8ebf-2c75104ce86b tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] [instance: 8b3855b6-18b1-46de-a1cc-f7a2941a42b9] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:32:53.843511 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9ce30618-b304-426f-8ebf-2c75104ce86b tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:53.844003 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9ce30618-b304-426f-8ebf-2c75104ce86b tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:53.844438 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9ce30618-b304-426f-8ebf-2c75104ce86b tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:53.845141 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9ce30618-b304-426f-8ebf-2c75104ce86b tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:53.845597 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9ce30618-b304-426f-8ebf-2c75104ce86b tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:53.846024 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9ce30618-b304-426f-8ebf-2c75104ce86b tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:53.906365 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-1195baf0-381d-49af-8e0b-4a06ee9aa5f6 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:32:53.914488 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-1195baf0-381d-49af-8e0b-4a06ee9aa5f6 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1" status: 200 len: 1623 microversion: 2.1 time: 0.097394 Sep 27 17:32:53.915729 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 410/848] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:32:53 2022] GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1 => generated 1623 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:32:54.021053 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-9ce30618-b304-426f-8ebf-2c75104ce86b tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5bf070765946168f7e5937f2b076c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890469995c02465eb9b9ad2d1fb9ab6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:32:54.028809 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-9ce30618-b304-426f-8ebf-2c75104ce86b tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] 10.222.0.55 "GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9" status: 200 len: 1567 microversion: 2.1 time: 0.197344 Sep 27 17:32:54.029325 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 439/849] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:32:53 2022] GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9 => generated 1567 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:32:54.373814 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-27d004c2-ffda-4e16-8efa-0668d48407b1 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:32:54.375128 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-27d004c2-ffda-4e16-8efa-0668d48407b1 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: 9cd2f537-78c4-4a00-95ab-4f7b115810cd] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:32:54.383942 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-27d004c2-ffda-4e16-8efa-0668d48407b1 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:54.384442 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-27d004c2-ffda-4e16-8efa-0668d48407b1 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:54.385719 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-27d004c2-ffda-4e16-8efa-0668d48407b1 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:54.386494 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-27d004c2-ffda-4e16-8efa-0668d48407b1 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:54.386964 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-27d004c2-ffda-4e16-8efa-0668d48407b1 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:54.387396 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-27d004c2-ffda-4e16-8efa-0668d48407b1 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:54.401499 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.wsgi [None req-27d004c2-ffda-4e16-8efa-0668d48407b1 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] HTTP exception thrown: Instance 9cd2f537-78c4-4a00-95ab-4f7b115810cd could not be found. Sep 27 17:32:54.403811 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-27d004c2-ffda-4e16-8efa-0668d48407b1 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Request method failure captured: Sep 27 17:32:54.403811 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: request: GET /compute/v2.1/servers/9cd2f537-78c4-4a00-95ab-4f7b115810cd HTTP/1.1 Sep 27 17:32:54.403811 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Accept: application/json Sep 27 17:32:54.403811 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Accept-Encoding: identity Sep 27 17:32:54.403811 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Connection: close Sep 27 17:32:54.403811 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Content-Length: 0 Sep 27 17:32:54.403811 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Content-Type: application/json Sep 27 17:32:54.403811 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Host: 10.222.0.55 Sep 27 17:32:54.403811 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Openstack-System-Scope: None Sep 27 17:32:54.403811 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: User-Agent: python-urllib3/1.26.12 Sep 27 17:32:54.403811 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Auth-Token: gAAAAABjMzJLbcCEQOqdb7vUsgmB1kYoJEkf6gmC-gBv2tRXmVys19QrTRcPsWXwKEDAq84Zx8Lk9yj3l6xwznprR9KLIbGZ9V7KSdvhEmUqz6sxyX18DRVOHZ32x9KkM54n-fmW5MzSlVPgKqrw3Lvqvb4fGZ9DWc41NDKWL10YNVKBy3FY280 Sep 27 17:32:54.403811 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Domain-Id: None Sep 27 17:32:54.403811 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Domain-Name: None Sep 27 17:32:54.403811 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Identity-Status: Confirmed Sep 27 17:32:54.403811 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Is-Admin-Project: True Sep 27 17:32:54.403811 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Domain-Id: default Sep 27 17:32:54.403811 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Domain-Name: Default Sep 27 17:32:54.403811 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Id: ef13103d3d8b43e1882d4820c8d9247b Sep 27 17:32:54.403811 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Name: tempest-AttachVolumeNegativeTest-1423690367 Sep 27 17:32:54.403811 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Role: reader,member Sep 27 17:32:54.403811 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Roles: reader,member Sep 27 17:32:54.405558 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ef13103d3d8b43e1882d4820c8d9247b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_ef13103d3d8b43e1882d4820c8d9247b", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ef13103d3d8b43e1882d4820c8d9247b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/ef13103d3d8b43e1882d4820c8d9247b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 27 17:32:54.405558 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Tenant: tempest-AttachVolumeNegativeTest-1423690367 Sep 27 17:32:54.405558 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Tenant-Id: ef13103d3d8b43e1882d4820c8d9247b Sep 27 17:32:54.405558 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1423690367 Sep 27 17:32:54.405558 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User: tempest-AttachVolumeNegativeTest-1423690367-project Sep 27 17:32:54.405558 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Domain-Id: default Sep 27 17:32:54.405558 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Domain-Name: Default Sep 27 17:32:54.405558 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Id: 0b02c2ba9a0a48c294a11b42cbfe28e3 Sep 27 17:32:54.405558 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Name: tempest-AttachVolumeNegativeTest-1423690367-project Sep 27 17:32:54.405558 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: method: > Sep 27 17:32:54.405558 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: exception: Instance 9cd2f537-78c4-4a00-95ab-4f7b115810cd could not be found. Sep 27 17:32:54.405558 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: action_args: {'id': '9cd2f537-78c4-4a00-95ab-4f7b115810cd'} Sep 27 17:32:54.406576 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 17:32:54.406576 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:32:54.406576 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 17:32:54.406576 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 17:32:54.406576 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 17:32:54.406576 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 17:32:54.406576 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 17:32:54.406576 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 17:32:54.406576 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 17:32:54.406576 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 17:32:54.406576 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9cd2f537-78c4-4a00-95ab-4f7b115810cd could not be found. Sep 27 17:32:54.406576 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:32:54.406576 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:32:54.406576 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:32:54.406576 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:32:54.406576 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:32:54.406576 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:32:54.406576 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 17:32:54.406576 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 17:32:54.406576 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 17:32:54.409987 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 17:32:54.409987 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 17:32:54.409987 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 17:32:54.409987 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 17:32:54.409987 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 17:32:54.409987 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 17:32:54.409987 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 17:32:54.409987 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9cd2f537-78c4-4a00-95ab-4f7b115810cd could not be found. Sep 27 17:32:54.409987 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:32:54.409987 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:32:54.409987 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:32:54.409987 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:32:54.409987 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:32:54.409987 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:32:54.409987 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 17:32:54.409987 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 17:32:54.409987 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9cd2f537-78c4-4a00-95ab-4f7b115810cd could not be found. Sep 27 17:32:54.409987 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:32:54.411553 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-27d004c2-ffda-4e16-8efa-0668d48407b1 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Returning 404 to user: Instance 9cd2f537-78c4-4a00-95ab-4f7b115810cd could not be found. {{(pid=120415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 17:32:54.411553 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-27d004c2-ffda-4e16-8efa-0668d48407b1 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/9cd2f537-78c4-4a00-95ab-4f7b115810cd" status: 404 len: 111 microversion: 2.1 time: 0.037481 Sep 27 17:32:54.411553 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 411/850] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:32:54 2022] GET /compute/v2.1/servers/9cd2f537-78c4-4a00-95ab-4f7b115810cd => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 17:32:54.415519 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-ff895ff3-ee03-4e9c-876c-cadceebae987 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '.version_select at 0x7fe728367670>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:32:54.438898 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-ff895ff3-ee03-4e9c-876c-cadceebae987 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1199101514" status: 202 len: 0 microversion: 2.1 time: 0.027166 Sep 27 17:32:54.439499 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 440/851] 10.222.0.55 () {58 vars in 1221 bytes} [Tue Sep 27 17:32:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1199101514 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 17:32:54.939160 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-b4595057-1ca9-4e36-bf26-53a11e471a06 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:32:54.939698 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-b4595057-1ca9-4e36-bf26-53a11e471a06 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:32:54.946404 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b4595057-1ca9-4e36-bf26-53a11e471a06 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:54.946903 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b4595057-1ca9-4e36-bf26-53a11e471a06 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:54.947347 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b4595057-1ca9-4e36-bf26-53a11e471a06 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:54.948055 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b4595057-1ca9-4e36-bf26-53a11e471a06 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:54.948504 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b4595057-1ca9-4e36-bf26-53a11e471a06 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:54.948932 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b4595057-1ca9-4e36-bf26-53a11e471a06 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:55.020369 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-b4595057-1ca9-4e36-bf26-53a11e471a06 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:32:55.028663 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-b4595057-1ca9-4e36-bf26-53a11e471a06 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1" status: 200 len: 1331 microversion: 2.1 time: 0.093501 Sep 27 17:32:55.030089 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 412/852] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:32:54 2022] GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1 => generated 1331 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:32:55.051696 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-5dc3d7c0-b57d-4f25-a65c-684a4aabbc3b tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:32:55.052304 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-5dc3d7c0-b57d-4f25-a65c-684a4aabbc3b tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] [instance: 8b3855b6-18b1-46de-a1cc-f7a2941a42b9] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:32:55.058523 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5dc3d7c0-b57d-4f25-a65c-684a4aabbc3b tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:55.059067 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5dc3d7c0-b57d-4f25-a65c-684a4aabbc3b tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:55.059412 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5dc3d7c0-b57d-4f25-a65c-684a4aabbc3b tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:55.060132 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5dc3d7c0-b57d-4f25-a65c-684a4aabbc3b tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:55.060639 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5dc3d7c0-b57d-4f25-a65c-684a4aabbc3b tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:55.060983 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5dc3d7c0-b57d-4f25-a65c-684a4aabbc3b tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:55.238815 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-5dc3d7c0-b57d-4f25-a65c-684a4aabbc3b tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5bf070765946168f7e5937f2b076c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890469995c02465eb9b9ad2d1fb9ab6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:32:55.250090 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-5dc3d7c0-b57d-4f25-a65c-684a4aabbc3b tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] 10.222.0.55 "GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9" status: 200 len: 1567 microversion: 2.1 time: 0.202089 Sep 27 17:32:55.251029 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 441/853] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:32:55 2022] GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9 => generated 1567 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:32:55.384577 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-4b8cddd4-c736-4b90-99cc-cbb6f29f1e42 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:32:55.385073 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-4b8cddd4-c736-4b90-99cc-cbb6f29f1e42 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: fef20d9a-42bf-4605-bbcb-b673d215a5b9] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:32:55.391219 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4b8cddd4-c736-4b90-99cc-cbb6f29f1e42 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:55.391702 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4b8cddd4-c736-4b90-99cc-cbb6f29f1e42 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:55.392141 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4b8cddd4-c736-4b90-99cc-cbb6f29f1e42 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:55.392829 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4b8cddd4-c736-4b90-99cc-cbb6f29f1e42 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:55.393281 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4b8cddd4-c736-4b90-99cc-cbb6f29f1e42 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:55.393705 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4b8cddd4-c736-4b90-99cc-cbb6f29f1e42 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:55.476981 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.objects.instance [None req-4b8cddd4-c736-4b90-99cc-cbb6f29f1e42 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lazy-loading 'services' on Instance uuid fef20d9a-42bf-4605-bbcb-b673d215a5b9 {{(pid=120415) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 17:32:55.547176 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-4b8cddd4-c736-4b90-99cc-cbb6f29f1e42 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "DELETE /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9/os-volume_attachments/27b6cfd9-3384-409b-a763-5be9d5c19670" status: 202 len: 0 microversion: 2.1 time: 0.166323 Sep 27 17:32:55.547789 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 413/854] 10.222.0.55 () {58 vars in 1416 bytes} [Tue Sep 27 17:32:55 2022] DELETE /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9/os-volume_attachments/27b6cfd9-3384-409b-a763-5be9d5c19670 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 17:32:55.556191 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-19518f8e-be26-4bba-ab5e-a0e9aa0678ad tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:32:55.558327 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-19518f8e-be26-4bba-ab5e-a0e9aa0678ad tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: fef20d9a-42bf-4605-bbcb-b673d215a5b9] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:32:55.564622 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-19518f8e-be26-4bba-ab5e-a0e9aa0678ad tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:55.565097 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-19518f8e-be26-4bba-ab5e-a0e9aa0678ad tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:55.565732 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-19518f8e-be26-4bba-ab5e-a0e9aa0678ad tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:55.566256 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-19518f8e-be26-4bba-ab5e-a0e9aa0678ad tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:55.566699 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-19518f8e-be26-4bba-ab5e-a0e9aa0678ad tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:55.567110 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-19518f8e-be26-4bba-ab5e-a0e9aa0678ad tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:55.603696 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-19518f8e-be26-4bba-ab5e-a0e9aa0678ad tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051423 Sep 27 17:32:55.604261 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 442/855] 10.222.0.55 () {58 vars in 1302 bytes} [Tue Sep 27 17:32:55 2022] GET /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:32:56.053047 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-a780134a-dd3b-43f5-8235-6e72c7d6fc8c tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:32:56.053768 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-a780134a-dd3b-43f5-8235-6e72c7d6fc8c tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: ca74fda8-afd6-41f2-8c93-5e8971c645f1] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:32:56.059835 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a780134a-dd3b-43f5-8235-6e72c7d6fc8c tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:56.060318 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a780134a-dd3b-43f5-8235-6e72c7d6fc8c tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:56.060752 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a780134a-dd3b-43f5-8235-6e72c7d6fc8c tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:56.061433 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a780134a-dd3b-43f5-8235-6e72c7d6fc8c tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:56.061886 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a780134a-dd3b-43f5-8235-6e72c7d6fc8c tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:56.062359 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a780134a-dd3b-43f5-8235-6e72c7d6fc8c tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:56.075373 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.wsgi [None req-a780134a-dd3b-43f5-8235-6e72c7d6fc8c tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] HTTP exception thrown: Instance ca74fda8-afd6-41f2-8c93-5e8971c645f1 could not be found. Sep 27 17:32:56.077505 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-a780134a-dd3b-43f5-8235-6e72c7d6fc8c tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Request method failure captured: Sep 27 17:32:56.077505 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: request: GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1 HTTP/1.1 Sep 27 17:32:56.077505 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Accept: application/json Sep 27 17:32:56.077505 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Accept-Encoding: identity Sep 27 17:32:56.077505 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Connection: close Sep 27 17:32:56.077505 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Content-Length: 0 Sep 27 17:32:56.077505 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Content-Type: application/json Sep 27 17:32:56.077505 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Host: 10.222.0.55 Sep 27 17:32:56.077505 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Openstack-System-Scope: None Sep 27 17:32:56.077505 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: User-Agent: python-urllib3/1.26.12 Sep 27 17:32:56.077505 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Auth-Token: gAAAAABjMzG_oYsxxnSJCNk_tQmKplbiP8h3imjUWos1S01buLQp6CXEw5BhuA_PsGqwDIqMw-PI9rCZuq5MdQs4oib-fTI5tt7xrSk-xzMiyY02qpRv4aq4oNkQg1Pn7OKJFQCc5SdwkX3vwqfdurESDHgoSkrIRuwNUUO4Aup43BAcJ7MoD5U Sep 27 17:32:56.077505 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Domain-Id: None Sep 27 17:32:56.077505 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Domain-Name: None Sep 27 17:32:56.077505 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Identity-Status: Confirmed Sep 27 17:32:56.077505 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Is-Admin-Project: True Sep 27 17:32:56.077505 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Domain-Id: default Sep 27 17:32:56.077505 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Domain-Name: Default Sep 27 17:32:56.077505 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Id: fd5caa5782e74721a4c2991524182668 Sep 27 17:32:56.077505 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1705185754 Sep 27 17:32:56.077505 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Role: reader,member Sep 27 17:32:56.077505 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Roles: reader,member Sep 27 17:32:56.078964 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/fd5caa5782e74721a4c2991524182668"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_fd5caa5782e74721a4c2991524182668", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/fd5caa5782e74721a4c2991524182668"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/fd5caa5782e74721a4c2991524182668"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 27 17:32:56.078964 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1705185754 Sep 27 17:32:56.078964 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Tenant-Id: fd5caa5782e74721a4c2991524182668 Sep 27 17:32:56.078964 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1705185754 Sep 27 17:32:56.078964 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User: tempest-ServerRescueNegativeTestJSON-1705185754-project Sep 27 17:32:56.078964 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Domain-Id: default Sep 27 17:32:56.078964 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Domain-Name: Default Sep 27 17:32:56.078964 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Id: d23a498bde00483c8fdd68dcde975e5d Sep 27 17:32:56.078964 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1705185754-project Sep 27 17:32:56.078964 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: method: > Sep 27 17:32:56.078964 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: exception: Instance ca74fda8-afd6-41f2-8c93-5e8971c645f1 could not be found. Sep 27 17:32:56.078964 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: action_args: {'id': 'ca74fda8-afd6-41f2-8c93-5e8971c645f1'} Sep 27 17:32:56.079748 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 17:32:56.079748 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:32:56.079748 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 17:32:56.079748 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 17:32:56.079748 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 17:32:56.079748 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 17:32:56.079748 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 17:32:56.079748 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 17:32:56.079748 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 17:32:56.079748 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 17:32:56.079748 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca74fda8-afd6-41f2-8c93-5e8971c645f1 could not be found. Sep 27 17:32:56.079748 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:32:56.079748 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:32:56.079748 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:32:56.079748 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:32:56.079748 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:32:56.079748 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:32:56.079748 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 17:32:56.079748 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 17:32:56.079748 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 17:32:56.081324 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 17:32:56.081324 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 17:32:56.081324 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 17:32:56.081324 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 17:32:56.081324 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 17:32:56.081324 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 17:32:56.081324 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 17:32:56.081324 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca74fda8-afd6-41f2-8c93-5e8971c645f1 could not be found. Sep 27 17:32:56.081324 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:32:56.081324 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:32:56.081324 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:32:56.081324 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:32:56.081324 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:32:56.081324 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:32:56.081324 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 17:32:56.081324 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 17:32:56.081324 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca74fda8-afd6-41f2-8c93-5e8971c645f1 could not be found. Sep 27 17:32:56.081324 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:32:56.083030 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-a780134a-dd3b-43f5-8235-6e72c7d6fc8c tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Returning 404 to user: Instance ca74fda8-afd6-41f2-8c93-5e8971c645f1 could not be found. {{(pid=120415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 17:32:56.083030 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-a780134a-dd3b-43f5-8235-6e72c7d6fc8c tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1" status: 404 len: 111 microversion: 2.1 time: 0.030161 Sep 27 17:32:56.083030 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 414/856] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:32:56 2022] GET /compute/v2.1/servers/ca74fda8-afd6-41f2-8c93-5e8971c645f1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 17:32:56.087567 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-689c2cc0-7e1b-4747-8867-4e14bc2f8f96 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '.version_select at 0x7fe728367940>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:32:56.105803 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-689c2cc0-7e1b-4747-8867-4e14bc2f8f96 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2116257343" status: 202 len: 0 microversion: 2.1 time: 0.022043 Sep 27 17:32:56.106641 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 443/857] 10.222.0.55 () {58 vars in 1221 bytes} [Tue Sep 27 17:32:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2116257343 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 17:32:56.275097 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-4e1762dd-8269-46f2-972c-121c844d7fbb tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:32:56.275508 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-4e1762dd-8269-46f2-972c-121c844d7fbb tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] [instance: 8b3855b6-18b1-46de-a1cc-f7a2941a42b9] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:32:56.295388 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4e1762dd-8269-46f2-972c-121c844d7fbb tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:56.295902 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4e1762dd-8269-46f2-972c-121c844d7fbb tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:56.296344 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4e1762dd-8269-46f2-972c-121c844d7fbb tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:56.297064 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4e1762dd-8269-46f2-972c-121c844d7fbb tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:56.297524 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4e1762dd-8269-46f2-972c-121c844d7fbb tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:56.297949 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4e1762dd-8269-46f2-972c-121c844d7fbb tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:56.467715 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-4e1762dd-8269-46f2-972c-121c844d7fbb tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5bf070765946168f7e5937f2b076c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890469995c02465eb9b9ad2d1fb9ab6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:32:56.475578 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-4e1762dd-8269-46f2-972c-121c844d7fbb tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] 10.222.0.55 "GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9" status: 200 len: 1568 microversion: 2.1 time: 0.205822 Sep 27 17:32:56.476145 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 415/858] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:32:56 2022] GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9 => generated 1568 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:32:56.499931 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-7a58db5a-eb8f-4de6-b22a-ea6587420c39 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:32:56.500728 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-7a58db5a-eb8f-4de6-b22a-ea6587420c39 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] [instance: 8b3855b6-18b1-46de-a1cc-f7a2941a42b9] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:32:56.506909 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7a58db5a-eb8f-4de6-b22a-ea6587420c39 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:56.507644 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7a58db5a-eb8f-4de6-b22a-ea6587420c39 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:56.508236 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7a58db5a-eb8f-4de6-b22a-ea6587420c39 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:56.509087 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7a58db5a-eb8f-4de6-b22a-ea6587420c39 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:56.509698 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7a58db5a-eb8f-4de6-b22a-ea6587420c39 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:56.510320 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7a58db5a-eb8f-4de6-b22a-ea6587420c39 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:56.541291 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-7a58db5a-eb8f-4de6-b22a-ea6587420c39 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] [instance: 8b3855b6-18b1-46de-a1cc-f7a2941a42b9] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120416) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 27 17:32:56.597659 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:32:56.617195 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-1dde8931-02f7-40f6-9c6b-c571b5fbdfd4 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:32:56.619582 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-1dde8931-02f7-40f6-9c6b-c571b5fbdfd4 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: fef20d9a-42bf-4605-bbcb-b673d215a5b9] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:32:56.627846 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1dde8931-02f7-40f6-9c6b-c571b5fbdfd4 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:56.630739 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-7a58db5a-eb8f-4de6-b22a-ea6587420c39 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] 10.222.0.55 "POST /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9/action" status: 202 len: 0 microversion: 2.1 time: 0.134507 Sep 27 17:32:56.635408 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 444/859] 10.222.0.55 () {60 vars in 1278 bytes} [Tue Sep 27 17:32:56 2022] POST /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 17:32:56.641065 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-19c449c3-b586-4a67-b540-a83835a534b8 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:32:56.641551 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1dde8931-02f7-40f6-9c6b-c571b5fbdfd4 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:56.641678 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-19c449c3-b586-4a67-b540-a83835a534b8 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] [instance: 8b3855b6-18b1-46de-a1cc-f7a2941a42b9] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:32:56.642364 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1dde8931-02f7-40f6-9c6b-c571b5fbdfd4 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:56.643264 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1dde8931-02f7-40f6-9c6b-c571b5fbdfd4 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:56.645163 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1dde8931-02f7-40f6-9c6b-c571b5fbdfd4 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:56.646394 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1dde8931-02f7-40f6-9c6b-c571b5fbdfd4 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:56.647900 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-19c449c3-b586-4a67-b540-a83835a534b8 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:56.648396 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-19c449c3-b586-4a67-b540-a83835a534b8 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:56.648870 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-19c449c3-b586-4a67-b540-a83835a534b8 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:56.649649 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-19c449c3-b586-4a67-b540-a83835a534b8 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:56.650173 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-19c449c3-b586-4a67-b540-a83835a534b8 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:56.650655 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-19c449c3-b586-4a67-b540-a83835a534b8 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:56.735837 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-1dde8931-02f7-40f6-9c6b-c571b5fbdfd4 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.122380 Sep 27 17:32:56.742673 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 416/860] 10.222.0.55 () {58 vars in 1302 bytes} [Tue Sep 27 17:32:56 2022] GET /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9/os-volume_attachments => generated 197 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:32:56.754055 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [req-241e12dc-66a5-4816-afd3-4a9d41177aa9 req-09da8ab7-1989-4b98-9fb6-df342ed8d6ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b3855b6-18b1-46de-a1cc-f7a2941a42b9", "name": "network-vif-unplugged", "status": "completed", "tag": "c0932507-0f02-4d95-8195-002c756fdef5"}]} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:32:56.776858 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-241e12dc-66a5-4816-afd3-4a9d41177aa9 req-09da8ab7-1989-4b98-9fb6-df342ed8d6ff service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:56.777343 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-241e12dc-66a5-4816-afd3-4a9d41177aa9 req-09da8ab7-1989-4b98-9fb6-df342ed8d6ff service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:56.777774 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-241e12dc-66a5-4816-afd3-4a9d41177aa9 req-09da8ab7-1989-4b98-9fb6-df342ed8d6ff service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:56.805846 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.compute.server_external_events [req-241e12dc-66a5-4816-afd3-4a9d41177aa9 req-09da8ab7-1989-4b98-9fb6-df342ed8d6ff service nova] Creating event network-vif-unplugged:c0932507-0f02-4d95-8195-002c756fdef5 for instance 8b3855b6-18b1-46de-a1cc-f7a2941a42b9 on hv-cinder-84914 Sep 27 17:32:56.811596 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-19c449c3-b586-4a67-b540-a83835a534b8 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5bf070765946168f7e5937f2b076c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890469995c02465eb9b9ad2d1fb9ab6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:32:56.819661 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [req-241e12dc-66a5-4816-afd3-4a9d41177aa9 req-09da8ab7-1989-4b98-9fb6-df342ed8d6ff service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075456 Sep 27 17:32:56.822026 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-19c449c3-b586-4a67-b540-a83835a534b8 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] 10.222.0.55 "GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9" status: 200 len: 1576 microversion: 2.1 time: 0.185186 Sep 27 17:32:56.822275 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 417/861] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:32:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:32:56.828210 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 445/862] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:32:56 2022] GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9 => generated 1576 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:32:57.749706 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-d9357291-fe22-42c9-9843-73eb98a28743 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:32:57.751889 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-d9357291-fe22-42c9-9843-73eb98a28743 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: fef20d9a-42bf-4605-bbcb-b673d215a5b9] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:32:57.758379 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d9357291-fe22-42c9-9843-73eb98a28743 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:57.758963 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d9357291-fe22-42c9-9843-73eb98a28743 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:57.759402 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d9357291-fe22-42c9-9843-73eb98a28743 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:57.760142 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d9357291-fe22-42c9-9843-73eb98a28743 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:57.760602 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d9357291-fe22-42c9-9843-73eb98a28743 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:57.761024 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d9357291-fe22-42c9-9843-73eb98a28743 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:57.790934 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-d9357291-fe22-42c9-9843-73eb98a28743 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046374 Sep 27 17:32:57.791493 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 418/863] 10.222.0.55 () {58 vars in 1302 bytes} [Tue Sep 27 17:32:57 2022] GET /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 17:32:57.845070 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-ef51024d-260e-4120-af49-c24714cf1e84 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:32:57.845697 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-ef51024d-260e-4120-af49-c24714cf1e84 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] [instance: 8b3855b6-18b1-46de-a1cc-f7a2941a42b9] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:32:57.852771 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ef51024d-260e-4120-af49-c24714cf1e84 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:57.853269 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ef51024d-260e-4120-af49-c24714cf1e84 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:57.853703 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ef51024d-260e-4120-af49-c24714cf1e84 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:57.854432 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ef51024d-260e-4120-af49-c24714cf1e84 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:57.854920 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ef51024d-260e-4120-af49-c24714cf1e84 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:57.855298 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ef51024d-260e-4120-af49-c24714cf1e84 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:57.856996 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-f401df54-1e39-4591-8654-8d29632e3e9a tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:32:57.857949 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-f401df54-1e39-4591-8654-8d29632e3e9a tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: fef20d9a-42bf-4605-bbcb-b673d215a5b9] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:32:57.864190 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f401df54-1e39-4591-8654-8d29632e3e9a tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:57.864670 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f401df54-1e39-4591-8654-8d29632e3e9a tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:57.865151 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f401df54-1e39-4591-8654-8d29632e3e9a tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:57.865834 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f401df54-1e39-4591-8654-8d29632e3e9a tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:57.866415 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f401df54-1e39-4591-8654-8d29632e3e9a tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:57.866837 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f401df54-1e39-4591-8654-8d29632e3e9a tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:57.895713 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-f401df54-1e39-4591-8654-8d29632e3e9a tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: fef20d9a-42bf-4605-bbcb-b673d215a5b9] Going to try to terminate instance {{(pid=120415) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 17:32:57.988543 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-f401df54-1e39-4591-8654-8d29632e3e9a tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "DELETE /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9" status: 204 len: 0 microversion: 2.1 time: 0.135741 Sep 27 17:32:57.989826 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 419/864] 10.222.0.55 () {58 vars in 1239 bytes} [Tue Sep 27 17:32:57 2022] DELETE /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 17:32:58.004548 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-ef51024d-260e-4120-af49-c24714cf1e84 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5bf070765946168f7e5937f2b076c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890469995c02465eb9b9ad2d1fb9ab6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:32:58.007122 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-502ae282-1e86-4573-99f2-266b3f88db3e tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:32:58.007946 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-502ae282-1e86-4573-99f2-266b3f88db3e tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: fef20d9a-42bf-4605-bbcb-b673d215a5b9] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:32:58.012585 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-ef51024d-260e-4120-af49-c24714cf1e84 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] 10.222.0.55 "GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9" status: 200 len: 1518 microversion: 2.1 time: 0.171357 Sep 27 17:32:58.013868 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-502ae282-1e86-4573-99f2-266b3f88db3e tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:58.014165 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 446/865] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:32:57 2022] GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9 => generated 1518 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:32:58.014393 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-502ae282-1e86-4573-99f2-266b3f88db3e tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:58.014830 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-502ae282-1e86-4573-99f2-266b3f88db3e tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:58.015559 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-502ae282-1e86-4573-99f2-266b3f88db3e tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:58.016013 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-502ae282-1e86-4573-99f2-266b3f88db3e tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:58.016435 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-502ae282-1e86-4573-99f2-266b3f88db3e tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:58.151950 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-502ae282-1e86-4573-99f2-266b3f88db3e tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b02c2ba9a0a48c294a11b42cbfe28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef13103d3d8b43e1882d4820c8d9247b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:32:58.159577 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-502ae282-1e86-4573-99f2-266b3f88db3e tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9" status: 200 len: 1683 microversion: 2.1 time: 0.164341 Sep 27 17:32:58.160126 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 420/866] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:32:57 2022] GET /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9 => generated 1683 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:32:59.036441 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-4820a2ba-928c-447c-bca0-3d25fe989b54 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:32:59.037193 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-4820a2ba-928c-447c-bca0-3d25fe989b54 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] [instance: 8b3855b6-18b1-46de-a1cc-f7a2941a42b9] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:32:59.043187 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4820a2ba-928c-447c-bca0-3d25fe989b54 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:59.043675 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4820a2ba-928c-447c-bca0-3d25fe989b54 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:59.044114 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4820a2ba-928c-447c-bca0-3d25fe989b54 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:59.044805 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4820a2ba-928c-447c-bca0-3d25fe989b54 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:59.045301 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4820a2ba-928c-447c-bca0-3d25fe989b54 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:59.045728 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4820a2ba-928c-447c-bca0-3d25fe989b54 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:59.176424 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-2e55cc9b-65db-415c-9f7a-8f9f5e3089ac tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:32:59.176946 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-2e55cc9b-65db-415c-9f7a-8f9f5e3089ac tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: d622d15d-b954-409c-a1f5-538da5de83db] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:32:59.188011 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2e55cc9b-65db-415c-9f7a-8f9f5e3089ac tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:59.188506 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2e55cc9b-65db-415c-9f7a-8f9f5e3089ac tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:59.188947 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2e55cc9b-65db-415c-9f7a-8f9f5e3089ac tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:59.189649 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2e55cc9b-65db-415c-9f7a-8f9f5e3089ac tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:59.190132 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2e55cc9b-65db-415c-9f7a-8f9f5e3089ac tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:59.190564 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2e55cc9b-65db-415c-9f7a-8f9f5e3089ac tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:59.219341 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-2e55cc9b-65db-415c-9f7a-8f9f5e3089ac tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: d622d15d-b954-409c-a1f5-538da5de83db] Going to try to terminate instance {{(pid=120415) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 17:32:59.234102 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:32:59.285626 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-4820a2ba-928c-447c-bca0-3d25fe989b54 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5bf070765946168f7e5937f2b076c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890469995c02465eb9b9ad2d1fb9ab6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:32:59.307298 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-4820a2ba-928c-447c-bca0-3d25fe989b54 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] 10.222.0.55 "GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9" status: 200 len: 1574 microversion: 2.1 time: 0.274043 Sep 27 17:32:59.309389 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 447/867] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:32:59 2022] GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9 => generated 1574 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:32:59.327073 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-4655b050-d933-4ef2-a477-c4a222a13e21 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:32:59.328011 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-4655b050-d933-4ef2-a477-c4a222a13e21 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: fef20d9a-42bf-4605-bbcb-b673d215a5b9] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:32:59.328299 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-2e55cc9b-65db-415c-9f7a-8f9f5e3089ac tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "DELETE /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db" status: 204 len: 0 microversion: 2.1 time: 0.155301 Sep 27 17:32:59.329690 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 421/868] 10.222.0.55 () {58 vars in 1239 bytes} [Tue Sep 27 17:32:59 2022] DELETE /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 27 17:32:59.339138 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4655b050-d933-4ef2-a477-c4a222a13e21 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:59.339936 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4655b050-d933-4ef2-a477-c4a222a13e21 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:59.340610 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4655b050-d933-4ef2-a477-c4a222a13e21 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:59.342275 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4655b050-d933-4ef2-a477-c4a222a13e21 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:59.342978 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4655b050-d933-4ef2-a477-c4a222a13e21 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:59.343708 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4655b050-d933-4ef2-a477-c4a222a13e21 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:59.346364 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-e39809fe-3de1-4685-9087-59aca3f561b6 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:32:59.347150 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-e39809fe-3de1-4685-9087-59aca3f561b6 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: d622d15d-b954-409c-a1f5-538da5de83db] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:32:59.354333 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e39809fe-3de1-4685-9087-59aca3f561b6 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:59.354822 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e39809fe-3de1-4685-9087-59aca3f561b6 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:59.355259 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e39809fe-3de1-4685-9087-59aca3f561b6 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:59.355962 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e39809fe-3de1-4685-9087-59aca3f561b6 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:59.356742 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e39809fe-3de1-4685-9087-59aca3f561b6 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:59.357178 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e39809fe-3de1-4685-9087-59aca3f561b6 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:59.615432 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-4655b050-d933-4ef2-a477-c4a222a13e21 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b02c2ba9a0a48c294a11b42cbfe28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef13103d3d8b43e1882d4820c8d9247b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:32:59.625086 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-e39809fe-3de1-4685-9087-59aca3f561b6 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:32:59.625328 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-4655b050-d933-4ef2-a477-c4a222a13e21 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9" status: 200 len: 1683 microversion: 2.1 time: 0.313237 Sep 27 17:32:59.626390 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 448/869] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:32:59 2022] GET /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9 => generated 1683 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:32:59.637560 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-e39809fe-3de1-4685-9087-59aca3f561b6 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db" status: 200 len: 1506 microversion: 2.1 time: 0.296984 Sep 27 17:32:59.638952 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 422/870] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:32:59 2022] GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db => generated 1506 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:32:59.938702 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [req-37e9bd85-4da1-4085-ada1-d91d786ee7e4 req-4995e713-d69e-4949-9952-015f5a13cc9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fef20d9a-42bf-4605-bbcb-b673d215a5b9", "name": "network-vif-deleted", "tag": "154c5998-5a7a-4e89-abf9-12d9614c0120"}]} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:32:59.947730 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-37e9bd85-4da1-4085-ada1-d91d786ee7e4 req-4995e713-d69e-4949-9952-015f5a13cc9a service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:32:59.948141 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-37e9bd85-4da1-4085-ada1-d91d786ee7e4 req-4995e713-d69e-4949-9952-015f5a13cc9a service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:32:59.948562 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-37e9bd85-4da1-4085-ada1-d91d786ee7e4 req-4995e713-d69e-4949-9952-015f5a13cc9a service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:32:59.962547 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.compute.server_external_events [req-37e9bd85-4da1-4085-ada1-d91d786ee7e4 req-4995e713-d69e-4949-9952-015f5a13cc9a service nova] Creating event network-vif-deleted:154c5998-5a7a-4e89-abf9-12d9614c0120 for instance fef20d9a-42bf-4605-bbcb-b673d215a5b9 on hv-cinder-84914 Sep 27 17:32:59.968731 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [req-37e9bd85-4da1-4085-ada1-d91d786ee7e4 req-4995e713-d69e-4949-9952-015f5a13cc9a service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033622 Sep 27 17:32:59.969330 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 449/871] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:32:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:33:00.336152 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-0c2c1214-90ad-4034-90e2-2568b54910c5 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:33:00.337319 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-0c2c1214-90ad-4034-90e2-2568b54910c5 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] [instance: 8b3855b6-18b1-46de-a1cc-f7a2941a42b9] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:33:00.347727 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0c2c1214-90ad-4034-90e2-2568b54910c5 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:00.348922 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0c2c1214-90ad-4034-90e2-2568b54910c5 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:00.349635 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0c2c1214-90ad-4034-90e2-2568b54910c5 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:00.351051 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0c2c1214-90ad-4034-90e2-2568b54910c5 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:00.351806 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0c2c1214-90ad-4034-90e2-2568b54910c5 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:00.352451 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0c2c1214-90ad-4034-90e2-2568b54910c5 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:00.566739 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-0c2c1214-90ad-4034-90e2-2568b54910c5 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5bf070765946168f7e5937f2b076c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890469995c02465eb9b9ad2d1fb9ab6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:33:00.574982 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-0c2c1214-90ad-4034-90e2-2568b54910c5 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] 10.222.0.55 "GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9" status: 200 len: 1574 microversion: 2.1 time: 0.243382 Sep 27 17:33:00.576202 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 423/872] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:33:00 2022] GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9 => generated 1574 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:33:00.650818 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-feb6419d-940d-486b-9119-f0eb3ac232d7 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:33:00.651506 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-feb6419d-940d-486b-9119-f0eb3ac232d7 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: fef20d9a-42bf-4605-bbcb-b673d215a5b9] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:33:00.659814 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-feb6419d-940d-486b-9119-f0eb3ac232d7 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:00.660704 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-feb6419d-940d-486b-9119-f0eb3ac232d7 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:00.661120 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-b6c820a3-cddc-44a4-97f5-c83b8c47a729 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:33:00.661354 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-feb6419d-940d-486b-9119-f0eb3ac232d7 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:00.662053 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-b6c820a3-cddc-44a4-97f5-c83b8c47a729 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: d622d15d-b954-409c-a1f5-538da5de83db] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:33:00.662339 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-feb6419d-940d-486b-9119-f0eb3ac232d7 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:00.663025 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-feb6419d-940d-486b-9119-f0eb3ac232d7 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:00.663578 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-feb6419d-940d-486b-9119-f0eb3ac232d7 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:00.668763 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b6c820a3-cddc-44a4-97f5-c83b8c47a729 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:00.669489 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b6c820a3-cddc-44a4-97f5-c83b8c47a729 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:00.670102 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b6c820a3-cddc-44a4-97f5-c83b8c47a729 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:00.670803 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b6c820a3-cddc-44a4-97f5-c83b8c47a729 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:00.671255 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b6c820a3-cddc-44a4-97f5-c83b8c47a729 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:00.671671 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b6c820a3-cddc-44a4-97f5-c83b8c47a729 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:00.706262 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-feb6419d-940d-486b-9119-f0eb3ac232d7 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:00.706737 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-feb6419d-940d-486b-9119-f0eb3ac232d7 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:00.707347 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-feb6419d-940d-486b-9119-f0eb3ac232d7 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:00.708583 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.objects.instance [None req-feb6419d-940d-486b-9119-f0eb3ac232d7 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lazy-loading 'fault' on Instance uuid fef20d9a-42bf-4605-bbcb-b673d215a5b9 {{(pid=120416) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 17:33:00.776278 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-b6c820a3-cddc-44a4-97f5-c83b8c47a729 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:33:00.784083 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-b6c820a3-cddc-44a4-97f5-c83b8c47a729 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db" status: 200 len: 1464 microversion: 2.1 time: 0.127315 Sep 27 17:33:00.784660 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 424/873] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:33:00 2022] GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db => generated 1464 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:33:00.798243 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-feb6419d-940d-486b-9119-f0eb3ac232d7 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b02c2ba9a0a48c294a11b42cbfe28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef13103d3d8b43e1882d4820c8d9247b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:33:00.818231 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-feb6419d-940d-486b-9119-f0eb3ac232d7 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9" status: 200 len: 1332 microversion: 2.1 time: 0.171290 Sep 27 17:33:00.819120 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 450/874] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:33:00 2022] GET /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9 => generated 1332 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:33:01.599234 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-f0c8fdb2-bab0-4442-8ce9-08f5f77337d7 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:33:01.599836 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-f0c8fdb2-bab0-4442-8ce9-08f5f77337d7 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] [instance: 8b3855b6-18b1-46de-a1cc-f7a2941a42b9] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:33:01.606464 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f0c8fdb2-bab0-4442-8ce9-08f5f77337d7 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:01.607478 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f0c8fdb2-bab0-4442-8ce9-08f5f77337d7 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:01.607908 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f0c8fdb2-bab0-4442-8ce9-08f5f77337d7 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:01.608588 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f0c8fdb2-bab0-4442-8ce9-08f5f77337d7 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:01.609032 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f0c8fdb2-bab0-4442-8ce9-08f5f77337d7 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:01.609448 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f0c8fdb2-bab0-4442-8ce9-08f5f77337d7 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:01.736535 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-f0c8fdb2-bab0-4442-8ce9-08f5f77337d7 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5bf070765946168f7e5937f2b076c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890469995c02465eb9b9ad2d1fb9ab6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:33:01.744390 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-f0c8fdb2-bab0-4442-8ce9-08f5f77337d7 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] 10.222.0.55 "GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9" status: 200 len: 1574 microversion: 2.1 time: 0.148997 Sep 27 17:33:01.744949 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 425/875] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:33:01 2022] GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9 => generated 1574 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:33:01.815094 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-097a5f36-926b-488f-99af-293d4036de69 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:33:01.815698 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-097a5f36-926b-488f-99af-293d4036de69 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: d622d15d-b954-409c-a1f5-538da5de83db] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:33:01.821790 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-097a5f36-926b-488f-99af-293d4036de69 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:01.822883 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-097a5f36-926b-488f-99af-293d4036de69 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:01.823534 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-097a5f36-926b-488f-99af-293d4036de69 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:01.824296 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-097a5f36-926b-488f-99af-293d4036de69 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:01.824752 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-097a5f36-926b-488f-99af-293d4036de69 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:01.825171 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-097a5f36-926b-488f-99af-293d4036de69 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:01.847567 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-c48dd8e1-1a29-421d-9a1a-c69e2f265500 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:33:01.848604 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-c48dd8e1-1a29-421d-9a1a-c69e2f265500 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: fef20d9a-42bf-4605-bbcb-b673d215a5b9] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:33:01.857466 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c48dd8e1-1a29-421d-9a1a-c69e2f265500 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:01.857957 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c48dd8e1-1a29-421d-9a1a-c69e2f265500 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:01.858533 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c48dd8e1-1a29-421d-9a1a-c69e2f265500 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:01.859330 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c48dd8e1-1a29-421d-9a1a-c69e2f265500 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:01.859784 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c48dd8e1-1a29-421d-9a1a-c69e2f265500 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:01.860204 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c48dd8e1-1a29-421d-9a1a-c69e2f265500 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:01.870753 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-097a5f36-926b-488f-99af-293d4036de69 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:01.871513 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-097a5f36-926b-488f-99af-293d4036de69 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:01.872221 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-097a5f36-926b-488f-99af-293d4036de69 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:01.872933 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.objects.instance [None req-097a5f36-926b-488f-99af-293d4036de69 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lazy-loading 'fault' on Instance uuid d622d15d-b954-409c-a1f5-538da5de83db {{(pid=120416) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 17:33:01.900002 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c48dd8e1-1a29-421d-9a1a-c69e2f265500 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:01.900497 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c48dd8e1-1a29-421d-9a1a-c69e2f265500 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:01.900932 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c48dd8e1-1a29-421d-9a1a-c69e2f265500 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:01.901380 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.objects.instance [None req-c48dd8e1-1a29-421d-9a1a-c69e2f265500 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lazy-loading 'fault' on Instance uuid fef20d9a-42bf-4605-bbcb-b673d215a5b9 {{(pid=120415) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 17:33:01.922060 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-097a5f36-926b-488f-99af-293d4036de69 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:33:01.932259 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-097a5f36-926b-488f-99af-293d4036de69 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db" status: 200 len: 1311 microversion: 2.1 time: 0.121703 Sep 27 17:33:01.934343 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 451/876] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:33:01 2022] GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db => generated 1311 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:33:01.948972 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-c48dd8e1-1a29-421d-9a1a-c69e2f265500 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b02c2ba9a0a48c294a11b42cbfe28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef13103d3d8b43e1882d4820c8d9247b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:33:01.956717 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-c48dd8e1-1a29-421d-9a1a-c69e2f265500 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9" status: 200 len: 1332 microversion: 2.1 time: 0.117147 Sep 27 17:33:01.957264 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 426/877] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:33:01 2022] GET /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9 => generated 1332 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:33:01.983121 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [req-fdfd0f8b-6265-4922-90ca-5e46fe71980a req-301868bc-9329-4bff-b85c-8ce7b9b7d52d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d622d15d-b954-409c-a1f5-538da5de83db", "name": "network-vif-deleted", "tag": "636a119c-4ac6-4298-8d42-f47c495d9a5b"}]} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:33:01.992602 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-fdfd0f8b-6265-4922-90ca-5e46fe71980a req-301868bc-9329-4bff-b85c-8ce7b9b7d52d service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:01.993046 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-fdfd0f8b-6265-4922-90ca-5e46fe71980a req-301868bc-9329-4bff-b85c-8ce7b9b7d52d service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:01.993468 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-fdfd0f8b-6265-4922-90ca-5e46fe71980a req-301868bc-9329-4bff-b85c-8ce7b9b7d52d service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:02.003903 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.compute.server_external_events [req-fdfd0f8b-6265-4922-90ca-5e46fe71980a req-301868bc-9329-4bff-b85c-8ce7b9b7d52d service nova] Creating event network-vif-deleted:636a119c-4ac6-4298-8d42-f47c495d9a5b for instance d622d15d-b954-409c-a1f5-538da5de83db on hv-cinder-84914 Sep 27 17:33:02.008553 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [req-fdfd0f8b-6265-4922-90ca-5e46fe71980a req-301868bc-9329-4bff-b85c-8ce7b9b7d52d service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029561 Sep 27 17:33:02.009105 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 452/878] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:33:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:33:02.767254 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-b44e9540-e417-40f5-9b54-83a602503742 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:33:02.767866 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-b44e9540-e417-40f5-9b54-83a602503742 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] [instance: 8b3855b6-18b1-46de-a1cc-f7a2941a42b9] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:33:02.774253 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b44e9540-e417-40f5-9b54-83a602503742 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:02.774732 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b44e9540-e417-40f5-9b54-83a602503742 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:02.775164 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b44e9540-e417-40f5-9b54-83a602503742 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:02.775848 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b44e9540-e417-40f5-9b54-83a602503742 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:02.776302 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b44e9540-e417-40f5-9b54-83a602503742 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:02.776722 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b44e9540-e417-40f5-9b54-83a602503742 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:02.908415 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-b44e9540-e417-40f5-9b54-83a602503742 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5bf070765946168f7e5937f2b076c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890469995c02465eb9b9ad2d1fb9ab6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:33:02.916108 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-b44e9540-e417-40f5-9b54-83a602503742 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] 10.222.0.55 "GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9" status: 200 len: 1574 microversion: 2.1 time: 0.152760 Sep 27 17:33:02.916673 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 427/879] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:33:02 2022] GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9 => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:33:02.956038 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-abacd9fd-b179-41fc-87fc-f77f3ad7f182 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:33:02.956731 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-abacd9fd-b179-41fc-87fc-f77f3ad7f182 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: d622d15d-b954-409c-a1f5-538da5de83db] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:33:02.962807 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-abacd9fd-b179-41fc-87fc-f77f3ad7f182 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:02.963282 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-abacd9fd-b179-41fc-87fc-f77f3ad7f182 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:02.963709 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-abacd9fd-b179-41fc-87fc-f77f3ad7f182 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:02.964390 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-abacd9fd-b179-41fc-87fc-f77f3ad7f182 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:02.964842 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-abacd9fd-b179-41fc-87fc-f77f3ad7f182 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:02.965262 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-abacd9fd-b179-41fc-87fc-f77f3ad7f182 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:02.978644 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.wsgi [None req-abacd9fd-b179-41fc-87fc-f77f3ad7f182 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] HTTP exception thrown: Instance d622d15d-b954-409c-a1f5-538da5de83db could not be found. Sep 27 17:33:02.979744 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-7c0fae0c-24dc-4b11-b43a-4d652c84d7c4 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:33:02.980238 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-abacd9fd-b179-41fc-87fc-f77f3ad7f182 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Request method failure captured: Sep 27 17:33:02.980238 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: request: GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db HTTP/1.1 Sep 27 17:33:02.980238 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Accept: application/json Sep 27 17:33:02.980238 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Accept-Encoding: identity Sep 27 17:33:02.980238 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Connection: close Sep 27 17:33:02.980238 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Content-Length: 0 Sep 27 17:33:02.980238 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Content-Type: application/json Sep 27 17:33:02.980238 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Host: 10.222.0.55 Sep 27 17:33:02.980238 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Openstack-System-Scope: None Sep 27 17:33:02.980238 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: User-Agent: python-urllib3/1.26.12 Sep 27 17:33:02.980238 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Auth-Token: gAAAAABjMzG_oYsxxnSJCNk_tQmKplbiP8h3imjUWos1S01buLQp6CXEw5BhuA_PsGqwDIqMw-PI9rCZuq5MdQs4oib-fTI5tt7xrSk-xzMiyY02qpRv4aq4oNkQg1Pn7OKJFQCc5SdwkX3vwqfdurESDHgoSkrIRuwNUUO4Aup43BAcJ7MoD5U Sep 27 17:33:02.980238 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Domain-Id: None Sep 27 17:33:02.980238 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Domain-Name: None Sep 27 17:33:02.980238 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Identity-Status: Confirmed Sep 27 17:33:02.980238 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Is-Admin-Project: True Sep 27 17:33:02.980238 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Domain-Id: default Sep 27 17:33:02.980238 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Domain-Name: Default Sep 27 17:33:02.980238 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Id: fd5caa5782e74721a4c2991524182668 Sep 27 17:33:02.980238 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1705185754 Sep 27 17:33:02.980238 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Role: reader,member Sep 27 17:33:02.980238 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Roles: reader,member Sep 27 17:33:02.982668 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/fd5caa5782e74721a4c2991524182668"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_fd5caa5782e74721a4c2991524182668", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/fd5caa5782e74721a4c2991524182668"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/fd5caa5782e74721a4c2991524182668"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 27 17:33:02.982668 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1705185754 Sep 27 17:33:02.982668 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Tenant-Id: fd5caa5782e74721a4c2991524182668 Sep 27 17:33:02.982668 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1705185754 Sep 27 17:33:02.982668 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User: tempest-ServerRescueNegativeTestJSON-1705185754-project Sep 27 17:33:02.982668 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Domain-Id: default Sep 27 17:33:02.982668 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Domain-Name: Default Sep 27 17:33:02.982668 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Id: d23a498bde00483c8fdd68dcde975e5d Sep 27 17:33:02.982668 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1705185754-project Sep 27 17:33:02.982668 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: method: > Sep 27 17:33:02.982668 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: exception: Instance d622d15d-b954-409c-a1f5-538da5de83db could not be found. Sep 27 17:33:02.982668 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: action_args: {'id': 'd622d15d-b954-409c-a1f5-538da5de83db'} Sep 27 17:33:02.983451 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 17:33:02.983451 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:33:02.983451 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 17:33:02.983451 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 17:33:02.983451 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 17:33:02.983451 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 17:33:02.983451 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 17:33:02.983451 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 17:33:02.983451 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 17:33:02.983451 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 17:33:02.983451 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d622d15d-b954-409c-a1f5-538da5de83db could not be found. Sep 27 17:33:02.983451 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:33:02.983451 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:33:02.983451 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:33:02.983451 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:33:02.983451 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:33:02.983451 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:33:02.983451 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 17:33:02.983451 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 17:33:02.983451 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 17:33:02.984656 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 17:33:02.984656 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 17:33:02.984656 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 17:33:02.984656 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 17:33:02.984656 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 17:33:02.984656 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 17:33:02.984656 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 17:33:02.984656 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d622d15d-b954-409c-a1f5-538da5de83db could not be found. Sep 27 17:33:02.984656 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:33:02.984656 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:33:02.984656 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:33:02.984656 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:33:02.984656 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:33:02.984656 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:33:02.984656 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 17:33:02.984656 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 17:33:02.984656 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d622d15d-b954-409c-a1f5-538da5de83db could not be found. Sep 27 17:33:02.984656 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:33:02.986787 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-7c0fae0c-24dc-4b11-b43a-4d652c84d7c4 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: fef20d9a-42bf-4605-bbcb-b673d215a5b9] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:33:02.986930 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-abacd9fd-b179-41fc-87fc-f77f3ad7f182 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Returning 404 to user: Instance d622d15d-b954-409c-a1f5-538da5de83db could not be found. {{(pid=120416) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 17:33:02.986930 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-abacd9fd-b179-41fc-87fc-f77f3ad7f182 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db" status: 404 len: 111 microversion: 2.1 time: 0.030067 Sep 27 17:33:02.986930 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 453/880] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:33:02 2022] GET /compute/v2.1/servers/d622d15d-b954-409c-a1f5-538da5de83db => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 17:33:02.988068 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7c0fae0c-24dc-4b11-b43a-4d652c84d7c4 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:02.988559 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7c0fae0c-24dc-4b11-b43a-4d652c84d7c4 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:02.989030 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7c0fae0c-24dc-4b11-b43a-4d652c84d7c4 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:02.989730 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7c0fae0c-24dc-4b11-b43a-4d652c84d7c4 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:02.990210 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7c0fae0c-24dc-4b11-b43a-4d652c84d7c4 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:02.990333 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-27f806de-081e-4525-8d93-d985d0d5021f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:33:02.990645 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7c0fae0c-24dc-4b11-b43a-4d652c84d7c4 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:02.990807 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-27f806de-081e-4525-8d93-d985d0d5021f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: 95a7693f-d1df-43fb-81e7-1c83b069e269] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:33:02.996488 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-27f806de-081e-4525-8d93-d985d0d5021f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:02.996959 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-27f806de-081e-4525-8d93-d985d0d5021f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:02.997394 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-27f806de-081e-4525-8d93-d985d0d5021f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:02.998090 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-27f806de-081e-4525-8d93-d985d0d5021f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:02.998546 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-27f806de-081e-4525-8d93-d985d0d5021f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:02.998964 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-27f806de-081e-4525-8d93-d985d0d5021f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:03.004118 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.wsgi [None req-7c0fae0c-24dc-4b11-b43a-4d652c84d7c4 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] HTTP exception thrown: Instance fef20d9a-42bf-4605-bbcb-b673d215a5b9 could not be found. Sep 27 17:33:03.005801 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-7c0fae0c-24dc-4b11-b43a-4d652c84d7c4 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Request method failure captured: Sep 27 17:33:03.005801 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: request: GET /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9 HTTP/1.1 Sep 27 17:33:03.005801 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Accept: application/json Sep 27 17:33:03.005801 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Accept-Encoding: identity Sep 27 17:33:03.005801 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Connection: close Sep 27 17:33:03.005801 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Content-Length: 0 Sep 27 17:33:03.005801 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Content-Type: application/json Sep 27 17:33:03.005801 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Host: 10.222.0.55 Sep 27 17:33:03.005801 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Openstack-System-Scope: None Sep 27 17:33:03.005801 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: User-Agent: python-urllib3/1.26.12 Sep 27 17:33:03.005801 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Auth-Token: gAAAAABjMzJLbcCEQOqdb7vUsgmB1kYoJEkf6gmC-gBv2tRXmVys19QrTRcPsWXwKEDAq84Zx8Lk9yj3l6xwznprR9KLIbGZ9V7KSdvhEmUqz6sxyX18DRVOHZ32x9KkM54n-fmW5MzSlVPgKqrw3Lvqvb4fGZ9DWc41NDKWL10YNVKBy3FY280 Sep 27 17:33:03.005801 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Domain-Id: None Sep 27 17:33:03.005801 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Domain-Name: None Sep 27 17:33:03.005801 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Identity-Status: Confirmed Sep 27 17:33:03.005801 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Is-Admin-Project: True Sep 27 17:33:03.005801 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Domain-Id: default Sep 27 17:33:03.005801 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Domain-Name: Default Sep 27 17:33:03.005801 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Id: ef13103d3d8b43e1882d4820c8d9247b Sep 27 17:33:03.005801 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Name: tempest-AttachVolumeNegativeTest-1423690367 Sep 27 17:33:03.005801 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Role: reader,member Sep 27 17:33:03.005801 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Roles: reader,member Sep 27 17:33:03.007469 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ef13103d3d8b43e1882d4820c8d9247b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_ef13103d3d8b43e1882d4820c8d9247b", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ef13103d3d8b43e1882d4820c8d9247b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/ef13103d3d8b43e1882d4820c8d9247b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 27 17:33:03.007469 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Tenant: tempest-AttachVolumeNegativeTest-1423690367 Sep 27 17:33:03.007469 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Tenant-Id: ef13103d3d8b43e1882d4820c8d9247b Sep 27 17:33:03.007469 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1423690367 Sep 27 17:33:03.007469 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User: tempest-AttachVolumeNegativeTest-1423690367-project Sep 27 17:33:03.007469 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Domain-Id: default Sep 27 17:33:03.007469 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Domain-Name: Default Sep 27 17:33:03.007469 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Id: 0b02c2ba9a0a48c294a11b42cbfe28e3 Sep 27 17:33:03.007469 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Name: tempest-AttachVolumeNegativeTest-1423690367-project Sep 27 17:33:03.007469 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: method: > Sep 27 17:33:03.007469 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: exception: Instance fef20d9a-42bf-4605-bbcb-b673d215a5b9 could not be found. Sep 27 17:33:03.007469 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: action_args: {'id': 'fef20d9a-42bf-4605-bbcb-b673d215a5b9'} Sep 27 17:33:03.008220 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 17:33:03.008220 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:33:03.008220 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 17:33:03.008220 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 17:33:03.008220 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 17:33:03.008220 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 17:33:03.008220 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 17:33:03.008220 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 17:33:03.008220 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 17:33:03.008220 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 17:33:03.008220 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fef20d9a-42bf-4605-bbcb-b673d215a5b9 could not be found. Sep 27 17:33:03.008220 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:33:03.008220 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:33:03.008220 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:33:03.008220 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:33:03.008220 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:33:03.008220 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:33:03.008220 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 17:33:03.008220 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 17:33:03.008220 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 17:33:03.009451 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 17:33:03.009451 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 17:33:03.009451 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 17:33:03.009451 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 17:33:03.009451 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 17:33:03.009451 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 17:33:03.009451 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 17:33:03.009451 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fef20d9a-42bf-4605-bbcb-b673d215a5b9 could not be found. Sep 27 17:33:03.009451 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:33:03.009451 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:33:03.009451 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:33:03.009451 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:33:03.009451 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:33:03.009451 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:33:03.009451 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 17:33:03.009451 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 17:33:03.009451 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fef20d9a-42bf-4605-bbcb-b673d215a5b9 could not be found. Sep 27 17:33:03.009451 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:33:03.010581 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-7c0fae0c-24dc-4b11-b43a-4d652c84d7c4 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Returning 404 to user: Instance fef20d9a-42bf-4605-bbcb-b673d215a5b9 could not be found. {{(pid=120415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 17:33:03.010581 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-7c0fae0c-24dc-4b11-b43a-4d652c84d7c4 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9" status: 404 len: 111 microversion: 2.1 time: 0.031493 Sep 27 17:33:03.010581 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 428/881] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:33:02 2022] GET /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 27 17:33:03.016057 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-9e16c544-6cdc-49fb-bf44-a9869f46f1fd tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '.version_select at 0x7fe724815700>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:33:03.024492 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-27f806de-081e-4525-8d93-d985d0d5021f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: 95a7693f-d1df-43fb-81e7-1c83b069e269] Going to try to terminate instance {{(pid=120416) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 17:33:03.035133 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-9e16c544-6cdc-49fb-bf44-a9869f46f1fd tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1277881017" status: 202 len: 0 microversion: 2.1 time: 0.022568 Sep 27 17:33:03.035699 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 429/882] 10.222.0.55 () {58 vars in 1221 bytes} [Tue Sep 27 17:33:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1277881017 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 27 17:33:03.105318 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-27f806de-081e-4525-8d93-d985d0d5021f tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "DELETE /compute/v2.1/servers/95a7693f-d1df-43fb-81e7-1c83b069e269" status: 204 len: 0 microversion: 2.1 time: 0.117979 Sep 27 17:33:03.106459 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 454/883] 10.222.0.55 () {58 vars in 1239 bytes} [Tue Sep 27 17:33:02 2022] DELETE /compute/v2.1/servers/95a7693f-d1df-43fb-81e7-1c83b069e269 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 27 17:33:03.116356 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-f4781e50-78a2-4d40-a722-395941ace342 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:33:03.117500 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-f4781e50-78a2-4d40-a722-395941ace342 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: 95a7693f-d1df-43fb-81e7-1c83b069e269] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:33:03.124203 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f4781e50-78a2-4d40-a722-395941ace342 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:03.124691 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f4781e50-78a2-4d40-a722-395941ace342 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:03.125125 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f4781e50-78a2-4d40-a722-395941ace342 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:03.125814 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f4781e50-78a2-4d40-a722-395941ace342 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:03.126306 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f4781e50-78a2-4d40-a722-395941ace342 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:03.126730 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f4781e50-78a2-4d40-a722-395941ace342 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:03.257646 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-f4781e50-78a2-4d40-a722-395941ace342 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:33:03.265904 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-f4781e50-78a2-4d40-a722-395941ace342 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/95a7693f-d1df-43fb-81e7-1c83b069e269" status: 200 len: 1521 microversion: 2.1 time: 0.154259 Sep 27 17:33:03.266502 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 430/884] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:33:03 2022] GET /compute/v2.1/servers/95a7693f-d1df-43fb-81e7-1c83b069e269 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:33:03.658690 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-e0c40f74-188f-4317-9b16-639aea12dc16 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Action: 'create', calling method: .version_select at 0x7fe728314e50>, body: {"keypair": {"name": "tempest-keypair-1433029226", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJgBER9TTVkGD7GokMazSD/saPipo4ERb9Y998c2lAfD093fW4UiWjt3jEKVPXV5gJ8fFqXGWYeg8BOoYAclt603XiHQb6+/jUDm1tN77hDvkvCqWS1QrqaZ+AobI70F9w=="}} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:33:03.674493 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.quota [None req-e0c40f74-188f-4317-9b16-639aea12dc16 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Getting quotas for project ef13103d3d8b43e1882d4820c8d9247b. Resources: {'key_pairs'} {{(pid=120416) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 17:33:03.678844 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.quota [None req-e0c40f74-188f-4317-9b16-639aea12dc16 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Getting quotas for user 0b02c2ba9a0a48c294a11b42cbfe28e3 and project ef13103d3d8b43e1882d4820c8d9247b. Resources: {'key_pairs'} {{(pid=120416) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 17:33:03.694381 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:33:03.702779 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-e0c40f74-188f-4317-9b16-639aea12dc16 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048292 Sep 27 17:33:03.703615 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 455/885] 10.222.0.55 () {60 vars in 1159 bytes} [Tue Sep 27 17:33:03 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:33:03.940886 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-262569fa-3d21-429e-9546-f522548fb56c tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:33:03.941516 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-262569fa-3d21-429e-9546-f522548fb56c tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] [instance: 8b3855b6-18b1-46de-a1cc-f7a2941a42b9] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:33:03.948138 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-262569fa-3d21-429e-9546-f522548fb56c tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:03.948627 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-262569fa-3d21-429e-9546-f522548fb56c tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:03.949258 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-262569fa-3d21-429e-9546-f522548fb56c tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:03.950145 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-262569fa-3d21-429e-9546-f522548fb56c tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:03.950774 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-262569fa-3d21-429e-9546-f522548fb56c tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:03.951944 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-262569fa-3d21-429e-9546-f522548fb56c tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:04.289048 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-a89557f1-fddd-48c2-9d40-0938e8736b59 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:33:04.290414 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-a89557f1-fddd-48c2-9d40-0938e8736b59 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: 95a7693f-d1df-43fb-81e7-1c83b069e269] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:33:04.318203 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a89557f1-fddd-48c2-9d40-0938e8736b59 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:04.318745 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a89557f1-fddd-48c2-9d40-0938e8736b59 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:04.319378 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a89557f1-fddd-48c2-9d40-0938e8736b59 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:04.320396 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a89557f1-fddd-48c2-9d40-0938e8736b59 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:04.321664 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a89557f1-fddd-48c2-9d40-0938e8736b59 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:04.322173 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a89557f1-fddd-48c2-9d40-0938e8736b59 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:04.512753 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-262569fa-3d21-429e-9546-f522548fb56c tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5bf070765946168f7e5937f2b076c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890469995c02465eb9b9ad2d1fb9ab6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:33:04.521584 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-262569fa-3d21-429e-9546-f522548fb56c tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] 10.222.0.55 "GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9" status: 200 len: 1574 microversion: 2.1 time: 0.585484 Sep 27 17:33:04.522707 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 431/886] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:33:03 2022] GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9 => generated 1574 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:33:04.587228 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-a89557f1-fddd-48c2-9d40-0938e8736b59 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd23a498bde00483c8fdd68dcde975e5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5caa5782e74721a4c2991524182668', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:33:04.595562 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-a89557f1-fddd-48c2-9d40-0938e8736b59 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/95a7693f-d1df-43fb-81e7-1c83b069e269" status: 200 len: 1521 microversion: 2.1 time: 0.310469 Sep 27 17:33:04.611462 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 456/887] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:33:04 2022] GET /compute/v2.1/servers/95a7693f-d1df-43fb-81e7-1c83b069e269 => generated 1521 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:33:04.817014 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [req-d6dd5837-cc5a-49bf-9863-0fad783d705e req-7f59cd16-9df4-4eb4-b907-985ef7f20bad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95a7693f-d1df-43fb-81e7-1c83b069e269", "name": "network-vif-deleted", "tag": "c153b3a2-7878-4d7b-ac38-d30f63848b75"}]} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:33:04.827048 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-d6dd5837-cc5a-49bf-9863-0fad783d705e req-7f59cd16-9df4-4eb4-b907-985ef7f20bad service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:04.827995 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-d6dd5837-cc5a-49bf-9863-0fad783d705e req-7f59cd16-9df4-4eb4-b907-985ef7f20bad service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:04.828424 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-d6dd5837-cc5a-49bf-9863-0fad783d705e req-7f59cd16-9df4-4eb4-b907-985ef7f20bad service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:04.840387 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.compute.server_external_events [req-d6dd5837-cc5a-49bf-9863-0fad783d705e req-7f59cd16-9df4-4eb4-b907-985ef7f20bad service nova] Creating event network-vif-deleted:c153b3a2-7878-4d7b-ac38-d30f63848b75 for instance 95a7693f-d1df-43fb-81e7-1c83b069e269 on hv-cinder-84914 Sep 27 17:33:04.845710 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [req-d6dd5837-cc5a-49bf-9863-0fad783d705e req-7f59cd16-9df4-4eb4-b907-985ef7f20bad service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032293 Sep 27 17:33:04.849781 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 432/888] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:33:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:33:05.042351 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-ab1fa7fe-3cea-4c00-a789-832dd3dbca91 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1216032940", "imageRef": "9355bd92-0a49-42cd-b079-ff9f0d54b91b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "50dc8265-0d0d-49da-afd6-19daca5e673b"}], "security_groups": [{"name": "tempest-securitygroup--1949625396"}], "key_name": "tempest-keypair-1433029226", "user_data": "}} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:33:05.148245 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.network.neutron [None req-ab1fa7fe-3cea-4c00-a789-832dd3dbca91 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] validate_networks() for [('50dc8265-0d0d-49da-afd6-19daca5e673b', None, None, None, None, None)] {{(pid=120416) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 17:33:05.521584 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.virt.hardware [None req-ab1fa7fe-3cea-4c00-a789-832dd3dbca91 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Flavor limits 0:0:0 {{(pid=120416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 17:33:05.522204 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.virt.hardware [None req-ab1fa7fe-3cea-4c00-a789-832dd3dbca91 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Image limits 0:0:0 {{(pid=120416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 17:33:05.522507 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.virt.hardware [None req-ab1fa7fe-3cea-4c00-a789-832dd3dbca91 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Flavor pref 0:0:0 {{(pid=120416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 17:33:05.522940 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.virt.hardware [None req-ab1fa7fe-3cea-4c00-a789-832dd3dbca91 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Image pref 0:0:0 {{(pid=120416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 17:33:05.523346 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.virt.hardware [None req-ab1fa7fe-3cea-4c00-a789-832dd3dbca91 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 17:33:05.532620 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ab1fa7fe-3cea-4c00-a789-832dd3dbca91 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:05.533093 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ab1fa7fe-3cea-4c00-a789-832dd3dbca91 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:05.533522 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ab1fa7fe-3cea-4c00-a789-832dd3dbca91 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:05.534278 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ab1fa7fe-3cea-4c00-a789-832dd3dbca91 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:05.534726 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ab1fa7fe-3cea-4c00-a789-832dd3dbca91 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:05.535145 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ab1fa7fe-3cea-4c00-a789-832dd3dbca91 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:05.548081 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-b0236a20-5d37-4010-8999-89dea142c597 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:33:05.548875 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-b0236a20-5d37-4010-8999-89dea142c597 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] [instance: 8b3855b6-18b1-46de-a1cc-f7a2941a42b9] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:33:05.551386 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.quota [None req-ab1fa7fe-3cea-4c00-a789-832dd3dbca91 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Getting quotas for project ef13103d3d8b43e1882d4820c8d9247b. Resources: {'cores', 'ram', 'instances'} {{(pid=120416) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 17:33:05.555260 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b0236a20-5d37-4010-8999-89dea142c597 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:05.555412 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.quota [None req-ab1fa7fe-3cea-4c00-a789-832dd3dbca91 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Getting quotas for user 0b02c2ba9a0a48c294a11b42cbfe28e3 and project ef13103d3d8b43e1882d4820c8d9247b. Resources: {'cores', 'ram', 'instances'} {{(pid=120416) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 17:33:05.555917 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b0236a20-5d37-4010-8999-89dea142c597 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:05.556421 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b0236a20-5d37-4010-8999-89dea142c597 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:05.557182 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b0236a20-5d37-4010-8999-89dea142c597 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:05.557643 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b0236a20-5d37-4010-8999-89dea142c597 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:05.558085 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b0236a20-5d37-4010-8999-89dea142c597 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:05.566390 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-ab1fa7fe-3cea-4c00-a789-832dd3dbca91 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Going to run 1 instances... {{(pid=120416) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 17:33:05.568683 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-ab1fa7fe-3cea-4c00-a789-832dd3dbca91 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: ce5f26c2-638d-4baf-9ccb-ba578b97cfc1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9355bd92-0a49-42cd-b079-ff9f0d54b91b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120416) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 17:33:05.617351 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-ab1fa7fe-3cea-4c00-a789-832dd3dbca91 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.579259 Sep 27 17:33:05.617994 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 457/889] 10.222.0.55 () {60 vars in 1147 bytes} [Tue Sep 27 17:33:05 2022] POST /compute/v2.1/servers => generated 402 bytes in 581 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 17:33:05.623092 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-d7ae0873-9460-4763-8e3e-d5fa030d7e22 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:33:05.623699 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-d7ae0873-9460-4763-8e3e-d5fa030d7e22 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] [instance: 95a7693f-d1df-43fb-81e7-1c83b069e269] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:33:05.630424 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d7ae0873-9460-4763-8e3e-d5fa030d7e22 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:05.630917 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d7ae0873-9460-4763-8e3e-d5fa030d7e22 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:05.631355 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d7ae0873-9460-4763-8e3e-d5fa030d7e22 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:05.632052 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d7ae0873-9460-4763-8e3e-d5fa030d7e22 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:05.632506 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d7ae0873-9460-4763-8e3e-d5fa030d7e22 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:05.634116 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d7ae0873-9460-4763-8e3e-d5fa030d7e22 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:05.646949 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.wsgi [None req-d7ae0873-9460-4763-8e3e-d5fa030d7e22 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] HTTP exception thrown: Instance 95a7693f-d1df-43fb-81e7-1c83b069e269 could not be found. Sep 27 17:33:05.648702 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-d7ae0873-9460-4763-8e3e-d5fa030d7e22 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Request method failure captured: Sep 27 17:33:05.648702 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: request: GET /compute/v2.1/servers/95a7693f-d1df-43fb-81e7-1c83b069e269 HTTP/1.1 Sep 27 17:33:05.648702 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Accept: application/json Sep 27 17:33:05.648702 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Accept-Encoding: identity Sep 27 17:33:05.648702 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Connection: close Sep 27 17:33:05.648702 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Content-Length: 0 Sep 27 17:33:05.648702 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Content-Type: application/json Sep 27 17:33:05.648702 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Host: 10.222.0.55 Sep 27 17:33:05.648702 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Openstack-System-Scope: None Sep 27 17:33:05.648702 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: User-Agent: python-urllib3/1.26.12 Sep 27 17:33:05.648702 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Auth-Token: gAAAAABjMzG_oYsxxnSJCNk_tQmKplbiP8h3imjUWos1S01buLQp6CXEw5BhuA_PsGqwDIqMw-PI9rCZuq5MdQs4oib-fTI5tt7xrSk-xzMiyY02qpRv4aq4oNkQg1Pn7OKJFQCc5SdwkX3vwqfdurESDHgoSkrIRuwNUUO4Aup43BAcJ7MoD5U Sep 27 17:33:05.648702 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Domain-Id: None Sep 27 17:33:05.648702 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Domain-Name: None Sep 27 17:33:05.648702 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Identity-Status: Confirmed Sep 27 17:33:05.648702 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Is-Admin-Project: True Sep 27 17:33:05.648702 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Domain-Id: default Sep 27 17:33:05.648702 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Domain-Name: Default Sep 27 17:33:05.648702 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Id: fd5caa5782e74721a4c2991524182668 Sep 27 17:33:05.648702 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1705185754 Sep 27 17:33:05.648702 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Role: reader,member Sep 27 17:33:05.648702 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Roles: reader,member Sep 27 17:33:05.651067 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/fd5caa5782e74721a4c2991524182668"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_fd5caa5782e74721a4c2991524182668", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/fd5caa5782e74721a4c2991524182668"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/fd5caa5782e74721a4c2991524182668"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 27 17:33:05.651067 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1705185754 Sep 27 17:33:05.651067 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Tenant-Id: fd5caa5782e74721a4c2991524182668 Sep 27 17:33:05.651067 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1705185754 Sep 27 17:33:05.651067 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User: tempest-ServerRescueNegativeTestJSON-1705185754-project Sep 27 17:33:05.651067 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Domain-Id: default Sep 27 17:33:05.651067 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Domain-Name: Default Sep 27 17:33:05.651067 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Id: d23a498bde00483c8fdd68dcde975e5d Sep 27 17:33:05.651067 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1705185754-project Sep 27 17:33:05.651067 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: method: > Sep 27 17:33:05.651067 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: exception: Instance 95a7693f-d1df-43fb-81e7-1c83b069e269 could not be found. Sep 27 17:33:05.651067 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: action_args: {'id': '95a7693f-d1df-43fb-81e7-1c83b069e269'} Sep 27 17:33:05.656647 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 17:33:05.656647 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:33:05.656647 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 17:33:05.656647 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 17:33:05.656647 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 17:33:05.656647 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 17:33:05.656647 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 17:33:05.656647 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 17:33:05.656647 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 17:33:05.656647 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 17:33:05.656647 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95a7693f-d1df-43fb-81e7-1c83b069e269 could not be found. Sep 27 17:33:05.656647 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:33:05.656647 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:33:05.656647 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:33:05.656647 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:33:05.656647 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:33:05.656647 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:33:05.656647 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 17:33:05.656647 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 17:33:05.656647 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 17:33:05.658707 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 17:33:05.658707 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 17:33:05.658707 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 17:33:05.658707 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 17:33:05.658707 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 17:33:05.658707 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 17:33:05.658707 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 17:33:05.658707 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95a7693f-d1df-43fb-81e7-1c83b069e269 could not be found. Sep 27 17:33:05.658707 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:33:05.658707 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:33:05.658707 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:33:05.658707 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:33:05.658707 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:33:05.658707 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:33:05.658707 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 17:33:05.658707 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 17:33:05.658707 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95a7693f-d1df-43fb-81e7-1c83b069e269 could not be found. Sep 27 17:33:05.658707 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:33:05.662136 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-d7ae0873-9460-4763-8e3e-d5fa030d7e22 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] Returning 404 to user: Instance 95a7693f-d1df-43fb-81e7-1c83b069e269 could not be found. {{(pid=120416) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 17:33:05.662136 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-d7ae0873-9460-4763-8e3e-d5fa030d7e22 tempest-ServerRescueNegativeTestJSON-1705185754 tempest-ServerRescueNegativeTestJSON-1705185754-project] 10.222.0.55 "GET /compute/v2.1/servers/95a7693f-d1df-43fb-81e7-1c83b069e269" status: 404 len: 111 microversion: 2.1 time: 0.031152 Sep 27 17:33:05.662136 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 458/890] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:33:05 2022] GET /compute/v2.1/servers/95a7693f-d1df-43fb-81e7-1c83b069e269 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 17:33:05.662136 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-83f4bcb9-4db0-4267-bfde-f57f699bb2b0 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:33:05.662136 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-83f4bcb9-4db0-4267-bfde-f57f699bb2b0 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: ce5f26c2-638d-4baf-9ccb-ba578b97cfc1] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:33:05.727591 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-83f4bcb9-4db0-4267-bfde-f57f699bb2b0 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b02c2ba9a0a48c294a11b42cbfe28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef13103d3d8b43e1882d4820c8d9247b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:33:05.737524 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-83f4bcb9-4db0-4267-bfde-f57f699bb2b0 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/ce5f26c2-638d-4baf-9ccb-ba578b97cfc1" status: 200 len: 1242 microversion: 2.1 time: 0.084906 Sep 27 17:33:05.738431 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 459/891] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:33:05 2022] GET /compute/v2.1/servers/ce5f26c2-638d-4baf-9ccb-ba578b97cfc1 => generated 1242 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:33:05.772887 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-b0236a20-5d37-4010-8999-89dea142c597 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5bf070765946168f7e5937f2b076c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890469995c02465eb9b9ad2d1fb9ab6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:33:05.781532 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-b0236a20-5d37-4010-8999-89dea142c597 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] 10.222.0.55 "GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9" status: 200 len: 1574 microversion: 2.1 time: 0.238420 Sep 27 17:33:05.782135 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 433/892] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:33:05 2022] GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9 => generated 1574 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:33:06.760918 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-83739f53-264b-4e71-b3b0-4a607c1813d5 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:33:06.761534 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-83739f53-264b-4e71-b3b0-4a607c1813d5 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: ce5f26c2-638d-4baf-9ccb-ba578b97cfc1] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:33:06.770776 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-83739f53-264b-4e71-b3b0-4a607c1813d5 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:06.771270 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-83739f53-264b-4e71-b3b0-4a607c1813d5 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:06.771711 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-83739f53-264b-4e71-b3b0-4a607c1813d5 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:06.772616 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-83739f53-264b-4e71-b3b0-4a607c1813d5 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:06.773076 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-83739f53-264b-4e71-b3b0-4a607c1813d5 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:06.773502 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-83739f53-264b-4e71-b3b0-4a607c1813d5 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:06.805800 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-c372ce55-8cb2-4bd8-83ef-1a1d499563bd tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:33:06.806466 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-c372ce55-8cb2-4bd8-83ef-1a1d499563bd tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] [instance: 8b3855b6-18b1-46de-a1cc-f7a2941a42b9] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:33:06.817809 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c372ce55-8cb2-4bd8-83ef-1a1d499563bd tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:06.818450 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c372ce55-8cb2-4bd8-83ef-1a1d499563bd tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:06.818961 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c372ce55-8cb2-4bd8-83ef-1a1d499563bd tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:06.820050 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c372ce55-8cb2-4bd8-83ef-1a1d499563bd tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:06.820712 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c372ce55-8cb2-4bd8-83ef-1a1d499563bd tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:06.821301 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c372ce55-8cb2-4bd8-83ef-1a1d499563bd tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:06.851189 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-83739f53-264b-4e71-b3b0-4a607c1813d5 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b02c2ba9a0a48c294a11b42cbfe28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef13103d3d8b43e1882d4820c8d9247b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:33:06.860116 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-83739f53-264b-4e71-b3b0-4a607c1813d5 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/ce5f26c2-638d-4baf-9ccb-ba578b97cfc1" status: 200 len: 1294 microversion: 2.1 time: 0.103150 Sep 27 17:33:06.861228 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 460/893] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:33:06 2022] GET /compute/v2.1/servers/ce5f26c2-638d-4baf-9ccb-ba578b97cfc1 => generated 1294 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:33:06.969900 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-c372ce55-8cb2-4bd8-83ef-1a1d499563bd tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5bf070765946168f7e5937f2b076c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890469995c02465eb9b9ad2d1fb9ab6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:33:06.978007 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-c372ce55-8cb2-4bd8-83ef-1a1d499563bd tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] 10.222.0.55 "GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9" status: 200 len: 1574 microversion: 2.1 time: 0.177058 Sep 27 17:33:06.978619 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 434/894] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:33:06 2022] GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9 => generated 1574 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:33:07.884948 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-5e83703c-7f8e-428a-8f4a-5e96833c6b6d tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:33:07.885657 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-5e83703c-7f8e-428a-8f4a-5e96833c6b6d tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: ce5f26c2-638d-4baf-9ccb-ba578b97cfc1] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:33:07.892218 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5e83703c-7f8e-428a-8f4a-5e96833c6b6d tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:07.892707 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5e83703c-7f8e-428a-8f4a-5e96833c6b6d tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:07.893321 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5e83703c-7f8e-428a-8f4a-5e96833c6b6d tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:07.894238 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5e83703c-7f8e-428a-8f4a-5e96833c6b6d tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:07.894890 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5e83703c-7f8e-428a-8f4a-5e96833c6b6d tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:07.895436 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5e83703c-7f8e-428a-8f4a-5e96833c6b6d tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:07.992878 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-5e83703c-7f8e-428a-8f4a-5e96833c6b6d tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b02c2ba9a0a48c294a11b42cbfe28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef13103d3d8b43e1882d4820c8d9247b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:33:08.003190 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-db8453d5-3040-4928-a8c3-73fe61306617 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:33:08.004046 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-db8453d5-3040-4928-a8c3-73fe61306617 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] [instance: 8b3855b6-18b1-46de-a1cc-f7a2941a42b9] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:33:08.008806 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-5e83703c-7f8e-428a-8f4a-5e96833c6b6d tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/ce5f26c2-638d-4baf-9ccb-ba578b97cfc1" status: 200 len: 1302 microversion: 2.1 time: 0.128253 Sep 27 17:33:08.009944 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 461/895] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:33:07 2022] GET /compute/v2.1/servers/ce5f26c2-638d-4baf-9ccb-ba578b97cfc1 => generated 1302 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:33:08.030585 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:33:08.034695 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-db8453d5-3040-4928-a8c3-73fe61306617 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:08.035207 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-db8453d5-3040-4928-a8c3-73fe61306617 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:08.035830 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-db8453d5-3040-4928-a8c3-73fe61306617 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:08.036558 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-db8453d5-3040-4928-a8c3-73fe61306617 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:08.037030 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-db8453d5-3040-4928-a8c3-73fe61306617 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:08.037440 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-db8453d5-3040-4928-a8c3-73fe61306617 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:08.251541 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-db8453d5-3040-4928-a8c3-73fe61306617 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5bf070765946168f7e5937f2b076c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890469995c02465eb9b9ad2d1fb9ab6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:33:08.260944 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-db8453d5-3040-4928-a8c3-73fe61306617 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] 10.222.0.55 "GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9" status: 200 len: 1574 microversion: 2.1 time: 0.261753 Sep 27 17:33:08.261618 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 435/896] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:33:07 2022] GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9 => generated 1574 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:33:09.033851 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-7c205be4-da25-4d09-8554-0c2ab979dbee tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:33:09.034552 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-7c205be4-da25-4d09-8554-0c2ab979dbee tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: ce5f26c2-638d-4baf-9ccb-ba578b97cfc1] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:33:09.040780 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7c205be4-da25-4d09-8554-0c2ab979dbee tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:09.041474 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7c205be4-da25-4d09-8554-0c2ab979dbee tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:09.042258 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7c205be4-da25-4d09-8554-0c2ab979dbee tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:09.042985 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7c205be4-da25-4d09-8554-0c2ab979dbee tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:09.043435 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7c205be4-da25-4d09-8554-0c2ab979dbee tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:09.043856 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7c205be4-da25-4d09-8554-0c2ab979dbee tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:09.285843 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-c06e0ceb-ec96-4b1f-ad94-ff699f2611ec tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:33:09.287477 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-c06e0ceb-ec96-4b1f-ad94-ff699f2611ec tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] [instance: 8b3855b6-18b1-46de-a1cc-f7a2941a42b9] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:33:09.295863 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c06e0ceb-ec96-4b1f-ad94-ff699f2611ec tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:09.296453 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c06e0ceb-ec96-4b1f-ad94-ff699f2611ec tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:09.296939 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c06e0ceb-ec96-4b1f-ad94-ff699f2611ec tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:09.297877 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c06e0ceb-ec96-4b1f-ad94-ff699f2611ec tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:09.298571 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c06e0ceb-ec96-4b1f-ad94-ff699f2611ec tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:09.298997 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c06e0ceb-ec96-4b1f-ad94-ff699f2611ec tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:09.421171 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-7c205be4-da25-4d09-8554-0c2ab979dbee tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b02c2ba9a0a48c294a11b42cbfe28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef13103d3d8b43e1882d4820c8d9247b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:33:09.430216 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-7c205be4-da25-4d09-8554-0c2ab979dbee tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/ce5f26c2-638d-4baf-9ccb-ba578b97cfc1" status: 200 len: 1368 microversion: 2.1 time: 0.400575 Sep 27 17:33:09.430806 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 462/897] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:33:09 2022] GET /compute/v2.1/servers/ce5f26c2-638d-4baf-9ccb-ba578b97cfc1 => generated 1368 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:33:09.652806 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-c06e0ceb-ec96-4b1f-ad94-ff699f2611ec tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5bf070765946168f7e5937f2b076c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890469995c02465eb9b9ad2d1fb9ab6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:33:09.661364 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-c06e0ceb-ec96-4b1f-ad94-ff699f2611ec tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] 10.222.0.55 "GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9" status: 200 len: 1574 microversion: 2.1 time: 0.380601 Sep 27 17:33:09.662016 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 436/898] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:33:09 2022] GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9 => generated 1574 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:33:10.268714 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [req-e87d6e80-fc7f-4921-9452-375e4ac3c2ad req-43361f23-4ebe-44bb-a580-09139d8e6e8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce5f26c2-638d-4baf-9ccb-ba578b97cfc1", "tag": "ef3355f1-2589-4b0a-bdb1-68cba54179a8"}]} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:33:10.285030 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-e87d6e80-fc7f-4921-9452-375e4ac3c2ad req-43361f23-4ebe-44bb-a580-09139d8e6e8c service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:10.286836 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-e87d6e80-fc7f-4921-9452-375e4ac3c2ad req-43361f23-4ebe-44bb-a580-09139d8e6e8c service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:10.287520 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-e87d6e80-fc7f-4921-9452-375e4ac3c2ad req-43361f23-4ebe-44bb-a580-09139d8e6e8c service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:10.299992 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.compute.server_external_events [req-e87d6e80-fc7f-4921-9452-375e4ac3c2ad req-43361f23-4ebe-44bb-a580-09139d8e6e8c service nova] Creating event network-changed:ef3355f1-2589-4b0a-bdb1-68cba54179a8 for instance ce5f26c2-638d-4baf-9ccb-ba578b97cfc1 on hv-cinder-84914 Sep 27 17:33:10.309918 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [req-e87d6e80-fc7f-4921-9452-375e4ac3c2ad req-43361f23-4ebe-44bb-a580-09139d8e6e8c service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044688 Sep 27 17:33:10.310876 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 463/899] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:33:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:33:10.456142 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-80bd032b-ad7f-4ed6-b91b-0c455b9d345f tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:33:10.456895 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-80bd032b-ad7f-4ed6-b91b-0c455b9d345f tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: ce5f26c2-638d-4baf-9ccb-ba578b97cfc1] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:33:10.463462 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-80bd032b-ad7f-4ed6-b91b-0c455b9d345f tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:10.463951 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-80bd032b-ad7f-4ed6-b91b-0c455b9d345f tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:10.464389 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-80bd032b-ad7f-4ed6-b91b-0c455b9d345f tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:10.465085 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-80bd032b-ad7f-4ed6-b91b-0c455b9d345f tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:10.465540 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-80bd032b-ad7f-4ed6-b91b-0c455b9d345f tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:10.466044 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-80bd032b-ad7f-4ed6-b91b-0c455b9d345f tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:10.686986 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-85c041fc-ea4b-4a57-9b74-a73e1ddb73d7 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:33:10.688095 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-85c041fc-ea4b-4a57-9b74-a73e1ddb73d7 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] [instance: 8b3855b6-18b1-46de-a1cc-f7a2941a42b9] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:33:10.694781 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-85c041fc-ea4b-4a57-9b74-a73e1ddb73d7 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:10.695809 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-85c041fc-ea4b-4a57-9b74-a73e1ddb73d7 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:10.696867 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-85c041fc-ea4b-4a57-9b74-a73e1ddb73d7 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:10.698029 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-85c041fc-ea4b-4a57-9b74-a73e1ddb73d7 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:10.698892 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-85c041fc-ea4b-4a57-9b74-a73e1ddb73d7 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:10.699512 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-85c041fc-ea4b-4a57-9b74-a73e1ddb73d7 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:10.701548 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-80bd032b-ad7f-4ed6-b91b-0c455b9d345f tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b02c2ba9a0a48c294a11b42cbfe28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef13103d3d8b43e1882d4820c8d9247b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:33:10.710902 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-80bd032b-ad7f-4ed6-b91b-0c455b9d345f tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/ce5f26c2-638d-4baf-9ccb-ba578b97cfc1" status: 200 len: 1368 microversion: 2.1 time: 0.259709 Sep 27 17:33:10.727540 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 437/900] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:33:10 2022] GET /compute/v2.1/servers/ce5f26c2-638d-4baf-9ccb-ba578b97cfc1 => generated 1368 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:33:10.735552 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [req-6e9760a9-446a-4f3f-bf63-cccc842b06ca req-8016f998-44f1-4e2f-a002-c0dd88bdb27b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b3855b6-18b1-46de-a1cc-f7a2941a42b9", "name": "network-vif-plugged", "status": "completed", "tag": "c0932507-0f02-4d95-8195-002c756fdef5"}]} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:33:10.748077 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-6e9760a9-446a-4f3f-bf63-cccc842b06ca req-8016f998-44f1-4e2f-a002-c0dd88bdb27b service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:10.748835 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-6e9760a9-446a-4f3f-bf63-cccc842b06ca req-8016f998-44f1-4e2f-a002-c0dd88bdb27b service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:10.749255 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-6e9760a9-446a-4f3f-bf63-cccc842b06ca req-8016f998-44f1-4e2f-a002-c0dd88bdb27b service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:10.780001 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.compute.server_external_events [req-6e9760a9-446a-4f3f-bf63-cccc842b06ca req-8016f998-44f1-4e2f-a002-c0dd88bdb27b service nova] Creating event network-vif-plugged:c0932507-0f02-4d95-8195-002c756fdef5 for instance 8b3855b6-18b1-46de-a1cc-f7a2941a42b9 on hv-cinder-84914 Sep 27 17:33:10.785818 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [req-6e9760a9-446a-4f3f-bf63-cccc842b06ca req-8016f998-44f1-4e2f-a002-c0dd88bdb27b service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056812 Sep 27 17:33:10.786548 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 438/901] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:33:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:33:10.905853 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-85c041fc-ea4b-4a57-9b74-a73e1ddb73d7 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5bf070765946168f7e5937f2b076c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890469995c02465eb9b9ad2d1fb9ab6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:33:10.910092 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:33:10.915378 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-85c041fc-ea4b-4a57-9b74-a73e1ddb73d7 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] 10.222.0.55 "GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9" status: 200 len: 1574 microversion: 2.1 time: 0.233454 Sep 27 17:33:10.916036 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 464/902] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:33:10 2022] GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9 => generated 1574 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:33:11.740799 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-689dd053-7079-43f1-8a79-377a1aba4318 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:33:11.741504 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-689dd053-7079-43f1-8a79-377a1aba4318 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: ce5f26c2-638d-4baf-9ccb-ba578b97cfc1] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:33:11.748432 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-689dd053-7079-43f1-8a79-377a1aba4318 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:11.749015 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-689dd053-7079-43f1-8a79-377a1aba4318 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:11.749529 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-689dd053-7079-43f1-8a79-377a1aba4318 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:11.750343 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-689dd053-7079-43f1-8a79-377a1aba4318 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:11.750869 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-689dd053-7079-43f1-8a79-377a1aba4318 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:11.751365 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-689dd053-7079-43f1-8a79-377a1aba4318 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:11.892475 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-689dd053-7079-43f1-8a79-377a1aba4318 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b02c2ba9a0a48c294a11b42cbfe28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef13103d3d8b43e1882d4820c8d9247b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:33:11.896163 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:33:11.902013 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-689dd053-7079-43f1-8a79-377a1aba4318 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/ce5f26c2-638d-4baf-9ccb-ba578b97cfc1" status: 200 len: 1368 microversion: 2.1 time: 0.166009 Sep 27 17:33:11.902628 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 439/903] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:33:11 2022] GET /compute/v2.1/servers/ce5f26c2-638d-4baf-9ccb-ba578b97cfc1 => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:33:11.938763 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-c70058b3-341b-439f-8e0b-47e14865f882 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:33:11.939369 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-c70058b3-341b-439f-8e0b-47e14865f882 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] [instance: 8b3855b6-18b1-46de-a1cc-f7a2941a42b9] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:33:11.947021 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c70058b3-341b-439f-8e0b-47e14865f882 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:11.947517 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c70058b3-341b-439f-8e0b-47e14865f882 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:11.947945 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c70058b3-341b-439f-8e0b-47e14865f882 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:11.948658 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c70058b3-341b-439f-8e0b-47e14865f882 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:11.949104 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c70058b3-341b-439f-8e0b-47e14865f882 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:11.949520 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c70058b3-341b-439f-8e0b-47e14865f882 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:12.091656 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-c70058b3-341b-439f-8e0b-47e14865f882 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5bf070765946168f7e5937f2b076c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890469995c02465eb9b9ad2d1fb9ab6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:33:12.100069 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-c70058b3-341b-439f-8e0b-47e14865f882 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] 10.222.0.55 "GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9" status: 200 len: 1574 microversion: 2.1 time: 0.165223 Sep 27 17:33:12.101135 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 465/904] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:33:11 2022] GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9 => generated 1574 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:33:12.925027 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-a5830270-7ba3-4e20-8875-f7377569daef tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:33:12.925686 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-a5830270-7ba3-4e20-8875-f7377569daef tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: ce5f26c2-638d-4baf-9ccb-ba578b97cfc1] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:33:12.933547 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a5830270-7ba3-4e20-8875-f7377569daef tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:12.934287 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a5830270-7ba3-4e20-8875-f7377569daef tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:12.934725 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a5830270-7ba3-4e20-8875-f7377569daef tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:12.935417 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a5830270-7ba3-4e20-8875-f7377569daef tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:12.935866 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a5830270-7ba3-4e20-8875-f7377569daef tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:12.936329 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a5830270-7ba3-4e20-8875-f7377569daef tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:13.076700 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-a5830270-7ba3-4e20-8875-f7377569daef tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b02c2ba9a0a48c294a11b42cbfe28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef13103d3d8b43e1882d4820c8d9247b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:33:13.085152 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-a5830270-7ba3-4e20-8875-f7377569daef tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/ce5f26c2-638d-4baf-9ccb-ba578b97cfc1" status: 200 len: 1368 microversion: 2.1 time: 0.163923 Sep 27 17:33:13.085711 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 440/905] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:33:12 2022] GET /compute/v2.1/servers/ce5f26c2-638d-4baf-9ccb-ba578b97cfc1 => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:33:13.126468 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-d7a5389e-f77f-4c63-88df-2dfcf9c5a1da tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:33:13.127012 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-d7a5389e-f77f-4c63-88df-2dfcf9c5a1da tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] [instance: 8b3855b6-18b1-46de-a1cc-f7a2941a42b9] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:33:13.132904 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d7a5389e-f77f-4c63-88df-2dfcf9c5a1da tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:13.133380 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d7a5389e-f77f-4c63-88df-2dfcf9c5a1da tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:13.133811 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d7a5389e-f77f-4c63-88df-2dfcf9c5a1da tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:13.134520 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d7a5389e-f77f-4c63-88df-2dfcf9c5a1da tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:13.134974 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d7a5389e-f77f-4c63-88df-2dfcf9c5a1da tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:13.135392 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d7a5389e-f77f-4c63-88df-2dfcf9c5a1da tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:13.266159 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-d7a5389e-f77f-4c63-88df-2dfcf9c5a1da tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5bf070765946168f7e5937f2b076c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890469995c02465eb9b9ad2d1fb9ab6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:33:13.274004 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-d7a5389e-f77f-4c63-88df-2dfcf9c5a1da tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] 10.222.0.55 "GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9" status: 200 len: 1574 microversion: 2.1 time: 0.151983 Sep 27 17:33:13.289477 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 466/906] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:33:13 2022] GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9 => generated 1574 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:33:14.109463 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-3b924e3d-50ad-4a7f-9998-eff6cc6b7cec tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:33:14.110186 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-3b924e3d-50ad-4a7f-9998-eff6cc6b7cec tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: ce5f26c2-638d-4baf-9ccb-ba578b97cfc1] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:33:14.116868 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3b924e3d-50ad-4a7f-9998-eff6cc6b7cec tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:14.117348 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3b924e3d-50ad-4a7f-9998-eff6cc6b7cec tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:14.117776 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3b924e3d-50ad-4a7f-9998-eff6cc6b7cec tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:14.118488 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3b924e3d-50ad-4a7f-9998-eff6cc6b7cec tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:14.118934 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3b924e3d-50ad-4a7f-9998-eff6cc6b7cec tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:14.119350 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3b924e3d-50ad-4a7f-9998-eff6cc6b7cec tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:14.252169 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-3b924e3d-50ad-4a7f-9998-eff6cc6b7cec tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b02c2ba9a0a48c294a11b42cbfe28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef13103d3d8b43e1882d4820c8d9247b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:33:14.259898 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-3b924e3d-50ad-4a7f-9998-eff6cc6b7cec tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/ce5f26c2-638d-4baf-9ccb-ba578b97cfc1" status: 200 len: 1368 microversion: 2.1 time: 0.155080 Sep 27 17:33:14.270038 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 441/907] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:33:14 2022] GET /compute/v2.1/servers/ce5f26c2-638d-4baf-9ccb-ba578b97cfc1 => generated 1368 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:33:14.296652 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-147a8a5f-eee3-474b-ae03-7b1f23e14e69 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:33:14.297824 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-147a8a5f-eee3-474b-ae03-7b1f23e14e69 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] [instance: 8b3855b6-18b1-46de-a1cc-f7a2941a42b9] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:33:14.304035 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-147a8a5f-eee3-474b-ae03-7b1f23e14e69 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:14.304752 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-147a8a5f-eee3-474b-ae03-7b1f23e14e69 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:14.305371 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-147a8a5f-eee3-474b-ae03-7b1f23e14e69 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:14.306302 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-147a8a5f-eee3-474b-ae03-7b1f23e14e69 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:14.306916 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-147a8a5f-eee3-474b-ae03-7b1f23e14e69 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:14.307339 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-147a8a5f-eee3-474b-ae03-7b1f23e14e69 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:14.493111 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-147a8a5f-eee3-474b-ae03-7b1f23e14e69 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5bf070765946168f7e5937f2b076c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890469995c02465eb9b9ad2d1fb9ab6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:33:14.501558 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-147a8a5f-eee3-474b-ae03-7b1f23e14e69 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] 10.222.0.55 "GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9" status: 200 len: 1574 microversion: 2.1 time: 0.208700 Sep 27 17:33:14.502148 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 467/908] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:33:14 2022] GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9 => generated 1574 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:33:15.284998 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-b1e5d3ce-58f6-4f6b-ad43-daf49f3530b9 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:33:15.285616 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-b1e5d3ce-58f6-4f6b-ad43-daf49f3530b9 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: ce5f26c2-638d-4baf-9ccb-ba578b97cfc1] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:33:15.293140 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b1e5d3ce-58f6-4f6b-ad43-daf49f3530b9 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:15.293629 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b1e5d3ce-58f6-4f6b-ad43-daf49f3530b9 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:15.294084 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b1e5d3ce-58f6-4f6b-ad43-daf49f3530b9 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:15.295411 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b1e5d3ce-58f6-4f6b-ad43-daf49f3530b9 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:15.295868 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b1e5d3ce-58f6-4f6b-ad43-daf49f3530b9 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:15.296302 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b1e5d3ce-58f6-4f6b-ad43-daf49f3530b9 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:15.529376 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-7d0eb6d6-dbd9-428f-b695-96b794124512 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:33:15.530198 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-7d0eb6d6-dbd9-428f-b695-96b794124512 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] [instance: 8b3855b6-18b1-46de-a1cc-f7a2941a42b9] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:33:15.536763 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7d0eb6d6-dbd9-428f-b695-96b794124512 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:15.537384 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7d0eb6d6-dbd9-428f-b695-96b794124512 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:15.537931 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7d0eb6d6-dbd9-428f-b695-96b794124512 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:15.538839 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7d0eb6d6-dbd9-428f-b695-96b794124512 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:15.539415 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7d0eb6d6-dbd9-428f-b695-96b794124512 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:15.539930 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7d0eb6d6-dbd9-428f-b695-96b794124512 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:15.542930 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_cell0:SELECT=2 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:33:15.725877 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-b1e5d3ce-58f6-4f6b-ad43-daf49f3530b9 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b02c2ba9a0a48c294a11b42cbfe28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef13103d3d8b43e1882d4820c8d9247b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:33:15.734378 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_cell0:SELECT=12 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:33:15.734707 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-b1e5d3ce-58f6-4f6b-ad43-daf49f3530b9 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/ce5f26c2-638d-4baf-9ccb-ba578b97cfc1" status: 200 len: 1368 microversion: 2.1 time: 0.453715 Sep 27 17:33:15.735371 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 442/909] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:33:15 2022] GET /compute/v2.1/servers/ce5f26c2-638d-4baf-9ccb-ba578b97cfc1 => generated 1368 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:33:15.776342 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-7d0eb6d6-dbd9-428f-b695-96b794124512 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5bf070765946168f7e5937f2b076c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890469995c02465eb9b9ad2d1fb9ab6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:33:15.784796 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-7d0eb6d6-dbd9-428f-b695-96b794124512 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] 10.222.0.55 "GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9" status: 200 len: 1561 microversion: 2.1 time: 0.259873 Sep 27 17:33:15.785406 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 468/910] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:33:15 2022] GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9 => generated 1561 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:33:16.674448 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [req-9fe1a7a9-89be-4529-a81e-7a7090989661 req-c1e11dde-c783-4969-8259-1835b50052e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce5f26c2-638d-4baf-9ccb-ba578b97cfc1", "name": "network-vif-plugged", "status": "completed", "tag": "ef3355f1-2589-4b0a-bdb1-68cba54179a8"}]} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:33:16.685132 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-9fe1a7a9-89be-4529-a81e-7a7090989661 req-c1e11dde-c783-4969-8259-1835b50052e4 service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:16.685618 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-9fe1a7a9-89be-4529-a81e-7a7090989661 req-c1e11dde-c783-4969-8259-1835b50052e4 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:16.686049 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-9fe1a7a9-89be-4529-a81e-7a7090989661 req-c1e11dde-c783-4969-8259-1835b50052e4 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:16.697153 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.compute.server_external_events [req-9fe1a7a9-89be-4529-a81e-7a7090989661 req-c1e11dde-c783-4969-8259-1835b50052e4 service nova] Creating event network-vif-plugged:ef3355f1-2589-4b0a-bdb1-68cba54179a8 for instance ce5f26c2-638d-4baf-9ccb-ba578b97cfc1 on hv-cinder-84914 Sep 27 17:33:16.702476 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [req-9fe1a7a9-89be-4529-a81e-7a7090989661 req-c1e11dde-c783-4969-8259-1835b50052e4 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031682 Sep 27 17:33:16.703076 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 443/911] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:33:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:33:16.759425 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-d8cc3935-c095-4bac-8949-4eae792de7e6 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:33:16.760065 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-d8cc3935-c095-4bac-8949-4eae792de7e6 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: ce5f26c2-638d-4baf-9ccb-ba578b97cfc1] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:33:16.766045 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d8cc3935-c095-4bac-8949-4eae792de7e6 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:16.766562 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d8cc3935-c095-4bac-8949-4eae792de7e6 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:16.767024 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d8cc3935-c095-4bac-8949-4eae792de7e6 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:16.767710 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d8cc3935-c095-4bac-8949-4eae792de7e6 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:16.768740 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d8cc3935-c095-4bac-8949-4eae792de7e6 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:16.769172 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d8cc3935-c095-4bac-8949-4eae792de7e6 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:16.935994 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-d8cc3935-c095-4bac-8949-4eae792de7e6 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b02c2ba9a0a48c294a11b42cbfe28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef13103d3d8b43e1882d4820c8d9247b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:33:16.943699 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-d8cc3935-c095-4bac-8949-4eae792de7e6 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/ce5f26c2-638d-4baf-9ccb-ba578b97cfc1" status: 200 len: 1368 microversion: 2.1 time: 0.188765 Sep 27 17:33:16.944280 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 469/912] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:33:16 2022] GET /compute/v2.1/servers/ce5f26c2-638d-4baf-9ccb-ba578b97cfc1 => generated 1368 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:33:17.967921 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-25ccd2f8-11d7-4bab-9c50-84fc48a110d1 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:33:17.968617 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-25ccd2f8-11d7-4bab-9c50-84fc48a110d1 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: ce5f26c2-638d-4baf-9ccb-ba578b97cfc1] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:33:17.974648 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-25ccd2f8-11d7-4bab-9c50-84fc48a110d1 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:17.975119 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-25ccd2f8-11d7-4bab-9c50-84fc48a110d1 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:17.975548 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-25ccd2f8-11d7-4bab-9c50-84fc48a110d1 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:17.976225 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-25ccd2f8-11d7-4bab-9c50-84fc48a110d1 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:17.976670 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-25ccd2f8-11d7-4bab-9c50-84fc48a110d1 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:17.977089 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-25ccd2f8-11d7-4bab-9c50-84fc48a110d1 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:18.106060 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-25ccd2f8-11d7-4bab-9c50-84fc48a110d1 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b02c2ba9a0a48c294a11b42cbfe28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef13103d3d8b43e1882d4820c8d9247b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:33:18.114363 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-25ccd2f8-11d7-4bab-9c50-84fc48a110d1 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/ce5f26c2-638d-4baf-9ccb-ba578b97cfc1" status: 200 len: 1368 microversion: 2.1 time: 0.151094 Sep 27 17:33:18.114863 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 444/913] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:33:17 2022] GET /compute/v2.1/servers/ce5f26c2-638d-4baf-9ccb-ba578b97cfc1 => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:33:19.137870 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-fda26c8e-3fb1-474a-9ddb-5cc016cfaa99 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:33:19.139488 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-fda26c8e-3fb1-474a-9ddb-5cc016cfaa99 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: ce5f26c2-638d-4baf-9ccb-ba578b97cfc1] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:33:19.146229 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-fda26c8e-3fb1-474a-9ddb-5cc016cfaa99 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:19.146652 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-fda26c8e-3fb1-474a-9ddb-5cc016cfaa99 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:19.147082 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-fda26c8e-3fb1-474a-9ddb-5cc016cfaa99 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:19.147766 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-fda26c8e-3fb1-474a-9ddb-5cc016cfaa99 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:19.148212 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-fda26c8e-3fb1-474a-9ddb-5cc016cfaa99 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:19.148629 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-fda26c8e-3fb1-474a-9ddb-5cc016cfaa99 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:19.274458 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-fda26c8e-3fb1-474a-9ddb-5cc016cfaa99 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b02c2ba9a0a48c294a11b42cbfe28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef13103d3d8b43e1882d4820c8d9247b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:33:19.281983 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-fda26c8e-3fb1-474a-9ddb-5cc016cfaa99 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/ce5f26c2-638d-4baf-9ccb-ba578b97cfc1" status: 200 len: 1558 microversion: 2.1 time: 0.147932 Sep 27 17:33:19.282576 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 470/914] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:33:19 2022] GET /compute/v2.1/servers/ce5f26c2-638d-4baf-9ccb-ba578b97cfc1 => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:33:19.304423 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-f7dafa55-c934-41b0-9c94-a41dd9ca25fb tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:33:19.304936 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-f7dafa55-c934-41b0-9c94-a41dd9ca25fb tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: ce5f26c2-638d-4baf-9ccb-ba578b97cfc1] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:33:19.311829 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f7dafa55-c934-41b0-9c94-a41dd9ca25fb tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:19.312343 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f7dafa55-c934-41b0-9c94-a41dd9ca25fb tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:19.312822 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f7dafa55-c934-41b0-9c94-a41dd9ca25fb tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:19.313521 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f7dafa55-c934-41b0-9c94-a41dd9ca25fb tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:19.313979 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f7dafa55-c934-41b0-9c94-a41dd9ca25fb tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:19.314443 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f7dafa55-c934-41b0-9c94-a41dd9ca25fb tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:19.391740 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-f7dafa55-c934-41b0-9c94-a41dd9ca25fb tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/ce5f26c2-638d-4baf-9ccb-ba578b97cfc1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091145 Sep 27 17:33:19.392339 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 445/915] 10.222.0.55 () {58 vars in 1275 bytes} [Tue Sep 27 17:33:19 2022] GET /compute/v2.1/servers/ce5f26c2-638d-4baf-9ccb-ba578b97cfc1/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:33:20.535336 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [req-1ee81c9f-c5c7-4fce-ac4f-8289ed001461 req-88710853-4220-46d6-a988-f916f4654101 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce5f26c2-638d-4baf-9ccb-ba578b97cfc1", "tag": "ef3355f1-2589-4b0a-bdb1-68cba54179a8"}]} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:33:20.545266 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-1ee81c9f-c5c7-4fce-ac4f-8289ed001461 req-88710853-4220-46d6-a988-f916f4654101 service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:20.545842 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-1ee81c9f-c5c7-4fce-ac4f-8289ed001461 req-88710853-4220-46d6-a988-f916f4654101 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:20.546395 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-1ee81c9f-c5c7-4fce-ac4f-8289ed001461 req-88710853-4220-46d6-a988-f916f4654101 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:20.558374 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.compute.server_external_events [req-1ee81c9f-c5c7-4fce-ac4f-8289ed001461 req-88710853-4220-46d6-a988-f916f4654101 service nova] Creating event network-changed:ef3355f1-2589-4b0a-bdb1-68cba54179a8 for instance ce5f26c2-638d-4baf-9ccb-ba578b97cfc1 on hv-cinder-84914 Sep 27 17:33:20.564076 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [req-1ee81c9f-c5c7-4fce-ac4f-8289ed001461 req-88710853-4220-46d6-a988-f916f4654101 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032615 Sep 27 17:33:20.564953 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 471/916] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:33:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:33:47.531812 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_api:SELECT=21 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:33:47.532681 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell1:SELECT=30 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:33:47.536504 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-54c882fd-980e-4d89-bb5a-0b0168ca7975 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:33:47.537031 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-54c882fd-980e-4d89-bb5a-0b0168ca7975 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] [instance: 40e2eab1-2d75-4ad4-9e7b-da70094ed345] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:33:47.543653 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-54c882fd-980e-4d89-bb5a-0b0168ca7975 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:47.544132 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-54c882fd-980e-4d89-bb5a-0b0168ca7975 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:47.544565 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-54c882fd-980e-4d89-bb5a-0b0168ca7975 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:47.545911 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-54c882fd-980e-4d89-bb5a-0b0168ca7975 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:47.546395 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-54c882fd-980e-4d89-bb5a-0b0168ca7975 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:47.546816 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-54c882fd-980e-4d89-bb5a-0b0168ca7975 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:47.571555 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-54c882fd-980e-4d89-bb5a-0b0168ca7975 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] [instance: 40e2eab1-2d75-4ad4-9e7b-da70094ed345] Going to try to terminate instance {{(pid=120415) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 17:33:47.656910 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-54c882fd-980e-4d89-bb5a-0b0168ca7975 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] 10.222.0.55 "DELETE /compute/v2.1/servers/40e2eab1-2d75-4ad4-9e7b-da70094ed345" status: 204 len: 0 microversion: 2.1 time: 0.126448 Sep 27 17:33:47.657502 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 446/917] 10.222.0.55 () {58 vars in 1239 bytes} [Tue Sep 27 17:33:47 2022] DELETE /compute/v2.1/servers/40e2eab1-2d75-4ad4-9e7b-da70094ed345 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 17:33:47.664771 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:33:47.666390 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_cell1:SELECT=38 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:33:47.673133 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-2cf86a42-1a93-4964-9963-2997428e7677 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:33:47.674200 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-2cf86a42-1a93-4964-9963-2997428e7677 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] [instance: 40e2eab1-2d75-4ad4-9e7b-da70094ed345] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:33:47.683004 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-2cf86a42-1a93-4964-9963-2997428e7677 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:47.683804 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-2cf86a42-1a93-4964-9963-2997428e7677 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:47.684553 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-2cf86a42-1a93-4964-9963-2997428e7677 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:47.685582 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-2cf86a42-1a93-4964-9963-2997428e7677 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:47.686051 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-2cf86a42-1a93-4964-9963-2997428e7677 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:47.686520 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-2cf86a42-1a93-4964-9963-2997428e7677 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:47.820702 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-2cf86a42-1a93-4964-9963-2997428e7677 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac1528c35fb464db00b5d18396b8eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4db1a85e2504cb9956a6461b5072aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:33:47.828868 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-2cf86a42-1a93-4964-9963-2997428e7677 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] 10.222.0.55 "GET /compute/v2.1/servers/40e2eab1-2d75-4ad4-9e7b-da70094ed345" status: 200 len: 1577 microversion: 2.1 time: 0.166194 Sep 27 17:33:47.829369 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 472/918] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:33:47 2022] GET /compute/v2.1/servers/40e2eab1-2d75-4ad4-9e7b-da70094ed345 => generated 1577 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:33:48.853658 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-73df78bd-9275-4bb9-bcb7-7412102fffb0 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:33:48.854408 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-73df78bd-9275-4bb9-bcb7-7412102fffb0 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] [instance: 40e2eab1-2d75-4ad4-9e7b-da70094ed345] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:33:48.861628 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-73df78bd-9275-4bb9-bcb7-7412102fffb0 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:48.862146 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-73df78bd-9275-4bb9-bcb7-7412102fffb0 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:48.862660 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-73df78bd-9275-4bb9-bcb7-7412102fffb0 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:48.863362 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-73df78bd-9275-4bb9-bcb7-7412102fffb0 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:48.863811 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-73df78bd-9275-4bb9-bcb7-7412102fffb0 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:48.864230 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-73df78bd-9275-4bb9-bcb7-7412102fffb0 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:49.006620 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-73df78bd-9275-4bb9-bcb7-7412102fffb0 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac1528c35fb464db00b5d18396b8eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4db1a85e2504cb9956a6461b5072aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:33:49.014686 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-73df78bd-9275-4bb9-bcb7-7412102fffb0 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] 10.222.0.55 "GET /compute/v2.1/servers/40e2eab1-2d75-4ad4-9e7b-da70094ed345" status: 200 len: 1577 microversion: 2.1 time: 0.165585 Sep 27 17:33:49.015272 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 447/919] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:33:48 2022] GET /compute/v2.1/servers/40e2eab1-2d75-4ad4-9e7b-da70094ed345 => generated 1577 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:33:50.039735 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-2010d2be-96ac-4315-b93f-78a17f872561 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:33:50.040445 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-2010d2be-96ac-4315-b93f-78a17f872561 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] [instance: 40e2eab1-2d75-4ad4-9e7b-da70094ed345] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:33:50.046947 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-2010d2be-96ac-4315-b93f-78a17f872561 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:50.047504 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-2010d2be-96ac-4315-b93f-78a17f872561 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:50.048447 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-2010d2be-96ac-4315-b93f-78a17f872561 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:50.049556 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-2010d2be-96ac-4315-b93f-78a17f872561 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:50.050331 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-2010d2be-96ac-4315-b93f-78a17f872561 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:50.050938 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-2010d2be-96ac-4315-b93f-78a17f872561 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:50.192828 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-2010d2be-96ac-4315-b93f-78a17f872561 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac1528c35fb464db00b5d18396b8eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4db1a85e2504cb9956a6461b5072aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:33:50.202364 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-2010d2be-96ac-4315-b93f-78a17f872561 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] 10.222.0.55 "GET /compute/v2.1/servers/40e2eab1-2d75-4ad4-9e7b-da70094ed345" status: 200 len: 1577 microversion: 2.1 time: 0.167553 Sep 27 17:33:50.203118 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 473/920] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:33:50 2022] GET /compute/v2.1/servers/40e2eab1-2d75-4ad4-9e7b-da70094ed345 => generated 1577 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:33:50.706233 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [req-f56988bf-efdf-494f-9e34-af954c00f97e req-ee0b6ba5-3089-40f6-80da-b46d28e4b18a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40e2eab1-2d75-4ad4-9e7b-da70094ed345", "name": "network-vif-deleted", "tag": "945bab49-e787-4511-9e29-ddfbda056c05"}]} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:33:50.718212 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-f56988bf-efdf-494f-9e34-af954c00f97e req-ee0b6ba5-3089-40f6-80da-b46d28e4b18a service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:50.719017 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-f56988bf-efdf-494f-9e34-af954c00f97e req-ee0b6ba5-3089-40f6-80da-b46d28e4b18a service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:50.719533 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-f56988bf-efdf-494f-9e34-af954c00f97e req-ee0b6ba5-3089-40f6-80da-b46d28e4b18a service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:50.750185 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.compute.server_external_events [req-f56988bf-efdf-494f-9e34-af954c00f97e req-ee0b6ba5-3089-40f6-80da-b46d28e4b18a service nova] Creating event network-vif-deleted:945bab49-e787-4511-9e29-ddfbda056c05 for instance 40e2eab1-2d75-4ad4-9e7b-da70094ed345 on hv-cinder-84914 Sep 27 17:33:50.763859 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [req-f56988bf-efdf-494f-9e34-af954c00f97e req-ee0b6ba5-3089-40f6-80da-b46d28e4b18a service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061149 Sep 27 17:33:50.765023 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 448/921] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:33:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:33:51.242566 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-bbc0f159-11bb-45ea-9537-524ae2169f32 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:33:51.243240 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-bbc0f159-11bb-45ea-9537-524ae2169f32 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] [instance: 40e2eab1-2d75-4ad4-9e7b-da70094ed345] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:33:51.254611 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-bbc0f159-11bb-45ea-9537-524ae2169f32 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:51.256032 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-bbc0f159-11bb-45ea-9537-524ae2169f32 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:51.256473 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-bbc0f159-11bb-45ea-9537-524ae2169f32 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:51.257620 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-bbc0f159-11bb-45ea-9537-524ae2169f32 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:51.258094 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-bbc0f159-11bb-45ea-9537-524ae2169f32 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:51.258556 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-bbc0f159-11bb-45ea-9537-524ae2169f32 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:51.290019 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-bbc0f159-11bb-45ea-9537-524ae2169f32 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:51.290553 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-bbc0f159-11bb-45ea-9537-524ae2169f32 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:51.290995 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-bbc0f159-11bb-45ea-9537-524ae2169f32 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:51.291443 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.objects.instance [None req-bbc0f159-11bb-45ea-9537-524ae2169f32 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lazy-loading 'fault' on Instance uuid 40e2eab1-2d75-4ad4-9e7b-da70094ed345 {{(pid=120416) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 17:33:51.333281 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-bbc0f159-11bb-45ea-9537-524ae2169f32 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac1528c35fb464db00b5d18396b8eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4db1a85e2504cb9956a6461b5072aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:33:51.342314 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-bbc0f159-11bb-45ea-9537-524ae2169f32 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] 10.222.0.55 "GET /compute/v2.1/servers/40e2eab1-2d75-4ad4-9e7b-da70094ed345" status: 200 len: 1231 microversion: 2.1 time: 0.119776 Sep 27 17:33:51.354683 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 474/922] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:33:51 2022] GET /compute/v2.1/servers/40e2eab1-2d75-4ad4-9e7b-da70094ed345 => generated 1231 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:33:52.365762 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-0eb6bd9d-ced5-4474-bf6f-2a8508475449 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:33:52.366481 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-0eb6bd9d-ced5-4474-bf6f-2a8508475449 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] [instance: 40e2eab1-2d75-4ad4-9e7b-da70094ed345] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:33:52.372595 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0eb6bd9d-ced5-4474-bf6f-2a8508475449 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:52.373577 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0eb6bd9d-ced5-4474-bf6f-2a8508475449 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:52.374008 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0eb6bd9d-ced5-4474-bf6f-2a8508475449 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:52.374710 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0eb6bd9d-ced5-4474-bf6f-2a8508475449 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:52.375155 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0eb6bd9d-ced5-4474-bf6f-2a8508475449 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:52.375571 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0eb6bd9d-ced5-4474-bf6f-2a8508475449 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:52.388453 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.wsgi [None req-0eb6bd9d-ced5-4474-bf6f-2a8508475449 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] HTTP exception thrown: Instance 40e2eab1-2d75-4ad4-9e7b-da70094ed345 could not be found. Sep 27 17:33:52.390065 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-0eb6bd9d-ced5-4474-bf6f-2a8508475449 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Request method failure captured: Sep 27 17:33:52.390065 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: request: GET /compute/v2.1/servers/40e2eab1-2d75-4ad4-9e7b-da70094ed345 HTTP/1.1 Sep 27 17:33:52.390065 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Accept: application/json Sep 27 17:33:52.390065 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Accept-Encoding: identity Sep 27 17:33:52.390065 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Connection: close Sep 27 17:33:52.390065 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Content-Length: 0 Sep 27 17:33:52.390065 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Content-Type: application/json Sep 27 17:33:52.390065 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Host: 10.222.0.55 Sep 27 17:33:52.390065 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Openstack-System-Scope: None Sep 27 17:33:52.390065 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: User-Agent: python-urllib3/1.26.12 Sep 27 17:33:52.390065 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Auth-Token: gAAAAABjMzMb3IJGuOnHL18ffMswjtbpCDabbePv468u2D3CBo2yd4aaE0nsIUEeif3P_ToERDJltgboimC5v9cGICb3GIeISi07JexrWXVTTpMOff8V0tgqT43LbsTQL3UrYAIWBQ3IKRgy8NaHp16upuRTj9reXc_gbYZG2KzKP8xnbiIKHtk Sep 27 17:33:52.390065 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Domain-Id: None Sep 27 17:33:52.390065 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Domain-Name: None Sep 27 17:33:52.390065 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Identity-Status: Confirmed Sep 27 17:33:52.390065 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Is-Admin-Project: True Sep 27 17:33:52.390065 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Domain-Id: default Sep 27 17:33:52.390065 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Domain-Name: Default Sep 27 17:33:52.390065 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Id: f4db1a85e2504cb9956a6461b5072aa3 Sep 27 17:33:52.390065 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Name: tempest-TestVolumeBootPattern-2014823828 Sep 27 17:33:52.390065 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Role: reader,member Sep 27 17:33:52.390065 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Roles: reader,member Sep 27 17:33:52.391789 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f4db1a85e2504cb9956a6461b5072aa3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_f4db1a85e2504cb9956a6461b5072aa3", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f4db1a85e2504cb9956a6461b5072aa3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/f4db1a85e2504cb9956a6461b5072aa3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 27 17:33:52.391789 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Tenant: tempest-TestVolumeBootPattern-2014823828 Sep 27 17:33:52.391789 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Tenant-Id: f4db1a85e2504cb9956a6461b5072aa3 Sep 27 17:33:52.391789 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Tenant-Name: tempest-TestVolumeBootPattern-2014823828 Sep 27 17:33:52.391789 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User: tempest-TestVolumeBootPattern-2014823828-project Sep 27 17:33:52.391789 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Domain-Id: default Sep 27 17:33:52.391789 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Domain-Name: Default Sep 27 17:33:52.391789 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Id: cac1528c35fb464db00b5d18396b8eac Sep 27 17:33:52.391789 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Name: tempest-TestVolumeBootPattern-2014823828-project Sep 27 17:33:52.391789 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: method: > Sep 27 17:33:52.391789 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: exception: Instance 40e2eab1-2d75-4ad4-9e7b-da70094ed345 could not be found. Sep 27 17:33:52.391789 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: action_args: {'id': '40e2eab1-2d75-4ad4-9e7b-da70094ed345'} Sep 27 17:33:52.392905 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 17:33:52.392905 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:33:52.392905 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 17:33:52.392905 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 17:33:52.392905 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 17:33:52.392905 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 17:33:52.392905 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 17:33:52.392905 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 17:33:52.392905 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 17:33:52.392905 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 17:33:52.392905 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40e2eab1-2d75-4ad4-9e7b-da70094ed345 could not be found. Sep 27 17:33:52.392905 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:33:52.392905 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:33:52.392905 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:33:52.392905 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:33:52.392905 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:33:52.392905 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:33:52.392905 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 17:33:52.392905 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 17:33:52.392905 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 17:33:52.394574 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 17:33:52.394574 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 17:33:52.394574 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 17:33:52.394574 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 17:33:52.394574 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 17:33:52.394574 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 17:33:52.394574 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 17:33:52.394574 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40e2eab1-2d75-4ad4-9e7b-da70094ed345 could not be found. Sep 27 17:33:52.394574 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:33:52.394574 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:33:52.394574 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:33:52.394574 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:33:52.394574 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:33:52.394574 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:33:52.394574 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 17:33:52.394574 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 17:33:52.394574 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40e2eab1-2d75-4ad4-9e7b-da70094ed345 could not be found. Sep 27 17:33:52.394574 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:33:52.396038 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-0eb6bd9d-ced5-4474-bf6f-2a8508475449 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Returning 404 to user: Instance 40e2eab1-2d75-4ad4-9e7b-da70094ed345 could not be found. {{(pid=120415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 17:33:52.396038 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-0eb6bd9d-ced5-4474-bf6f-2a8508475449 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] 10.222.0.55 "GET /compute/v2.1/servers/40e2eab1-2d75-4ad4-9e7b-da70094ed345" status: 404 len: 111 microversion: 2.1 time: 0.030438 Sep 27 17:33:52.396038 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 449/923] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:33:52 2022] GET /compute/v2.1/servers/40e2eab1-2d75-4ad4-9e7b-da70094ed345 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 17:33:52.486570 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-08ffcf08-9a4f-415b-a4d5-e6f3afde7b1f tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-624655242", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2033463902", "security_groups": [{"name": "tempest-secgroup-smoke-981048707"}], "block_device_mapping_v2": [{"uuid": "1393a372-ee60-4254-8d8a-e6ccbba596dd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e7d51347-695f-4b89-ba87-954fe70eed97"}]}} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:33:52.600559 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.network.neutron [None req-08ffcf08-9a4f-415b-a4d5-e6f3afde7b1f tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] validate_networks() for [('e7d51347-695f-4b89-ba87-954fe70eed97', None, None, None, None, None)] {{(pid=120416) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 17:33:52.968865 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.virt.hardware [None req-08ffcf08-9a4f-415b-a4d5-e6f3afde7b1f tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Flavor limits 0:0:0 {{(pid=120416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 17:33:52.969316 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.virt.hardware [None req-08ffcf08-9a4f-415b-a4d5-e6f3afde7b1f tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Image limits 0:0:0 {{(pid=120416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 17:33:52.969789 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.virt.hardware [None req-08ffcf08-9a4f-415b-a4d5-e6f3afde7b1f tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Flavor pref 0:0:0 {{(pid=120416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 17:33:52.970238 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.virt.hardware [None req-08ffcf08-9a4f-415b-a4d5-e6f3afde7b1f tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Image pref 0:0:0 {{(pid=120416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 17:33:52.970651 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.virt.hardware [None req-08ffcf08-9a4f-415b-a4d5-e6f3afde7b1f tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 17:33:52.979346 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-08ffcf08-9a4f-415b-a4d5-e6f3afde7b1f tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:52.979822 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-08ffcf08-9a4f-415b-a4d5-e6f3afde7b1f tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:52.980256 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-08ffcf08-9a4f-415b-a4d5-e6f3afde7b1f tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:52.980977 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-08ffcf08-9a4f-415b-a4d5-e6f3afde7b1f tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:52.981684 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-08ffcf08-9a4f-415b-a4d5-e6f3afde7b1f tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:52.982744 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-08ffcf08-9a4f-415b-a4d5-e6f3afde7b1f tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:52.999137 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.quota [None req-08ffcf08-9a4f-415b-a4d5-e6f3afde7b1f tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Getting quotas for project f4db1a85e2504cb9956a6461b5072aa3. Resources: {'cores', 'ram', 'instances'} {{(pid=120416) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 17:33:53.003191 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.quota [None req-08ffcf08-9a4f-415b-a4d5-e6f3afde7b1f tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Getting quotas for user cac1528c35fb464db00b5d18396b8eac and project f4db1a85e2504cb9956a6461b5072aa3. Resources: {'cores', 'ram', 'instances'} {{(pid=120416) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 17:33:53.058389 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-08ffcf08-9a4f-415b-a4d5-e6f3afde7b1f tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Going to run 1 instances... {{(pid=120416) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 17:33:53.061402 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-08ffcf08-9a4f-415b-a4d5-e6f3afde7b1f tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] [instance: aa18e03f-5e59-482d-a5ad-e14cf3bc3f35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1393a372-ee60-4254-8d8a-e6ccbba596dd',volume_size=None,volume_type=None)] {{(pid=120416) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 17:33:53.193310 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-08ffcf08-9a4f-415b-a4d5-e6f3afde7b1f tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.711106 Sep 27 17:33:53.194461 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 475/924] 10.222.0.55 () {60 vars in 1147 bytes} [Tue Sep 27 17:33:52 2022] POST /compute/v2.1/servers => generated 405 bytes in 713 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 17:33:53.207289 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-6305bec1-d711-4585-acc4-44211bcddd12 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:33:53.207933 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-6305bec1-d711-4585-acc4-44211bcddd12 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] [instance: aa18e03f-5e59-482d-a5ad-e14cf3bc3f35] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:33:53.268030 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-6305bec1-d711-4585-acc4-44211bcddd12 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac1528c35fb464db00b5d18396b8eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4db1a85e2504cb9956a6461b5072aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:33:53.274947 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-6305bec1-d711-4585-acc4-44211bcddd12 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] 10.222.0.55 "GET /compute/v2.1/servers/aa18e03f-5e59-482d-a5ad-e14cf3bc3f35" status: 200 len: 1094 microversion: 2.1 time: 0.073377 Sep 27 17:33:53.275733 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 450/925] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:33:53 2022] GET /compute/v2.1/servers/aa18e03f-5e59-482d-a5ad-e14cf3bc3f35 => generated 1094 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:33:54.297692 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-d963928c-e608-4d86-8c11-f659a2f4155f tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:33:54.298267 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-d963928c-e608-4d86-8c11-f659a2f4155f tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] [instance: aa18e03f-5e59-482d-a5ad-e14cf3bc3f35] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:33:54.305779 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d963928c-e608-4d86-8c11-f659a2f4155f tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:54.305993 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d963928c-e608-4d86-8c11-f659a2f4155f tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:54.306334 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d963928c-e608-4d86-8c11-f659a2f4155f tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:54.307038 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d963928c-e608-4d86-8c11-f659a2f4155f tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:54.307493 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d963928c-e608-4d86-8c11-f659a2f4155f tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:54.307916 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d963928c-e608-4d86-8c11-f659a2f4155f tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:54.373291 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-d963928c-e608-4d86-8c11-f659a2f4155f tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac1528c35fb464db00b5d18396b8eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4db1a85e2504cb9956a6461b5072aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:33:54.382755 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-d963928c-e608-4d86-8c11-f659a2f4155f tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] 10.222.0.55 "GET /compute/v2.1/servers/aa18e03f-5e59-482d-a5ad-e14cf3bc3f35" status: 200 len: 1192 microversion: 2.1 time: 0.088913 Sep 27 17:33:54.383458 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 476/926] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:33:54 2022] GET /compute/v2.1/servers/aa18e03f-5e59-482d-a5ad-e14cf3bc3f35 => generated 1192 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:33:55.408656 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-a3ed914f-23bf-47e7-a148-ab59f0aa158c tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:33:55.410208 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-a3ed914f-23bf-47e7-a148-ab59f0aa158c tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] [instance: aa18e03f-5e59-482d-a5ad-e14cf3bc3f35] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:33:55.419872 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a3ed914f-23bf-47e7-a148-ab59f0aa158c tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:55.420679 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a3ed914f-23bf-47e7-a148-ab59f0aa158c tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:55.421308 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a3ed914f-23bf-47e7-a148-ab59f0aa158c tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:55.422217 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a3ed914f-23bf-47e7-a148-ab59f0aa158c tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:55.422682 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a3ed914f-23bf-47e7-a148-ab59f0aa158c tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:55.423110 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a3ed914f-23bf-47e7-a148-ab59f0aa158c tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:55.596687 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-a3ed914f-23bf-47e7-a148-ab59f0aa158c tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac1528c35fb464db00b5d18396b8eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4db1a85e2504cb9956a6461b5072aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:33:55.604664 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-a3ed914f-23bf-47e7-a148-ab59f0aa158c tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] 10.222.0.55 "GET /compute/v2.1/servers/aa18e03f-5e59-482d-a5ad-e14cf3bc3f35" status: 200 len: 1265 microversion: 2.1 time: 0.202242 Sep 27 17:33:55.605236 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 451/927] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:33:55 2022] GET /compute/v2.1/servers/aa18e03f-5e59-482d-a5ad-e14cf3bc3f35 => generated 1265 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:33:56.080813 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [req-13b7fb00-5ba6-4192-93df-9008d2d7cfd6 req-7bbb0024-fed9-4f73-9859-346ea5d23d88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa18e03f-5e59-482d-a5ad-e14cf3bc3f35", "tag": "5fc9c471-e36c-4eea-8fb2-162d705567b5"}]} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:33:56.092700 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-13b7fb00-5ba6-4192-93df-9008d2d7cfd6 req-7bbb0024-fed9-4f73-9859-346ea5d23d88 service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:56.093316 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-13b7fb00-5ba6-4192-93df-9008d2d7cfd6 req-7bbb0024-fed9-4f73-9859-346ea5d23d88 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:56.093849 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-13b7fb00-5ba6-4192-93df-9008d2d7cfd6 req-7bbb0024-fed9-4f73-9859-346ea5d23d88 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:56.104882 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.compute.server_external_events [req-13b7fb00-5ba6-4192-93df-9008d2d7cfd6 req-7bbb0024-fed9-4f73-9859-346ea5d23d88 service nova] Creating event network-changed:5fc9c471-e36c-4eea-8fb2-162d705567b5 for instance aa18e03f-5e59-482d-a5ad-e14cf3bc3f35 on hv-cinder-84914 Sep 27 17:33:56.110623 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [req-13b7fb00-5ba6-4192-93df-9008d2d7cfd6 req-7bbb0024-fed9-4f73-9859-346ea5d23d88 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033745 Sep 27 17:33:56.111216 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 477/928] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:33:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 17:33:56.628171 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-c9af390d-0013-4385-a3f1-861de0603d79 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:33:56.628787 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-c9af390d-0013-4385-a3f1-861de0603d79 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] [instance: aa18e03f-5e59-482d-a5ad-e14cf3bc3f35] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:33:56.635290 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c9af390d-0013-4385-a3f1-861de0603d79 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:56.635771 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c9af390d-0013-4385-a3f1-861de0603d79 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:56.636211 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c9af390d-0013-4385-a3f1-861de0603d79 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:56.636906 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c9af390d-0013-4385-a3f1-861de0603d79 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:56.637360 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c9af390d-0013-4385-a3f1-861de0603d79 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:56.637785 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c9af390d-0013-4385-a3f1-861de0603d79 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:56.771592 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-c9af390d-0013-4385-a3f1-861de0603d79 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac1528c35fb464db00b5d18396b8eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4db1a85e2504cb9956a6461b5072aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:33:56.779818 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-c9af390d-0013-4385-a3f1-861de0603d79 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] 10.222.0.55 "GET /compute/v2.1/servers/aa18e03f-5e59-482d-a5ad-e14cf3bc3f35" status: 200 len: 1265 microversion: 2.1 time: 0.155559 Sep 27 17:33:56.780387 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 452/929] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:33:56 2022] GET /compute/v2.1/servers/aa18e03f-5e59-482d-a5ad-e14cf3bc3f35 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:33:57.804532 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-3a6eebfe-6e24-4f2e-bcef-95695c99f732 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:33:57.805146 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-3a6eebfe-6e24-4f2e-bcef-95695c99f732 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] [instance: aa18e03f-5e59-482d-a5ad-e14cf3bc3f35] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:33:57.811677 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3a6eebfe-6e24-4f2e-bcef-95695c99f732 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:57.812155 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3a6eebfe-6e24-4f2e-bcef-95695c99f732 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:57.812751 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3a6eebfe-6e24-4f2e-bcef-95695c99f732 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:57.813435 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3a6eebfe-6e24-4f2e-bcef-95695c99f732 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:57.813880 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3a6eebfe-6e24-4f2e-bcef-95695c99f732 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:57.814321 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3a6eebfe-6e24-4f2e-bcef-95695c99f732 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:57.962630 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-3a6eebfe-6e24-4f2e-bcef-95695c99f732 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac1528c35fb464db00b5d18396b8eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4db1a85e2504cb9956a6461b5072aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:33:57.970381 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-3a6eebfe-6e24-4f2e-bcef-95695c99f732 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] 10.222.0.55 "GET /compute/v2.1/servers/aa18e03f-5e59-482d-a5ad-e14cf3bc3f35" status: 200 len: 1265 microversion: 2.1 time: 0.170996 Sep 27 17:33:57.970952 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 478/930] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:33:57 2022] GET /compute/v2.1/servers/aa18e03f-5e59-482d-a5ad-e14cf3bc3f35 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:33:58.992619 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-3fda2645-e2b9-4df3-a449-de9dba7331a0 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:33:58.993170 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-3fda2645-e2b9-4df3-a449-de9dba7331a0 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] [instance: aa18e03f-5e59-482d-a5ad-e14cf3bc3f35] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:33:58.999847 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3fda2645-e2b9-4df3-a449-de9dba7331a0 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:59.000330 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3fda2645-e2b9-4df3-a449-de9dba7331a0 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:59.000767 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3fda2645-e2b9-4df3-a449-de9dba7331a0 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:59.001455 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3fda2645-e2b9-4df3-a449-de9dba7331a0 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:33:59.001908 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3fda2645-e2b9-4df3-a449-de9dba7331a0 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:33:59.002361 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3fda2645-e2b9-4df3-a449-de9dba7331a0 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:33:59.134889 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-3fda2645-e2b9-4df3-a449-de9dba7331a0 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac1528c35fb464db00b5d18396b8eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4db1a85e2504cb9956a6461b5072aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:33:59.143164 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-3fda2645-e2b9-4df3-a449-de9dba7331a0 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] 10.222.0.55 "GET /compute/v2.1/servers/aa18e03f-5e59-482d-a5ad-e14cf3bc3f35" status: 200 len: 1265 microversion: 2.1 time: 0.154553 Sep 27 17:33:59.143730 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 453/931] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:33:58 2022] GET /compute/v2.1/servers/aa18e03f-5e59-482d-a5ad-e14cf3bc3f35 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:34:00.166063 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-939648c0-68a2-43d2-9bd9-8f4e7fcf70bb tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:34:00.166712 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-939648c0-68a2-43d2-9bd9-8f4e7fcf70bb tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] [instance: aa18e03f-5e59-482d-a5ad-e14cf3bc3f35] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:34:00.172653 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-939648c0-68a2-43d2-9bd9-8f4e7fcf70bb tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:00.173124 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-939648c0-68a2-43d2-9bd9-8f4e7fcf70bb tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:00.173551 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-939648c0-68a2-43d2-9bd9-8f4e7fcf70bb tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:00.174255 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-939648c0-68a2-43d2-9bd9-8f4e7fcf70bb tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:00.174700 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-939648c0-68a2-43d2-9bd9-8f4e7fcf70bb tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:00.175113 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-939648c0-68a2-43d2-9bd9-8f4e7fcf70bb tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:00.324409 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-939648c0-68a2-43d2-9bd9-8f4e7fcf70bb tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac1528c35fb464db00b5d18396b8eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4db1a85e2504cb9956a6461b5072aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:00.332695 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-939648c0-68a2-43d2-9bd9-8f4e7fcf70bb tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] 10.222.0.55 "GET /compute/v2.1/servers/aa18e03f-5e59-482d-a5ad-e14cf3bc3f35" status: 200 len: 1265 microversion: 2.1 time: 0.170497 Sep 27 17:34:00.333259 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 479/932] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:34:00 2022] GET /compute/v2.1/servers/aa18e03f-5e59-482d-a5ad-e14cf3bc3f35 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:34:01.355278 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-24723935-f549-4f0a-9e1f-192322028810 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:34:01.355899 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-24723935-f549-4f0a-9e1f-192322028810 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] [instance: aa18e03f-5e59-482d-a5ad-e14cf3bc3f35] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:34:01.362613 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-24723935-f549-4f0a-9e1f-192322028810 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:01.363097 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-24723935-f549-4f0a-9e1f-192322028810 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:01.363534 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-24723935-f549-4f0a-9e1f-192322028810 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:01.364224 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-24723935-f549-4f0a-9e1f-192322028810 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:01.364681 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-24723935-f549-4f0a-9e1f-192322028810 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:01.365106 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-24723935-f549-4f0a-9e1f-192322028810 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:01.493704 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-24723935-f549-4f0a-9e1f-192322028810 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac1528c35fb464db00b5d18396b8eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4db1a85e2504cb9956a6461b5072aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:01.501355 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-24723935-f549-4f0a-9e1f-192322028810 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] 10.222.0.55 "GET /compute/v2.1/servers/aa18e03f-5e59-482d-a5ad-e14cf3bc3f35" status: 200 len: 1265 microversion: 2.1 time: 0.150018 Sep 27 17:34:01.501921 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 454/933] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:34:01 2022] GET /compute/v2.1/servers/aa18e03f-5e59-482d-a5ad-e14cf3bc3f35 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:34:02.524021 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-4f4c47a6-d56b-4f4b-8b92-681f8774838e tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:34:02.524624 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-4f4c47a6-d56b-4f4b-8b92-681f8774838e tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] [instance: aa18e03f-5e59-482d-a5ad-e14cf3bc3f35] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:34:02.531151 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4f4c47a6-d56b-4f4b-8b92-681f8774838e tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:02.531648 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4f4c47a6-d56b-4f4b-8b92-681f8774838e tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:02.532111 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4f4c47a6-d56b-4f4b-8b92-681f8774838e tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:02.532772 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4f4c47a6-d56b-4f4b-8b92-681f8774838e tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:02.533253 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4f4c47a6-d56b-4f4b-8b92-681f8774838e tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:02.533690 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-4f4c47a6-d56b-4f4b-8b92-681f8774838e tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:02.665874 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-4f4c47a6-d56b-4f4b-8b92-681f8774838e tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac1528c35fb464db00b5d18396b8eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4db1a85e2504cb9956a6461b5072aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:02.673994 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-4f4c47a6-d56b-4f4b-8b92-681f8774838e tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] 10.222.0.55 "GET /compute/v2.1/servers/aa18e03f-5e59-482d-a5ad-e14cf3bc3f35" status: 200 len: 1265 microversion: 2.1 time: 0.153862 Sep 27 17:34:02.674612 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 480/934] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:34:02 2022] GET /compute/v2.1/servers/aa18e03f-5e59-482d-a5ad-e14cf3bc3f35 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:34:03.696741 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-2d60e059-c65f-4798-b60f-ff88ce1becce tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:34:03.697358 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-2d60e059-c65f-4798-b60f-ff88ce1becce tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] [instance: aa18e03f-5e59-482d-a5ad-e14cf3bc3f35] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:34:03.699810 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell0:SELECT=2 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:34:03.705285 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2d60e059-c65f-4798-b60f-ff88ce1becce tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:03.705762 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2d60e059-c65f-4798-b60f-ff88ce1becce tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:03.706228 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2d60e059-c65f-4798-b60f-ff88ce1becce tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:03.706915 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2d60e059-c65f-4798-b60f-ff88ce1becce tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:03.707366 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2d60e059-c65f-4798-b60f-ff88ce1becce tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:03.707786 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2d60e059-c65f-4798-b60f-ff88ce1becce tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:03.833441 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-2d60e059-c65f-4798-b60f-ff88ce1becce tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac1528c35fb464db00b5d18396b8eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4db1a85e2504cb9956a6461b5072aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:03.841076 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-2d60e059-c65f-4798-b60f-ff88ce1becce tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] 10.222.0.55 "GET /compute/v2.1/servers/aa18e03f-5e59-482d-a5ad-e14cf3bc3f35" status: 200 len: 1265 microversion: 2.1 time: 0.148252 Sep 27 17:34:03.841670 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 455/935] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:34:03 2022] GET /compute/v2.1/servers/aa18e03f-5e59-482d-a5ad-e14cf3bc3f35 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:34:04.863698 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-1f74d135-c861-4442-b175-b41becf6ca6d tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:34:04.864315 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-1f74d135-c861-4442-b175-b41becf6ca6d tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] [instance: aa18e03f-5e59-482d-a5ad-e14cf3bc3f35] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:34:04.866302 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_cell0:SELECT=2 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:34:04.866964 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_cell0:SELECT=6 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:34:04.873634 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1f74d135-c861-4442-b175-b41becf6ca6d tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:04.874211 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1f74d135-c861-4442-b175-b41becf6ca6d tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:04.875288 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1f74d135-c861-4442-b175-b41becf6ca6d tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:04.875989 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1f74d135-c861-4442-b175-b41becf6ca6d tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:04.876445 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1f74d135-c861-4442-b175-b41becf6ca6d tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:04.876867 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1f74d135-c861-4442-b175-b41becf6ca6d tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:05.186944 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-1f74d135-c861-4442-b175-b41becf6ca6d tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac1528c35fb464db00b5d18396b8eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4db1a85e2504cb9956a6461b5072aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:05.195531 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-1f74d135-c861-4442-b175-b41becf6ca6d tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] 10.222.0.55 "GET /compute/v2.1/servers/aa18e03f-5e59-482d-a5ad-e14cf3bc3f35" status: 200 len: 1265 microversion: 2.1 time: 0.335756 Sep 27 17:34:05.196038 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 481/936] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:34:04 2022] GET /compute/v2.1/servers/aa18e03f-5e59-482d-a5ad-e14cf3bc3f35 => generated 1265 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:34:06.218282 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-e8c987f9-c263-4ff1-aa8b-d7ea588ce004 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:34:06.218863 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-e8c987f9-c263-4ff1-aa8b-d7ea588ce004 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] [instance: aa18e03f-5e59-482d-a5ad-e14cf3bc3f35] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:34:06.225265 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e8c987f9-c263-4ff1-aa8b-d7ea588ce004 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:06.225747 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e8c987f9-c263-4ff1-aa8b-d7ea588ce004 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:06.226208 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e8c987f9-c263-4ff1-aa8b-d7ea588ce004 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:06.226898 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e8c987f9-c263-4ff1-aa8b-d7ea588ce004 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:06.227346 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e8c987f9-c263-4ff1-aa8b-d7ea588ce004 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:06.227767 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e8c987f9-c263-4ff1-aa8b-d7ea588ce004 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:06.659794 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-e8c987f9-c263-4ff1-aa8b-d7ea588ce004 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac1528c35fb464db00b5d18396b8eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4db1a85e2504cb9956a6461b5072aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:06.667464 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-e8c987f9-c263-4ff1-aa8b-d7ea588ce004 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] 10.222.0.55 "GET /compute/v2.1/servers/aa18e03f-5e59-482d-a5ad-e14cf3bc3f35" status: 200 len: 1265 microversion: 2.1 time: 0.453518 Sep 27 17:34:06.668031 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 456/937] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:34:06 2022] GET /compute/v2.1/servers/aa18e03f-5e59-482d-a5ad-e14cf3bc3f35 => generated 1265 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:34:07.203249 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [req-851774d8-b119-421a-b3ae-ef150d2cdadb req-1578525c-0e7d-4261-ab35-3b87f9f4891b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa18e03f-5e59-482d-a5ad-e14cf3bc3f35", "name": "network-vif-plugged", "status": "completed", "tag": "5fc9c471-e36c-4eea-8fb2-162d705567b5"}]} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:34:07.212838 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-851774d8-b119-421a-b3ae-ef150d2cdadb req-1578525c-0e7d-4261-ab35-3b87f9f4891b service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:07.213434 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-851774d8-b119-421a-b3ae-ef150d2cdadb req-1578525c-0e7d-4261-ab35-3b87f9f4891b service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:07.213935 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-851774d8-b119-421a-b3ae-ef150d2cdadb req-1578525c-0e7d-4261-ab35-3b87f9f4891b service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:07.227168 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.compute.server_external_events [req-851774d8-b119-421a-b3ae-ef150d2cdadb req-1578525c-0e7d-4261-ab35-3b87f9f4891b service nova] Creating event network-vif-plugged:5fc9c471-e36c-4eea-8fb2-162d705567b5 for instance aa18e03f-5e59-482d-a5ad-e14cf3bc3f35 on hv-cinder-84914 Sep 27 17:34:07.232627 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [req-851774d8-b119-421a-b3ae-ef150d2cdadb req-1578525c-0e7d-4261-ab35-3b87f9f4891b service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033034 Sep 27 17:34:07.233221 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 482/938] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:34:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:34:07.690835 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-f0f8d052-135b-4498-a275-fd960d2d8f90 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:34:07.691450 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-f0f8d052-135b-4498-a275-fd960d2d8f90 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] [instance: aa18e03f-5e59-482d-a5ad-e14cf3bc3f35] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:34:07.697768 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f0f8d052-135b-4498-a275-fd960d2d8f90 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:07.698295 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f0f8d052-135b-4498-a275-fd960d2d8f90 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:07.698736 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f0f8d052-135b-4498-a275-fd960d2d8f90 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:07.699435 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f0f8d052-135b-4498-a275-fd960d2d8f90 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:07.699892 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f0f8d052-135b-4498-a275-fd960d2d8f90 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:07.700318 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f0f8d052-135b-4498-a275-fd960d2d8f90 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:07.827241 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-f0f8d052-135b-4498-a275-fd960d2d8f90 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac1528c35fb464db00b5d18396b8eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4db1a85e2504cb9956a6461b5072aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:07.835391 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-f0f8d052-135b-4498-a275-fd960d2d8f90 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] 10.222.0.55 "GET /compute/v2.1/servers/aa18e03f-5e59-482d-a5ad-e14cf3bc3f35" status: 200 len: 1265 microversion: 2.1 time: 0.148976 Sep 27 17:34:07.835941 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 457/939] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:34:07 2022] GET /compute/v2.1/servers/aa18e03f-5e59-482d-a5ad-e14cf3bc3f35 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:34:08.335351 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-ceff6294-61bd-4859-9b21-e8b1f1eaf9d5 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:34:08.335922 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-ceff6294-61bd-4859-9b21-e8b1f1eaf9d5 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: f84aa405-baed-4bb8-84db-ab3592929c8a] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:34:08.342004 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ceff6294-61bd-4859-9b21-e8b1f1eaf9d5 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:08.342505 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ceff6294-61bd-4859-9b21-e8b1f1eaf9d5 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:08.342933 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ceff6294-61bd-4859-9b21-e8b1f1eaf9d5 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:08.344220 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ceff6294-61bd-4859-9b21-e8b1f1eaf9d5 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:08.344670 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ceff6294-61bd-4859-9b21-e8b1f1eaf9d5 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:08.345084 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ceff6294-61bd-4859-9b21-e8b1f1eaf9d5 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:08.367765 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-ceff6294-61bd-4859-9b21-e8b1f1eaf9d5 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a/ips" status: 200 len: 152 microversion: 2.20 time: 0.036567 Sep 27 17:34:08.368229 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 483/940] 10.222.0.55 () {60 vars in 1289 bytes} [Tue Sep 27 17:34:08 2022] GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a/ips => generated 152 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 17:34:08.858514 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-a915507f-2005-463c-9fa6-fb18331e1161 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:34:08.859617 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-a915507f-2005-463c-9fa6-fb18331e1161 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] [instance: aa18e03f-5e59-482d-a5ad-e14cf3bc3f35] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:34:08.866016 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a915507f-2005-463c-9fa6-fb18331e1161 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:08.866532 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a915507f-2005-463c-9fa6-fb18331e1161 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:08.866974 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a915507f-2005-463c-9fa6-fb18331e1161 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:08.867663 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a915507f-2005-463c-9fa6-fb18331e1161 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:08.868118 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a915507f-2005-463c-9fa6-fb18331e1161 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:08.868543 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a915507f-2005-463c-9fa6-fb18331e1161 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:08.998443 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-a915507f-2005-463c-9fa6-fb18331e1161 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac1528c35fb464db00b5d18396b8eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4db1a85e2504cb9956a6461b5072aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:09.006852 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-a915507f-2005-463c-9fa6-fb18331e1161 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] 10.222.0.55 "GET /compute/v2.1/servers/aa18e03f-5e59-482d-a5ad-e14cf3bc3f35" status: 200 len: 1265 microversion: 2.1 time: 0.152498 Sep 27 17:34:09.007446 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 458/941] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:34:08 2022] GET /compute/v2.1/servers/aa18e03f-5e59-482d-a5ad-e14cf3bc3f35 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:34:10.028848 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-1543c304-2e4b-42c7-b7c0-bc249cb3aef9 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:34:10.029492 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-1543c304-2e4b-42c7-b7c0-bc249cb3aef9 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] [instance: aa18e03f-5e59-482d-a5ad-e14cf3bc3f35] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:34:10.035833 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1543c304-2e4b-42c7-b7c0-bc249cb3aef9 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:10.036317 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1543c304-2e4b-42c7-b7c0-bc249cb3aef9 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:10.036754 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1543c304-2e4b-42c7-b7c0-bc249cb3aef9 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:10.037447 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1543c304-2e4b-42c7-b7c0-bc249cb3aef9 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:10.037905 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1543c304-2e4b-42c7-b7c0-bc249cb3aef9 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:10.038362 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1543c304-2e4b-42c7-b7c0-bc249cb3aef9 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:10.168093 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-1543c304-2e4b-42c7-b7c0-bc249cb3aef9 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac1528c35fb464db00b5d18396b8eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4db1a85e2504cb9956a6461b5072aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:10.175759 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-1543c304-2e4b-42c7-b7c0-bc249cb3aef9 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] 10.222.0.55 "GET /compute/v2.1/servers/aa18e03f-5e59-482d-a5ad-e14cf3bc3f35" status: 200 len: 1452 microversion: 2.1 time: 0.150807 Sep 27 17:34:10.176317 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 484/942] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:34:10 2022] GET /compute/v2.1/servers/aa18e03f-5e59-482d-a5ad-e14cf3bc3f35 => generated 1452 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:34:10.197847 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-05e6e97c-b05d-4346-a9ac-cf464e3a2854 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:34:10.198480 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-05e6e97c-b05d-4346-a9ac-cf464e3a2854 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] [instance: aa18e03f-5e59-482d-a5ad-e14cf3bc3f35] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:34:10.205466 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-05e6e97c-b05d-4346-a9ac-cf464e3a2854 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:10.205938 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-05e6e97c-b05d-4346-a9ac-cf464e3a2854 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:10.206396 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-05e6e97c-b05d-4346-a9ac-cf464e3a2854 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:10.207074 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-05e6e97c-b05d-4346-a9ac-cf464e3a2854 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:10.207798 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-05e6e97c-b05d-4346-a9ac-cf464e3a2854 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:10.207911 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-05e6e97c-b05d-4346-a9ac-cf464e3a2854 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:10.341190 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-05e6e97c-b05d-4346-a9ac-cf464e3a2854 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac1528c35fb464db00b5d18396b8eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4db1a85e2504cb9956a6461b5072aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:10.349149 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-05e6e97c-b05d-4346-a9ac-cf464e3a2854 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] 10.222.0.55 "GET /compute/v2.1/servers/aa18e03f-5e59-482d-a5ad-e14cf3bc3f35" status: 200 len: 1452 microversion: 2.1 time: 0.155115 Sep 27 17:34:10.349718 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 459/943] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:34:10 2022] GET /compute/v2.1/servers/aa18e03f-5e59-482d-a5ad-e14cf3bc3f35 => generated 1452 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:34:11.362859 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-ab866363-fa52-4624-adbc-9a7740a64090 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:34:11.363506 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-ab866363-fa52-4624-adbc-9a7740a64090 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: f84aa405-baed-4bb8-84db-ab3592929c8a] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:34:11.369653 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ab866363-fa52-4624-adbc-9a7740a64090 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:11.370170 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ab866363-fa52-4624-adbc-9a7740a64090 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:11.370611 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ab866363-fa52-4624-adbc-9a7740a64090 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:11.371309 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ab866363-fa52-4624-adbc-9a7740a64090 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:11.371764 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ab866363-fa52-4624-adbc-9a7740a64090 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:11.372192 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ab866363-fa52-4624-adbc-9a7740a64090 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:11.395612 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.objects.instance [None req-ab866363-fa52-4624-adbc-9a7740a64090 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lazy-loading 'flavor' on Instance uuid f84aa405-baed-4bb8-84db-ab3592929c8a {{(pid=120416) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 17:34:11.584654 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-ab866363-fa52-4624-adbc-9a7740a64090 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "POST /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a/action" status: 202 len: 0 microversion: 2.20 time: 0.225814 Sep 27 17:34:11.585252 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 485/944] 10.222.0.55 () {62 vars in 1319 bytes} [Tue Sep 27 17:34:11 2022] POST /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 27 17:34:11.593500 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-76199819-6eda-48d8-b880-ce38e9c2b8dc tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:34:11.596202 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-76199819-6eda-48d8-b880-ce38e9c2b8dc tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: f84aa405-baed-4bb8-84db-ab3592929c8a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:34:11.603208 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-76199819-6eda-48d8-b880-ce38e9c2b8dc tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:11.603695 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-76199819-6eda-48d8-b880-ce38e9c2b8dc tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:11.604139 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-76199819-6eda-48d8-b880-ce38e9c2b8dc tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:11.605081 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-76199819-6eda-48d8-b880-ce38e9c2b8dc tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:11.605694 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-76199819-6eda-48d8-b880-ce38e9c2b8dc tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:11.606161 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-76199819-6eda-48d8-b880-ce38e9c2b8dc tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:11.742819 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-76199819-6eda-48d8-b880-ce38e9c2b8dc tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:11.750980 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-76199819-6eda-48d8-b880-ce38e9c2b8dc tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:11.752447 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-76199819-6eda-48d8-b880-ce38e9c2b8dc tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:11.753619 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-76199819-6eda-48d8-b880-ce38e9c2b8dc tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a" status: 200 len: 1724 microversion: 2.20 time: 0.164079 Sep 27 17:34:11.754215 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 460/945] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:34:11 2022] GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 17:34:11.910141 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [req-f2f83627-dec4-4629-898b-70497f3446b6 req-5975737c-fd04-4e0e-9cec-3e7be0fc12d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa18e03f-5e59-482d-a5ad-e14cf3bc3f35", "tag": "5fc9c471-e36c-4eea-8fb2-162d705567b5"}]} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:34:11.919590 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-f2f83627-dec4-4629-898b-70497f3446b6 req-5975737c-fd04-4e0e-9cec-3e7be0fc12d5 service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:11.920067 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-f2f83627-dec4-4629-898b-70497f3446b6 req-5975737c-fd04-4e0e-9cec-3e7be0fc12d5 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:11.920531 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-f2f83627-dec4-4629-898b-70497f3446b6 req-5975737c-fd04-4e0e-9cec-3e7be0fc12d5 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:11.931504 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.compute.server_external_events [req-f2f83627-dec4-4629-898b-70497f3446b6 req-5975737c-fd04-4e0e-9cec-3e7be0fc12d5 service nova] Creating event network-changed:5fc9c471-e36c-4eea-8fb2-162d705567b5 for instance aa18e03f-5e59-482d-a5ad-e14cf3bc3f35 on hv-cinder-84914 Sep 27 17:34:11.936427 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [req-f2f83627-dec4-4629-898b-70497f3446b6 req-5975737c-fd04-4e0e-9cec-3e7be0fc12d5 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030962 Sep 27 17:34:11.937113 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 486/946] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:34:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:34:12.780325 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-a03a6f46-2f0c-4f22-9f29-87c31be43707 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:34:12.781015 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-a03a6f46-2f0c-4f22-9f29-87c31be43707 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: f84aa405-baed-4bb8-84db-ab3592929c8a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:34:12.787433 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a03a6f46-2f0c-4f22-9f29-87c31be43707 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:12.788027 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a03a6f46-2f0c-4f22-9f29-87c31be43707 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:12.788459 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a03a6f46-2f0c-4f22-9f29-87c31be43707 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:12.789154 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a03a6f46-2f0c-4f22-9f29-87c31be43707 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:12.789598 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a03a6f46-2f0c-4f22-9f29-87c31be43707 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:12.790012 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a03a6f46-2f0c-4f22-9f29-87c31be43707 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:12.920494 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-a03a6f46-2f0c-4f22-9f29-87c31be43707 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:12.929630 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-a03a6f46-2f0c-4f22-9f29-87c31be43707 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:12.931095 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-a03a6f46-2f0c-4f22-9f29-87c31be43707 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:12.932278 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-a03a6f46-2f0c-4f22-9f29-87c31be43707 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a" status: 200 len: 1724 microversion: 2.20 time: 0.156003 Sep 27 17:34:12.932841 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 461/947] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:34:12 2022] GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:34:13.958964 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-1542b992-5345-47b7-b703-d5bc0e5b14bb tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:34:13.959771 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-1542b992-5345-47b7-b703-d5bc0e5b14bb tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: f84aa405-baed-4bb8-84db-ab3592929c8a] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:34:13.967303 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1542b992-5345-47b7-b703-d5bc0e5b14bb tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:13.967814 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1542b992-5345-47b7-b703-d5bc0e5b14bb tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:13.968247 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1542b992-5345-47b7-b703-d5bc0e5b14bb tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:13.969450 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1542b992-5345-47b7-b703-d5bc0e5b14bb tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:13.970162 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1542b992-5345-47b7-b703-d5bc0e5b14bb tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:13.970806 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1542b992-5345-47b7-b703-d5bc0e5b14bb tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:14.103122 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-1542b992-5345-47b7-b703-d5bc0e5b14bb tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:14.111406 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-1542b992-5345-47b7-b703-d5bc0e5b14bb tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:14.112843 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-1542b992-5345-47b7-b703-d5bc0e5b14bb tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:14.113984 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-1542b992-5345-47b7-b703-d5bc0e5b14bb tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a" status: 200 len: 1724 microversion: 2.20 time: 0.160138 Sep 27 17:34:14.114566 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 487/948] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:34:13 2022] GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:34:15.139563 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-7f91e586-799d-41ae-b3aa-06d112d8411a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:34:15.140197 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-7f91e586-799d-41ae-b3aa-06d112d8411a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: f84aa405-baed-4bb8-84db-ab3592929c8a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:34:15.146684 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7f91e586-799d-41ae-b3aa-06d112d8411a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:15.147168 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7f91e586-799d-41ae-b3aa-06d112d8411a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:15.147607 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7f91e586-799d-41ae-b3aa-06d112d8411a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:15.148294 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7f91e586-799d-41ae-b3aa-06d112d8411a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:15.148750 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7f91e586-799d-41ae-b3aa-06d112d8411a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:15.149174 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7f91e586-799d-41ae-b3aa-06d112d8411a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:15.275905 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-7f91e586-799d-41ae-b3aa-06d112d8411a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:15.286781 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-7f91e586-799d-41ae-b3aa-06d112d8411a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:15.288529 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-7f91e586-799d-41ae-b3aa-06d112d8411a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:15.290015 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-7f91e586-799d-41ae-b3aa-06d112d8411a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a" status: 200 len: 1724 microversion: 2.20 time: 0.154382 Sep 27 17:34:15.291084 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 462/949] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:34:15 2022] GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:34:16.446061 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-83a93925-11a1-4fcd-98c6-60b067327309 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:34:16.446701 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-83a93925-11a1-4fcd-98c6-60b067327309 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: f84aa405-baed-4bb8-84db-ab3592929c8a] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:34:16.452552 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-83a93925-11a1-4fcd-98c6-60b067327309 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:16.453026 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-83a93925-11a1-4fcd-98c6-60b067327309 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:16.453473 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-83a93925-11a1-4fcd-98c6-60b067327309 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:16.454189 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-83a93925-11a1-4fcd-98c6-60b067327309 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:16.454638 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-83a93925-11a1-4fcd-98c6-60b067327309 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:16.455056 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-83a93925-11a1-4fcd-98c6-60b067327309 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:16.584157 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-83a93925-11a1-4fcd-98c6-60b067327309 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:16.592066 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-83a93925-11a1-4fcd-98c6-60b067327309 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:16.593509 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-83a93925-11a1-4fcd-98c6-60b067327309 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:16.594683 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-83a93925-11a1-4fcd-98c6-60b067327309 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a" status: 200 len: 1724 microversion: 2.20 time: 0.282101 Sep 27 17:34:16.595236 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 488/950] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:34:16 2022] GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a => generated 1724 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:34:17.620384 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-d9592085-ddc6-4301-a8e1-8dfcab32351c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:34:17.620994 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-d9592085-ddc6-4301-a8e1-8dfcab32351c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: f84aa405-baed-4bb8-84db-ab3592929c8a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:34:17.623336 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:34:17.629070 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d9592085-ddc6-4301-a8e1-8dfcab32351c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:17.629552 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d9592085-ddc6-4301-a8e1-8dfcab32351c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:17.629989 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d9592085-ddc6-4301-a8e1-8dfcab32351c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:17.630710 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d9592085-ddc6-4301-a8e1-8dfcab32351c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:17.631171 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d9592085-ddc6-4301-a8e1-8dfcab32351c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:17.631599 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d9592085-ddc6-4301-a8e1-8dfcab32351c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:17.634969 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:34:17.758663 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-d9592085-ddc6-4301-a8e1-8dfcab32351c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:17.766813 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-d9592085-ddc6-4301-a8e1-8dfcab32351c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:17.768294 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-d9592085-ddc6-4301-a8e1-8dfcab32351c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:17.769450 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-d9592085-ddc6-4301-a8e1-8dfcab32351c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a" status: 200 len: 1724 microversion: 2.20 time: 0.153098 Sep 27 17:34:17.770001 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 463/951] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:34:17 2022] GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:34:18.794491 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-de4a9a94-8cc6-441a-9482-b7dac3b2c642 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:34:18.795244 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-de4a9a94-8cc6-441a-9482-b7dac3b2c642 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: f84aa405-baed-4bb8-84db-ab3592929c8a] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:34:18.797062 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:34:18.803310 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-de4a9a94-8cc6-441a-9482-b7dac3b2c642 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:18.803799 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-de4a9a94-8cc6-441a-9482-b7dac3b2c642 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:18.804237 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-de4a9a94-8cc6-441a-9482-b7dac3b2c642 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:18.804925 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-de4a9a94-8cc6-441a-9482-b7dac3b2c642 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:18.805379 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-de4a9a94-8cc6-441a-9482-b7dac3b2c642 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:18.805805 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-de4a9a94-8cc6-441a-9482-b7dac3b2c642 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:18.808955 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:34:18.943406 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-de4a9a94-8cc6-441a-9482-b7dac3b2c642 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:18.951255 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-de4a9a94-8cc6-441a-9482-b7dac3b2c642 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:18.952718 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-de4a9a94-8cc6-441a-9482-b7dac3b2c642 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:18.954450 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-de4a9a94-8cc6-441a-9482-b7dac3b2c642 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a" status: 200 len: 1724 microversion: 2.20 time: 0.163848 Sep 27 17:34:18.955014 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 489/952] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:34:18 2022] GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:34:19.980025 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-272bb50b-db41-484d-904d-a1559315d49d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:34:19.980636 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-272bb50b-db41-484d-904d-a1559315d49d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: f84aa405-baed-4bb8-84db-ab3592929c8a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:34:19.987693 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-272bb50b-db41-484d-904d-a1559315d49d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:19.988173 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-272bb50b-db41-484d-904d-a1559315d49d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:19.988633 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-272bb50b-db41-484d-904d-a1559315d49d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:19.989318 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-272bb50b-db41-484d-904d-a1559315d49d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:19.989771 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-272bb50b-db41-484d-904d-a1559315d49d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:19.990222 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-272bb50b-db41-484d-904d-a1559315d49d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:20.118780 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-272bb50b-db41-484d-904d-a1559315d49d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:20.126871 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-272bb50b-db41-484d-904d-a1559315d49d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:20.128336 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-272bb50b-db41-484d-904d-a1559315d49d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:20.129499 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-272bb50b-db41-484d-904d-a1559315d49d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a" status: 200 len: 1724 microversion: 2.20 time: 0.153418 Sep 27 17:34:20.130059 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 464/953] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:34:19 2022] GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:34:21.156810 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-a412a7ad-57d3-4c09-94bc-f47d56991bc1 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:34:21.157537 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-a412a7ad-57d3-4c09-94bc-f47d56991bc1 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: f84aa405-baed-4bb8-84db-ab3592929c8a] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:34:21.163877 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a412a7ad-57d3-4c09-94bc-f47d56991bc1 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:21.164359 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a412a7ad-57d3-4c09-94bc-f47d56991bc1 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:21.164798 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a412a7ad-57d3-4c09-94bc-f47d56991bc1 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:21.165488 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a412a7ad-57d3-4c09-94bc-f47d56991bc1 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:21.165948 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a412a7ad-57d3-4c09-94bc-f47d56991bc1 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:21.166399 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a412a7ad-57d3-4c09-94bc-f47d56991bc1 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:21.300709 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-a412a7ad-57d3-4c09-94bc-f47d56991bc1 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:21.309334 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-a412a7ad-57d3-4c09-94bc-f47d56991bc1 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:21.310809 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-a412a7ad-57d3-4c09-94bc-f47d56991bc1 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:21.311991 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-a412a7ad-57d3-4c09-94bc-f47d56991bc1 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a" status: 200 len: 1724 microversion: 2.20 time: 0.159162 Sep 27 17:34:21.312549 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 490/954] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:34:21 2022] GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:34:22.337936 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-5fd03ec1-d1d1-4642-8c9c-892fbbd73aa6 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:34:22.338579 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-5fd03ec1-d1d1-4642-8c9c-892fbbd73aa6 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: f84aa405-baed-4bb8-84db-ab3592929c8a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:34:22.345009 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5fd03ec1-d1d1-4642-8c9c-892fbbd73aa6 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:22.345508 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5fd03ec1-d1d1-4642-8c9c-892fbbd73aa6 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:22.345945 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5fd03ec1-d1d1-4642-8c9c-892fbbd73aa6 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:22.346667 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5fd03ec1-d1d1-4642-8c9c-892fbbd73aa6 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:22.347122 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5fd03ec1-d1d1-4642-8c9c-892fbbd73aa6 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:22.349782 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5fd03ec1-d1d1-4642-8c9c-892fbbd73aa6 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:22.490110 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-5fd03ec1-d1d1-4642-8c9c-892fbbd73aa6 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:22.498027 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-5fd03ec1-d1d1-4642-8c9c-892fbbd73aa6 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:22.499500 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-5fd03ec1-d1d1-4642-8c9c-892fbbd73aa6 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:22.500655 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-5fd03ec1-d1d1-4642-8c9c-892fbbd73aa6 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a" status: 200 len: 1724 microversion: 2.20 time: 0.166643 Sep 27 17:34:22.501219 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 465/955] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:34:22 2022] GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:34:23.526801 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-b311b77a-a09b-4bfd-84fc-7f6dbbc2d83d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:34:23.527346 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-b311b77a-a09b-4bfd-84fc-7f6dbbc2d83d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: f84aa405-baed-4bb8-84db-ab3592929c8a] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:34:23.533465 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b311b77a-a09b-4bfd-84fc-7f6dbbc2d83d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:23.533940 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b311b77a-a09b-4bfd-84fc-7f6dbbc2d83d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:23.534403 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b311b77a-a09b-4bfd-84fc-7f6dbbc2d83d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:23.535087 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b311b77a-a09b-4bfd-84fc-7f6dbbc2d83d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:23.535540 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b311b77a-a09b-4bfd-84fc-7f6dbbc2d83d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:23.535966 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b311b77a-a09b-4bfd-84fc-7f6dbbc2d83d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:23.661414 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-b311b77a-a09b-4bfd-84fc-7f6dbbc2d83d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:23.669603 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-b311b77a-a09b-4bfd-84fc-7f6dbbc2d83d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:23.671082 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-b311b77a-a09b-4bfd-84fc-7f6dbbc2d83d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:23.672247 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-b311b77a-a09b-4bfd-84fc-7f6dbbc2d83d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a" status: 200 len: 1724 microversion: 2.20 time: 0.149436 Sep 27 17:34:23.672806 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 491/956] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:34:23 2022] GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:34:24.698402 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-64c1fb96-dee4-4cde-b339-039c11c32fb5 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:34:24.699019 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-64c1fb96-dee4-4cde-b339-039c11c32fb5 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: f84aa405-baed-4bb8-84db-ab3592929c8a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:34:24.706469 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-64c1fb96-dee4-4cde-b339-039c11c32fb5 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:24.706955 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-64c1fb96-dee4-4cde-b339-039c11c32fb5 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:24.707393 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-64c1fb96-dee4-4cde-b339-039c11c32fb5 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:24.708082 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-64c1fb96-dee4-4cde-b339-039c11c32fb5 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:24.708538 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-64c1fb96-dee4-4cde-b339-039c11c32fb5 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:24.708963 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-64c1fb96-dee4-4cde-b339-039c11c32fb5 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:24.839461 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-64c1fb96-dee4-4cde-b339-039c11c32fb5 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:24.847493 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-64c1fb96-dee4-4cde-b339-039c11c32fb5 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:24.848952 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-64c1fb96-dee4-4cde-b339-039c11c32fb5 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:24.850149 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-64c1fb96-dee4-4cde-b339-039c11c32fb5 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a" status: 200 len: 1724 microversion: 2.20 time: 0.155720 Sep 27 17:34:24.850707 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 466/957] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:34:24 2022] GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:34:25.875491 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-f8f681e4-3599-413d-8464-f46a389d88d4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:34:25.876112 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-f8f681e4-3599-413d-8464-f46a389d88d4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: f84aa405-baed-4bb8-84db-ab3592929c8a] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:34:25.882465 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f8f681e4-3599-413d-8464-f46a389d88d4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:25.882947 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f8f681e4-3599-413d-8464-f46a389d88d4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:25.883374 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f8f681e4-3599-413d-8464-f46a389d88d4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:25.884071 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f8f681e4-3599-413d-8464-f46a389d88d4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:25.884517 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f8f681e4-3599-413d-8464-f46a389d88d4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:25.884932 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f8f681e4-3599-413d-8464-f46a389d88d4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:26.025085 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-f8f681e4-3599-413d-8464-f46a389d88d4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:26.033512 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-f8f681e4-3599-413d-8464-f46a389d88d4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:26.034975 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-f8f681e4-3599-413d-8464-f46a389d88d4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:26.036128 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-f8f681e4-3599-413d-8464-f46a389d88d4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a" status: 200 len: 1724 microversion: 2.20 time: 0.164653 Sep 27 17:34:26.036699 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 492/958] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:34:25 2022] GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:34:27.062290 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-3b52d4c0-a0cb-4589-882b-bf8ff2da1f59 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:34:27.062895 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-3b52d4c0-a0cb-4589-882b-bf8ff2da1f59 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: f84aa405-baed-4bb8-84db-ab3592929c8a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:34:27.069662 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3b52d4c0-a0cb-4589-882b-bf8ff2da1f59 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:27.070171 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3b52d4c0-a0cb-4589-882b-bf8ff2da1f59 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:27.070612 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3b52d4c0-a0cb-4589-882b-bf8ff2da1f59 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:27.071305 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3b52d4c0-a0cb-4589-882b-bf8ff2da1f59 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:27.071792 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3b52d4c0-a0cb-4589-882b-bf8ff2da1f59 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:27.072222 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3b52d4c0-a0cb-4589-882b-bf8ff2da1f59 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:27.201845 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-3b52d4c0-a0cb-4589-882b-bf8ff2da1f59 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:27.209929 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-3b52d4c0-a0cb-4589-882b-bf8ff2da1f59 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:27.211409 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-3b52d4c0-a0cb-4589-882b-bf8ff2da1f59 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:27.212567 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-3b52d4c0-a0cb-4589-882b-bf8ff2da1f59 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a" status: 200 len: 1724 microversion: 2.20 time: 0.154329 Sep 27 17:34:27.213142 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 467/959] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:34:27 2022] GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:34:28.238537 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-9bbe57fd-d91d-42b9-9d10-c5eedf2946c4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:34:28.239145 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-9bbe57fd-d91d-42b9-9d10-c5eedf2946c4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: f84aa405-baed-4bb8-84db-ab3592929c8a] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:34:28.245127 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9bbe57fd-d91d-42b9-9d10-c5eedf2946c4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:28.245608 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9bbe57fd-d91d-42b9-9d10-c5eedf2946c4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:28.246044 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9bbe57fd-d91d-42b9-9d10-c5eedf2946c4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:28.246760 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9bbe57fd-d91d-42b9-9d10-c5eedf2946c4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:28.247216 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9bbe57fd-d91d-42b9-9d10-c5eedf2946c4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:28.247638 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9bbe57fd-d91d-42b9-9d10-c5eedf2946c4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:28.382177 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-9bbe57fd-d91d-42b9-9d10-c5eedf2946c4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:28.390038 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-9bbe57fd-d91d-42b9-9d10-c5eedf2946c4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:28.391497 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-9bbe57fd-d91d-42b9-9d10-c5eedf2946c4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:28.392662 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-9bbe57fd-d91d-42b9-9d10-c5eedf2946c4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a" status: 200 len: 1724 microversion: 2.20 time: 0.158556 Sep 27 17:34:28.393210 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 493/960] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:34:28 2022] GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:34:29.417676 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-713eabe8-d584-4053-9237-ea5eaff901a3 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:34:29.418308 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-713eabe8-d584-4053-9237-ea5eaff901a3 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: f84aa405-baed-4bb8-84db-ab3592929c8a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:34:29.424696 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-713eabe8-d584-4053-9237-ea5eaff901a3 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:29.425170 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-713eabe8-d584-4053-9237-ea5eaff901a3 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:29.425599 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-713eabe8-d584-4053-9237-ea5eaff901a3 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:29.426306 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-713eabe8-d584-4053-9237-ea5eaff901a3 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:29.426756 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-713eabe8-d584-4053-9237-ea5eaff901a3 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:29.427174 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-713eabe8-d584-4053-9237-ea5eaff901a3 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:29.553354 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-713eabe8-d584-4053-9237-ea5eaff901a3 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:29.561483 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-713eabe8-d584-4053-9237-ea5eaff901a3 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:29.562963 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-713eabe8-d584-4053-9237-ea5eaff901a3 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:29.564631 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-713eabe8-d584-4053-9237-ea5eaff901a3 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a" status: 200 len: 1724 microversion: 2.20 time: 0.150969 Sep 27 17:34:29.565183 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 468/961] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:34:29 2022] GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:34:30.590963 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-614f3339-608f-46f1-a401-8b9a5ce9338a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:34:30.591481 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-614f3339-608f-46f1-a401-8b9a5ce9338a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: f84aa405-baed-4bb8-84db-ab3592929c8a] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:34:30.597999 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-614f3339-608f-46f1-a401-8b9a5ce9338a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:30.598517 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-614f3339-608f-46f1-a401-8b9a5ce9338a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:30.598951 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-614f3339-608f-46f1-a401-8b9a5ce9338a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:30.599635 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-614f3339-608f-46f1-a401-8b9a5ce9338a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:30.600089 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-614f3339-608f-46f1-a401-8b9a5ce9338a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:30.600512 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-614f3339-608f-46f1-a401-8b9a5ce9338a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:30.734594 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-614f3339-608f-46f1-a401-8b9a5ce9338a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:30.742611 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-614f3339-608f-46f1-a401-8b9a5ce9338a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:30.744064 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-614f3339-608f-46f1-a401-8b9a5ce9338a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:30.745211 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-614f3339-608f-46f1-a401-8b9a5ce9338a tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a" status: 200 len: 1724 microversion: 2.20 time: 0.158241 Sep 27 17:34:30.745770 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 494/962] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:34:30 2022] GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:34:31.771268 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-dec9cb8a-4e52-4160-aca7-b776d56d0136 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:34:31.771868 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-dec9cb8a-4e52-4160-aca7-b776d56d0136 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: f84aa405-baed-4bb8-84db-ab3592929c8a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:34:31.778531 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-dec9cb8a-4e52-4160-aca7-b776d56d0136 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:31.779002 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-dec9cb8a-4e52-4160-aca7-b776d56d0136 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:31.779429 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-dec9cb8a-4e52-4160-aca7-b776d56d0136 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:31.780104 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-dec9cb8a-4e52-4160-aca7-b776d56d0136 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:31.780547 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-dec9cb8a-4e52-4160-aca7-b776d56d0136 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:31.780963 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-dec9cb8a-4e52-4160-aca7-b776d56d0136 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:31.908804 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-dec9cb8a-4e52-4160-aca7-b776d56d0136 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:31.916781 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-dec9cb8a-4e52-4160-aca7-b776d56d0136 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:31.918264 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-dec9cb8a-4e52-4160-aca7-b776d56d0136 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:31.919420 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-dec9cb8a-4e52-4160-aca7-b776d56d0136 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a" status: 200 len: 1724 microversion: 2.20 time: 0.152403 Sep 27 17:34:31.919974 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 469/963] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:34:31 2022] GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:34:32.945766 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-e887088f-ee38-4c9f-be26-5bf885fa1780 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:34:32.946401 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-e887088f-ee38-4c9f-be26-5bf885fa1780 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: f84aa405-baed-4bb8-84db-ab3592929c8a] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:34:32.952223 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e887088f-ee38-4c9f-be26-5bf885fa1780 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:32.952700 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e887088f-ee38-4c9f-be26-5bf885fa1780 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:32.953132 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e887088f-ee38-4c9f-be26-5bf885fa1780 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:32.953815 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e887088f-ee38-4c9f-be26-5bf885fa1780 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:32.954315 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e887088f-ee38-4c9f-be26-5bf885fa1780 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:32.954738 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e887088f-ee38-4c9f-be26-5bf885fa1780 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:33.083241 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-e887088f-ee38-4c9f-be26-5bf885fa1780 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:33.091538 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-e887088f-ee38-4c9f-be26-5bf885fa1780 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:33.092988 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-e887088f-ee38-4c9f-be26-5bf885fa1780 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:33.094162 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-e887088f-ee38-4c9f-be26-5bf885fa1780 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a" status: 200 len: 1745 microversion: 2.20 time: 0.152286 Sep 27 17:34:33.094715 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 495/964] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:34:32 2022] GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a => generated 1745 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:34:34.121319 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-f1844b17-2355-4f9b-8eef-28a7c2742212 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:34:34.121964 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-f1844b17-2355-4f9b-8eef-28a7c2742212 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: f84aa405-baed-4bb8-84db-ab3592929c8a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:34:34.128962 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f1844b17-2355-4f9b-8eef-28a7c2742212 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:34.129557 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f1844b17-2355-4f9b-8eef-28a7c2742212 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:34.130096 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f1844b17-2355-4f9b-8eef-28a7c2742212 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:34.130793 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f1844b17-2355-4f9b-8eef-28a7c2742212 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:34.131248 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f1844b17-2355-4f9b-8eef-28a7c2742212 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:34.131674 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f1844b17-2355-4f9b-8eef-28a7c2742212 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:34.259509 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-f1844b17-2355-4f9b-8eef-28a7c2742212 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:34.267661 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-f1844b17-2355-4f9b-8eef-28a7c2742212 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:34.269136 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-f1844b17-2355-4f9b-8eef-28a7c2742212 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:34.270271 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-f1844b17-2355-4f9b-8eef-28a7c2742212 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a" status: 200 len: 1745 microversion: 2.20 time: 0.152884 Sep 27 17:34:34.270836 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 470/965] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:34:34 2022] GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:34:35.296495 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-d8cb8792-c7e6-41a0-8706-c580b6c2e54e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:34:35.297095 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-d8cb8792-c7e6-41a0-8706-c580b6c2e54e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: f84aa405-baed-4bb8-84db-ab3592929c8a] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:34:35.305497 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d8cb8792-c7e6-41a0-8706-c580b6c2e54e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:35.305988 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d8cb8792-c7e6-41a0-8706-c580b6c2e54e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:35.306934 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d8cb8792-c7e6-41a0-8706-c580b6c2e54e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:35.307839 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d8cb8792-c7e6-41a0-8706-c580b6c2e54e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:35.308469 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d8cb8792-c7e6-41a0-8706-c580b6c2e54e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:35.308898 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d8cb8792-c7e6-41a0-8706-c580b6c2e54e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:35.332110 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [req-7fcd0644-5c50-4e71-88de-c0bd1fd82846 req-c52395da-8c41-4627-8e5d-b1b7e619f04c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f84aa405-baed-4bb8-84db-ab3592929c8a", "name": "network-vif-plugged", "status": "completed", "tag": "44bdfd6c-6234-47ec-8359-4819b713d0a5"}]} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:34:35.343262 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-7fcd0644-5c50-4e71-88de-c0bd1fd82846 req-c52395da-8c41-4627-8e5d-b1b7e619f04c service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:35.343977 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-7fcd0644-5c50-4e71-88de-c0bd1fd82846 req-c52395da-8c41-4627-8e5d-b1b7e619f04c service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:35.344577 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-7fcd0644-5c50-4e71-88de-c0bd1fd82846 req-c52395da-8c41-4627-8e5d-b1b7e619f04c service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:35.356929 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.compute.server_external_events [req-7fcd0644-5c50-4e71-88de-c0bd1fd82846 req-c52395da-8c41-4627-8e5d-b1b7e619f04c service nova] Creating event network-vif-plugged:44bdfd6c-6234-47ec-8359-4819b713d0a5 for instance f84aa405-baed-4bb8-84db-ab3592929c8a on hv-cinder-84914 Sep 27 17:34:35.363004 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [req-7fcd0644-5c50-4e71-88de-c0bd1fd82846 req-c52395da-8c41-4627-8e5d-b1b7e619f04c service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035096 Sep 27 17:34:35.363605 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 471/966] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:34:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 17:34:35.444071 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-d8cb8792-c7e6-41a0-8706-c580b6c2e54e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:35.452195 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-d8cb8792-c7e6-41a0-8706-c580b6c2e54e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:35.453648 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-d8cb8792-c7e6-41a0-8706-c580b6c2e54e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:35.455013 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-d8cb8792-c7e6-41a0-8706-c580b6c2e54e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a" status: 200 len: 1745 microversion: 2.20 time: 0.162463 Sep 27 17:34:35.455570 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 496/967] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:34:35 2022] GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a => generated 1745 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:34:36.482264 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-3f17f715-67e8-4113-8acb-134f80ae3e16 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:34:36.482962 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-3f17f715-67e8-4113-8acb-134f80ae3e16 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: f84aa405-baed-4bb8-84db-ab3592929c8a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:34:36.489572 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3f17f715-67e8-4113-8acb-134f80ae3e16 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:36.490055 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3f17f715-67e8-4113-8acb-134f80ae3e16 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:36.490530 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3f17f715-67e8-4113-8acb-134f80ae3e16 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:36.491224 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3f17f715-67e8-4113-8acb-134f80ae3e16 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:36.491676 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3f17f715-67e8-4113-8acb-134f80ae3e16 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:36.492100 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3f17f715-67e8-4113-8acb-134f80ae3e16 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:36.621462 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-3f17f715-67e8-4113-8acb-134f80ae3e16 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:36.630204 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-3f17f715-67e8-4113-8acb-134f80ae3e16 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:36.631659 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-3f17f715-67e8-4113-8acb-134f80ae3e16 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:36.632816 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-3f17f715-67e8-4113-8acb-134f80ae3e16 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a" status: 200 len: 1745 microversion: 2.20 time: 0.155685 Sep 27 17:34:36.633374 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 472/968] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:34:36 2022] GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:34:37.659494 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-55059938-1106-40ed-a753-9d9984d81e9f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:34:37.660297 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-55059938-1106-40ed-a753-9d9984d81e9f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: f84aa405-baed-4bb8-84db-ab3592929c8a] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:34:37.678824 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-55059938-1106-40ed-a753-9d9984d81e9f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:37.679341 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-55059938-1106-40ed-a753-9d9984d81e9f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:37.679779 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-55059938-1106-40ed-a753-9d9984d81e9f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:37.680486 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-55059938-1106-40ed-a753-9d9984d81e9f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:37.681132 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-55059938-1106-40ed-a753-9d9984d81e9f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:37.681559 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-55059938-1106-40ed-a753-9d9984d81e9f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:37.836765 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-55059938-1106-40ed-a753-9d9984d81e9f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:37.846225 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-55059938-1106-40ed-a753-9d9984d81e9f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:37.847698 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-55059938-1106-40ed-a753-9d9984d81e9f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:37.848898 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-55059938-1106-40ed-a753-9d9984d81e9f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a" status: 200 len: 1745 microversion: 2.20 time: 0.194802 Sep 27 17:34:37.849464 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 497/969] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:34:37 2022] GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a => generated 1745 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:34:38.876749 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-e89273c1-a44b-4107-9c46-7ea1c1c74930 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:34:38.877381 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-e89273c1-a44b-4107-9c46-7ea1c1c74930 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: f84aa405-baed-4bb8-84db-ab3592929c8a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:34:38.886028 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e89273c1-a44b-4107-9c46-7ea1c1c74930 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:38.886547 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e89273c1-a44b-4107-9c46-7ea1c1c74930 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:38.886990 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e89273c1-a44b-4107-9c46-7ea1c1c74930 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:38.887688 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e89273c1-a44b-4107-9c46-7ea1c1c74930 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:38.888144 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e89273c1-a44b-4107-9c46-7ea1c1c74930 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:38.888569 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e89273c1-a44b-4107-9c46-7ea1c1c74930 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:39.016435 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-e89273c1-a44b-4107-9c46-7ea1c1c74930 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:39.024719 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-e89273c1-a44b-4107-9c46-7ea1c1c74930 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:39.026212 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-e89273c1-a44b-4107-9c46-7ea1c1c74930 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:39.027382 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-e89273c1-a44b-4107-9c46-7ea1c1c74930 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a" status: 200 len: 1745 microversion: 2.20 time: 0.155347 Sep 27 17:34:39.027925 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 473/970] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:34:38 2022] GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:34:40.055543 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-fa2d9376-9fd4-4f50-a21e-79cc89ba18d2 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:34:40.056858 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-fa2d9376-9fd4-4f50-a21e-79cc89ba18d2 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: f84aa405-baed-4bb8-84db-ab3592929c8a] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:34:40.063255 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-fa2d9376-9fd4-4f50-a21e-79cc89ba18d2 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:40.064266 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-fa2d9376-9fd4-4f50-a21e-79cc89ba18d2 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:40.064896 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-fa2d9376-9fd4-4f50-a21e-79cc89ba18d2 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:40.065771 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-fa2d9376-9fd4-4f50-a21e-79cc89ba18d2 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:40.066359 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-fa2d9376-9fd4-4f50-a21e-79cc89ba18d2 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:40.066977 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-fa2d9376-9fd4-4f50-a21e-79cc89ba18d2 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:40.216381 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-fa2d9376-9fd4-4f50-a21e-79cc89ba18d2 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:40.224811 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-fa2d9376-9fd4-4f50-a21e-79cc89ba18d2 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:40.226485 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-fa2d9376-9fd4-4f50-a21e-79cc89ba18d2 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:40.227727 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-fa2d9376-9fd4-4f50-a21e-79cc89ba18d2 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a" status: 200 len: 1740 microversion: 2.20 time: 0.176634 Sep 27 17:34:40.228366 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 498/971] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:34:40 2022] GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a => generated 1740 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:34:41.257537 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-8a7c7387-219a-405f-84ce-86ba060c71af tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:34:41.258169 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-8a7c7387-219a-405f-84ce-86ba060c71af tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: f84aa405-baed-4bb8-84db-ab3592929c8a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:34:41.267912 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8a7c7387-219a-405f-84ce-86ba060c71af tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:41.268902 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8a7c7387-219a-405f-84ce-86ba060c71af tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:41.271581 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8a7c7387-219a-405f-84ce-86ba060c71af tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:41.273117 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8a7c7387-219a-405f-84ce-86ba060c71af tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:41.273766 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8a7c7387-219a-405f-84ce-86ba060c71af tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:41.274221 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8a7c7387-219a-405f-84ce-86ba060c71af tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:41.419045 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-8a7c7387-219a-405f-84ce-86ba060c71af tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:41.427700 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-8a7c7387-219a-405f-84ce-86ba060c71af tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:41.429382 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-8a7c7387-219a-405f-84ce-86ba060c71af tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:41.430584 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-8a7c7387-219a-405f-84ce-86ba060c71af tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a" status: 200 len: 1740 microversion: 2.20 time: 0.179801 Sep 27 17:34:41.431452 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 474/972] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:34:41 2022] GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a => generated 1740 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:34:42.456626 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-0a1d81a7-42e7-48a3-b62a-ce2cdb6462dc tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:34:42.457326 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-0a1d81a7-42e7-48a3-b62a-ce2cdb6462dc tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: f84aa405-baed-4bb8-84db-ab3592929c8a] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:34:42.463172 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-0a1d81a7-42e7-48a3-b62a-ce2cdb6462dc tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:42.463840 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-0a1d81a7-42e7-48a3-b62a-ce2cdb6462dc tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:42.464485 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-0a1d81a7-42e7-48a3-b62a-ce2cdb6462dc tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:42.467398 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-0a1d81a7-42e7-48a3-b62a-ce2cdb6462dc tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:42.468030 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-0a1d81a7-42e7-48a3-b62a-ce2cdb6462dc tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:42.468642 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-0a1d81a7-42e7-48a3-b62a-ce2cdb6462dc tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:42.618697 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-0a1d81a7-42e7-48a3-b62a-ce2cdb6462dc tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:42.630653 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-0a1d81a7-42e7-48a3-b62a-ce2cdb6462dc tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:42.633024 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-0a1d81a7-42e7-48a3-b62a-ce2cdb6462dc tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:42.634481 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-0a1d81a7-42e7-48a3-b62a-ce2cdb6462dc tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a" status: 200 len: 1740 microversion: 2.20 time: 0.182579 Sep 27 17:34:42.635050 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 499/973] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:34:42 2022] GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a => generated 1740 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 17:34:43.664239 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-b599388f-1e74-4e4c-933f-5917f72aa801 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:34:43.664951 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-b599388f-1e74-4e4c-933f-5917f72aa801 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: f84aa405-baed-4bb8-84db-ab3592929c8a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:34:43.674561 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b599388f-1e74-4e4c-933f-5917f72aa801 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:43.675424 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b599388f-1e74-4e4c-933f-5917f72aa801 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:43.675956 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b599388f-1e74-4e4c-933f-5917f72aa801 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:43.676854 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b599388f-1e74-4e4c-933f-5917f72aa801 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:43.677338 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b599388f-1e74-4e4c-933f-5917f72aa801 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:43.677785 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b599388f-1e74-4e4c-933f-5917f72aa801 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:43.839463 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-b599388f-1e74-4e4c-933f-5917f72aa801 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:43.849991 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-b599388f-1e74-4e4c-933f-5917f72aa801 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:43.851551 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-b599388f-1e74-4e4c-933f-5917f72aa801 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:43.852955 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-b599388f-1e74-4e4c-933f-5917f72aa801 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a" status: 200 len: 1740 microversion: 2.20 time: 0.192797 Sep 27 17:34:43.853716 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 475/974] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:34:43 2022] GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a => generated 1740 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:34:44.883814 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-f541ccc6-24d3-4e87-bb3b-7794099ac8a1 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:34:44.884420 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-f541ccc6-24d3-4e87-bb3b-7794099ac8a1 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: f84aa405-baed-4bb8-84db-ab3592929c8a] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:34:44.893676 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f541ccc6-24d3-4e87-bb3b-7794099ac8a1 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:44.894985 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f541ccc6-24d3-4e87-bb3b-7794099ac8a1 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:44.895480 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f541ccc6-24d3-4e87-bb3b-7794099ac8a1 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:44.897077 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f541ccc6-24d3-4e87-bb3b-7794099ac8a1 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:44.897539 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f541ccc6-24d3-4e87-bb3b-7794099ac8a1 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:44.897967 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f541ccc6-24d3-4e87-bb3b-7794099ac8a1 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:45.065756 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-f541ccc6-24d3-4e87-bb3b-7794099ac8a1 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:45.077448 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-f541ccc6-24d3-4e87-bb3b-7794099ac8a1 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:45.079483 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-f541ccc6-24d3-4e87-bb3b-7794099ac8a1 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:45.080664 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-f541ccc6-24d3-4e87-bb3b-7794099ac8a1 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a" status: 200 len: 1740 microversion: 2.20 time: 0.202401 Sep 27 17:34:45.081218 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 500/975] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:34:44 2022] GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a => generated 1740 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:34:46.106733 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-abc0b39e-b761-4249-b999-f8033e3147da tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:34:46.107356 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-abc0b39e-b761-4249-b999-f8033e3147da tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: f84aa405-baed-4bb8-84db-ab3592929c8a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:34:46.114568 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-abc0b39e-b761-4249-b999-f8033e3147da tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:46.115054 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-abc0b39e-b761-4249-b999-f8033e3147da tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:46.115727 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-abc0b39e-b761-4249-b999-f8033e3147da tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:46.116429 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-abc0b39e-b761-4249-b999-f8033e3147da tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:46.116891 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-abc0b39e-b761-4249-b999-f8033e3147da tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:46.117317 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-abc0b39e-b761-4249-b999-f8033e3147da tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:46.261186 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-abc0b39e-b761-4249-b999-f8033e3147da tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:46.269856 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-abc0b39e-b761-4249-b999-f8033e3147da tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:46.271357 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-abc0b39e-b761-4249-b999-f8033e3147da tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:46.272561 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-abc0b39e-b761-4249-b999-f8033e3147da tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a" status: 200 len: 1740 microversion: 2.20 time: 0.170366 Sep 27 17:34:46.273277 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 476/976] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:34:46 2022] GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a => generated 1740 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:34:47.299117 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-a1361f90-b9fb-488e-a4e0-e865993030c6 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:34:47.300665 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-a1361f90-b9fb-488e-a4e0-e865993030c6 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: f84aa405-baed-4bb8-84db-ab3592929c8a] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:34:47.321620 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a1361f90-b9fb-488e-a4e0-e865993030c6 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:47.322340 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a1361f90-b9fb-488e-a4e0-e865993030c6 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:47.322932 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a1361f90-b9fb-488e-a4e0-e865993030c6 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:47.323794 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a1361f90-b9fb-488e-a4e0-e865993030c6 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:47.324410 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a1361f90-b9fb-488e-a4e0-e865993030c6 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:47.324989 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a1361f90-b9fb-488e-a4e0-e865993030c6 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:47.491834 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-a1361f90-b9fb-488e-a4e0-e865993030c6 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:47.501558 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-a1361f90-b9fb-488e-a4e0-e865993030c6 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:47.503157 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-a1361f90-b9fb-488e-a4e0-e865993030c6 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:47.504463 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-a1361f90-b9fb-488e-a4e0-e865993030c6 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a" status: 200 len: 1740 microversion: 2.20 time: 0.210506 Sep 27 17:34:47.505334 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 501/977] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:34:47 2022] GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a => generated 1740 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:34:48.532277 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-d8d629b4-c8d7-47bc-bb8f-e39999ebb3eb tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:34:48.532882 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-d8d629b4-c8d7-47bc-bb8f-e39999ebb3eb tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: f84aa405-baed-4bb8-84db-ab3592929c8a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:34:48.535320 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_api:SELECT=28 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:34:48.540550 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d8d629b4-c8d7-47bc-bb8f-e39999ebb3eb tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:48.541028 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d8d629b4-c8d7-47bc-bb8f-e39999ebb3eb tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:48.541457 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d8d629b4-c8d7-47bc-bb8f-e39999ebb3eb tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:48.542171 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d8d629b4-c8d7-47bc-bb8f-e39999ebb3eb tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:48.542629 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d8d629b4-c8d7-47bc-bb8f-e39999ebb3eb tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:48.543042 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d8d629b4-c8d7-47bc-bb8f-e39999ebb3eb tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:48.546503 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell1:SELECT=80 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:34:48.675347 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-d8d629b4-c8d7-47bc-bb8f-e39999ebb3eb tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:48.683611 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-d8d629b4-c8d7-47bc-bb8f-e39999ebb3eb tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:48.686367 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-d8d629b4-c8d7-47bc-bb8f-e39999ebb3eb tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:48.687772 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-d8d629b4-c8d7-47bc-bb8f-e39999ebb3eb tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a" status: 200 len: 1740 microversion: 2.20 time: 0.159467 Sep 27 17:34:48.689431 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 477/978] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:34:48 2022] GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a => generated 1740 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:34:49.714564 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-42623dee-e12b-4f7e-aa81-6c12d113d78b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:34:49.715193 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-42623dee-e12b-4f7e-aa81-6c12d113d78b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: f84aa405-baed-4bb8-84db-ab3592929c8a] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:34:49.717514 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_api:SELECT=26 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:34:49.723351 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-42623dee-e12b-4f7e-aa81-6c12d113d78b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:49.723837 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-42623dee-e12b-4f7e-aa81-6c12d113d78b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:49.724271 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-42623dee-e12b-4f7e-aa81-6c12d113d78b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:49.724965 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-42623dee-e12b-4f7e-aa81-6c12d113d78b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:49.725449 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-42623dee-e12b-4f7e-aa81-6c12d113d78b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:49.725872 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-42623dee-e12b-4f7e-aa81-6c12d113d78b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:49.728721 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_cell1:SELECT=78 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:34:49.862565 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-42623dee-e12b-4f7e-aa81-6c12d113d78b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:49.870745 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-42623dee-e12b-4f7e-aa81-6c12d113d78b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:49.872192 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-42623dee-e12b-4f7e-aa81-6c12d113d78b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:49.873341 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-42623dee-e12b-4f7e-aa81-6c12d113d78b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a" status: 200 len: 1722 microversion: 2.20 time: 0.162858 Sep 27 17:34:49.873892 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 502/979] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:34:49 2022] GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:34:50.899395 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-e6585939-7ca7-49cb-ad76-7c9d501d16d5 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:34:50.900003 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-e6585939-7ca7-49cb-ad76-7c9d501d16d5 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: f84aa405-baed-4bb8-84db-ab3592929c8a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:34:50.906468 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e6585939-7ca7-49cb-ad76-7c9d501d16d5 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:50.906951 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e6585939-7ca7-49cb-ad76-7c9d501d16d5 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:50.907390 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e6585939-7ca7-49cb-ad76-7c9d501d16d5 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:50.908077 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e6585939-7ca7-49cb-ad76-7c9d501d16d5 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:50.908531 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e6585939-7ca7-49cb-ad76-7c9d501d16d5 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:50.908954 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e6585939-7ca7-49cb-ad76-7c9d501d16d5 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:51.038658 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-e6585939-7ca7-49cb-ad76-7c9d501d16d5 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:51.046615 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-e6585939-7ca7-49cb-ad76-7c9d501d16d5 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:51.048588 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-e6585939-7ca7-49cb-ad76-7c9d501d16d5 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:51.049745 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-e6585939-7ca7-49cb-ad76-7c9d501d16d5 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a" status: 200 len: 1722 microversion: 2.20 time: 0.154270 Sep 27 17:34:51.050353 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 478/980] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:34:50 2022] GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:34:51.388853 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [req-6c999348-718c-445f-bf0e-6d6ccc613016 req-b4b3a3fb-c310-4882-92e9-a1b02eadd76b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f84aa405-baed-4bb8-84db-ab3592929c8a", "name": "network-vif-unplugged", "status": "completed", "tag": "44bdfd6c-6234-47ec-8359-4819b713d0a5"}]} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:34:51.399311 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-6c999348-718c-445f-bf0e-6d6ccc613016 req-b4b3a3fb-c310-4882-92e9-a1b02eadd76b service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:51.399786 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-6c999348-718c-445f-bf0e-6d6ccc613016 req-b4b3a3fb-c310-4882-92e9-a1b02eadd76b service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:51.400345 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-6c999348-718c-445f-bf0e-6d6ccc613016 req-b4b3a3fb-c310-4882-92e9-a1b02eadd76b service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:51.411661 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.compute.server_external_events [req-6c999348-718c-445f-bf0e-6d6ccc613016 req-b4b3a3fb-c310-4882-92e9-a1b02eadd76b service nova] Creating event network-vif-unplugged:44bdfd6c-6234-47ec-8359-4819b713d0a5 for instance f84aa405-baed-4bb8-84db-ab3592929c8a on hv-cinder-84914 Sep 27 17:34:51.416601 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [req-6c999348-718c-445f-bf0e-6d6ccc613016 req-b4b3a3fb-c310-4882-92e9-a1b02eadd76b service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031493 Sep 27 17:34:51.417178 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 503/981] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:34:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:34:52.075432 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-736974d9-342d-4f5c-b7a1-47d02c1fdd59 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:34:52.076084 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-736974d9-342d-4f5c-b7a1-47d02c1fdd59 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: f84aa405-baed-4bb8-84db-ab3592929c8a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:34:52.083017 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-736974d9-342d-4f5c-b7a1-47d02c1fdd59 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:52.083494 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-736974d9-342d-4f5c-b7a1-47d02c1fdd59 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:52.083925 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-736974d9-342d-4f5c-b7a1-47d02c1fdd59 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:52.084734 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-736974d9-342d-4f5c-b7a1-47d02c1fdd59 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:52.085274 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-736974d9-342d-4f5c-b7a1-47d02c1fdd59 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:52.085596 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-736974d9-342d-4f5c-b7a1-47d02c1fdd59 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:52.215556 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-736974d9-342d-4f5c-b7a1-47d02c1fdd59 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:52.223570 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-736974d9-342d-4f5c-b7a1-47d02c1fdd59 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:52.225005 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-736974d9-342d-4f5c-b7a1-47d02c1fdd59 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:52.226239 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-736974d9-342d-4f5c-b7a1-47d02c1fdd59 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a" status: 200 len: 1725 microversion: 2.20 time: 0.154619 Sep 27 17:34:52.226790 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 479/982] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:34:52 2022] GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:34:52.253060 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-df8cfd21-6e8d-466d-98c4-6b3f6d25f67f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "563a512f-2a84-4cd7-a404-65985713d9fa"}} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:34:52.255565 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-df8cfd21-6e8d-466d-98c4-6b3f6d25f67f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: f84aa405-baed-4bb8-84db-ab3592929c8a] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:34:52.261553 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-df8cfd21-6e8d-466d-98c4-6b3f6d25f67f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:52.262110 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-df8cfd21-6e8d-466d-98c4-6b3f6d25f67f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:52.262558 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-df8cfd21-6e8d-466d-98c4-6b3f6d25f67f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:52.263240 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-df8cfd21-6e8d-466d-98c4-6b3f6d25f67f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:52.263693 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-df8cfd21-6e8d-466d-98c4-6b3f6d25f67f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:52.264114 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-df8cfd21-6e8d-466d-98c4-6b3f6d25f67f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:52.543005 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-df8cfd21-6e8d-466d-98c4-6b3f6d25f67f tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "POST /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.294854 Sep 27 17:34:52.543651 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 504/983] 10.222.0.55 () {62 vars in 1364 bytes} [Tue Sep 27 17:34:52 2022] POST /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a/os-volume_attachments => generated 188 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 27 17:34:52.667618 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-241b8c9b-237b-4efd-bfad-de1291907413 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:34:52.668106 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-241b8c9b-237b-4efd-bfad-de1291907413 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: f84aa405-baed-4bb8-84db-ab3592929c8a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:34:52.674690 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-241b8c9b-237b-4efd-bfad-de1291907413 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:52.675183 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-241b8c9b-237b-4efd-bfad-de1291907413 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:52.675597 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-241b8c9b-237b-4efd-bfad-de1291907413 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:52.676273 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-241b8c9b-237b-4efd-bfad-de1291907413 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:52.676721 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-241b8c9b-237b-4efd-bfad-de1291907413 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:52.677145 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-241b8c9b-237b-4efd-bfad-de1291907413 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:52.915721 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-241b8c9b-237b-4efd-bfad-de1291907413 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "DELETE /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a/os-volume_attachments/563a512f-2a84-4cd7-a404-65985713d9fa" status: 202 len: 0 microversion: 2.20 time: 0.251904 Sep 27 17:34:52.916327 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 480/984] 10.222.0.55 () {60 vars in 1457 bytes} [Tue Sep 27 17:34:52 2022] DELETE /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a/os-volume_attachments/563a512f-2a84-4cd7-a404-65985713d9fa => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 27 17:34:52.979939 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-dfd72e60-f9c9-4f36-965c-d09706d56cb5 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:34:52.980459 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-dfd72e60-f9c9-4f36-965c-d09706d56cb5 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: f84aa405-baed-4bb8-84db-ab3592929c8a] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:34:52.986606 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-dfd72e60-f9c9-4f36-965c-d09706d56cb5 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:52.987079 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-dfd72e60-f9c9-4f36-965c-d09706d56cb5 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:52.987531 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-dfd72e60-f9c9-4f36-965c-d09706d56cb5 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:52.988202 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-dfd72e60-f9c9-4f36-965c-d09706d56cb5 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:52.988646 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-dfd72e60-f9c9-4f36-965c-d09706d56cb5 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:52.989058 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-dfd72e60-f9c9-4f36-965c-d09706d56cb5 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:53.019287 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-dfd72e60-f9c9-4f36-965c-d09706d56cb5 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: f84aa405-baed-4bb8-84db-ab3592929c8a] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120416) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 27 17:34:53.081913 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-dfd72e60-f9c9-4f36-965c-d09706d56cb5 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "POST /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a/action" status: 202 len: 0 microversion: 2.20 time: 0.105858 Sep 27 17:34:53.082603 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 505/985] 10.222.0.55 () {62 vars in 1319 bytes} [Tue Sep 27 17:34:52 2022] POST /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 27 17:34:53.091219 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-51575e6a-384b-4256-93f8-8e7ddf08968b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:34:53.091834 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-51575e6a-384b-4256-93f8-8e7ddf08968b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: f84aa405-baed-4bb8-84db-ab3592929c8a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:34:53.098943 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-51575e6a-384b-4256-93f8-8e7ddf08968b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:53.099429 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-51575e6a-384b-4256-93f8-8e7ddf08968b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:53.099870 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-51575e6a-384b-4256-93f8-8e7ddf08968b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:53.100760 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-51575e6a-384b-4256-93f8-8e7ddf08968b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:53.101217 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-51575e6a-384b-4256-93f8-8e7ddf08968b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:53.101830 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-51575e6a-384b-4256-93f8-8e7ddf08968b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:53.238745 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-51575e6a-384b-4256-93f8-8e7ddf08968b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:53.247259 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-51575e6a-384b-4256-93f8-8e7ddf08968b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:53.248703 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-51575e6a-384b-4256-93f8-8e7ddf08968b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:53.249901 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-51575e6a-384b-4256-93f8-8e7ddf08968b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a" status: 200 len: 1673 microversion: 2.20 time: 0.162695 Sep 27 17:34:53.250838 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 481/986] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:34:53 2022] GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a => generated 1673 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:34:54.276069 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-29b0bca7-a1b4-4746-bdda-8724d799dca9 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:34:54.277366 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-29b0bca7-a1b4-4746-bdda-8724d799dca9 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: f84aa405-baed-4bb8-84db-ab3592929c8a] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:34:54.283749 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-29b0bca7-a1b4-4746-bdda-8724d799dca9 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:54.284256 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-29b0bca7-a1b4-4746-bdda-8724d799dca9 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:54.284693 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-29b0bca7-a1b4-4746-bdda-8724d799dca9 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:54.285384 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-29b0bca7-a1b4-4746-bdda-8724d799dca9 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:54.285838 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-29b0bca7-a1b4-4746-bdda-8724d799dca9 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:54.286289 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-29b0bca7-a1b4-4746-bdda-8724d799dca9 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:54.429802 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-29b0bca7-a1b4-4746-bdda-8724d799dca9 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:54.439038 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-29b0bca7-a1b4-4746-bdda-8724d799dca9 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:54.441219 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-29b0bca7-a1b4-4746-bdda-8724d799dca9 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:54.442415 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-29b0bca7-a1b4-4746-bdda-8724d799dca9 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a" status: 200 len: 1731 microversion: 2.20 time: 0.170339 Sep 27 17:34:54.446229 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 506/987] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:34:54 2022] GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a => generated 1731 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:34:55.468622 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-3e9f242d-9893-469c-b4b2-5ba836afb162 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:34:55.469235 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-3e9f242d-9893-469c-b4b2-5ba836afb162 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: f84aa405-baed-4bb8-84db-ab3592929c8a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:34:55.475855 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3e9f242d-9893-469c-b4b2-5ba836afb162 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:55.476338 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3e9f242d-9893-469c-b4b2-5ba836afb162 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:55.476772 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3e9f242d-9893-469c-b4b2-5ba836afb162 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:55.477458 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3e9f242d-9893-469c-b4b2-5ba836afb162 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:55.477902 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3e9f242d-9893-469c-b4b2-5ba836afb162 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:55.478342 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3e9f242d-9893-469c-b4b2-5ba836afb162 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:55.611745 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-3e9f242d-9893-469c-b4b2-5ba836afb162 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:55.620269 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-3e9f242d-9893-469c-b4b2-5ba836afb162 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:55.621740 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-3e9f242d-9893-469c-b4b2-5ba836afb162 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:55.622961 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-3e9f242d-9893-469c-b4b2-5ba836afb162 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a" status: 200 len: 1731 microversion: 2.20 time: 0.158705 Sep 27 17:34:55.624019 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 482/988] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:34:55 2022] GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:34:56.653017 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-c8d6161d-47db-434d-961a-2e3133886c6e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:34:56.654586 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-c8d6161d-47db-434d-961a-2e3133886c6e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: f84aa405-baed-4bb8-84db-ab3592929c8a] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:34:56.671589 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c8d6161d-47db-434d-961a-2e3133886c6e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:56.672098 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c8d6161d-47db-434d-961a-2e3133886c6e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:56.672530 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c8d6161d-47db-434d-961a-2e3133886c6e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:56.673254 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c8d6161d-47db-434d-961a-2e3133886c6e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:56.674716 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c8d6161d-47db-434d-961a-2e3133886c6e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:56.675151 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c8d6161d-47db-434d-961a-2e3133886c6e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:56.816464 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-c8d6161d-47db-434d-961a-2e3133886c6e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:56.825025 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-c8d6161d-47db-434d-961a-2e3133886c6e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:56.826520 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-c8d6161d-47db-434d-961a-2e3133886c6e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:56.827677 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-c8d6161d-47db-434d-961a-2e3133886c6e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a" status: 200 len: 1731 microversion: 2.20 time: 0.178810 Sep 27 17:34:56.828237 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 507/989] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:34:56 2022] GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a => generated 1731 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:34:57.854047 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-f150f860-1bf9-432e-a0a8-d21df0da3850 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:34:57.854711 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-f150f860-1bf9-432e-a0a8-d21df0da3850 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: f84aa405-baed-4bb8-84db-ab3592929c8a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:34:57.865163 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f150f860-1bf9-432e-a0a8-d21df0da3850 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:57.865644 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f150f860-1bf9-432e-a0a8-d21df0da3850 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:57.866102 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f150f860-1bf9-432e-a0a8-d21df0da3850 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:57.866816 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f150f860-1bf9-432e-a0a8-d21df0da3850 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:57.867274 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f150f860-1bf9-432e-a0a8-d21df0da3850 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:57.867701 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f150f860-1bf9-432e-a0a8-d21df0da3850 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:57.993746 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-f150f860-1bf9-432e-a0a8-d21df0da3850 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:58.002135 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-f150f860-1bf9-432e-a0a8-d21df0da3850 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:58.004243 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-f150f860-1bf9-432e-a0a8-d21df0da3850 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:58.005578 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-f150f860-1bf9-432e-a0a8-d21df0da3850 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a" status: 200 len: 1731 microversion: 2.20 time: 0.156600 Sep 27 17:34:58.006338 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 483/990] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:34:57 2022] GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:34:59.033053 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-21490151-b9b2-482e-9bb7-1da3177f6e8b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:34:59.033608 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-21490151-b9b2-482e-9bb7-1da3177f6e8b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: f84aa405-baed-4bb8-84db-ab3592929c8a] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:34:59.039523 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-21490151-b9b2-482e-9bb7-1da3177f6e8b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:59.040003 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-21490151-b9b2-482e-9bb7-1da3177f6e8b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:59.040438 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-21490151-b9b2-482e-9bb7-1da3177f6e8b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:59.041121 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-21490151-b9b2-482e-9bb7-1da3177f6e8b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:34:59.041576 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-21490151-b9b2-482e-9bb7-1da3177f6e8b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:34:59.041995 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-21490151-b9b2-482e-9bb7-1da3177f6e8b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:34:59.184501 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-21490151-b9b2-482e-9bb7-1da3177f6e8b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:59.193703 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-21490151-b9b2-482e-9bb7-1da3177f6e8b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:59.195180 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-21490151-b9b2-482e-9bb7-1da3177f6e8b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:34:59.196347 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-21490151-b9b2-482e-9bb7-1da3177f6e8b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a" status: 200 len: 1731 microversion: 2.20 time: 0.167305 Sep 27 17:34:59.196900 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 508/991] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:34:59 2022] GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:35:00.225848 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-6b7d17ac-fec8-40ca-8696-c309752bad39 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:35:00.227510 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-6b7d17ac-fec8-40ca-8696-c309752bad39 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: f84aa405-baed-4bb8-84db-ab3592929c8a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:35:00.235465 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6b7d17ac-fec8-40ca-8696-c309752bad39 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:00.236042 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6b7d17ac-fec8-40ca-8696-c309752bad39 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:00.236559 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6b7d17ac-fec8-40ca-8696-c309752bad39 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:00.237349 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6b7d17ac-fec8-40ca-8696-c309752bad39 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:00.237881 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6b7d17ac-fec8-40ca-8696-c309752bad39 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:00.238409 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6b7d17ac-fec8-40ca-8696-c309752bad39 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:00.392997 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-6b7d17ac-fec8-40ca-8696-c309752bad39 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:35:00.401869 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-6b7d17ac-fec8-40ca-8696-c309752bad39 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:35:00.403358 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-6b7d17ac-fec8-40ca-8696-c309752bad39 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:35:00.404553 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-6b7d17ac-fec8-40ca-8696-c309752bad39 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a" status: 200 len: 1731 microversion: 2.20 time: 0.185137 Sep 27 17:35:00.405113 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 484/992] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:35:00 2022] GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a => generated 1731 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 17:35:01.435285 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-318976f6-7363-40ab-9dbf-c247707fc80d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:35:01.435913 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-318976f6-7363-40ab-9dbf-c247707fc80d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: f84aa405-baed-4bb8-84db-ab3592929c8a] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:35:01.441943 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-318976f6-7363-40ab-9dbf-c247707fc80d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:01.442451 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-318976f6-7363-40ab-9dbf-c247707fc80d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:01.442892 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-318976f6-7363-40ab-9dbf-c247707fc80d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:01.443569 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-318976f6-7363-40ab-9dbf-c247707fc80d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:01.444021 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-318976f6-7363-40ab-9dbf-c247707fc80d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:01.444439 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-318976f6-7363-40ab-9dbf-c247707fc80d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:01.583477 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-318976f6-7363-40ab-9dbf-c247707fc80d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:35:01.591835 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-318976f6-7363-40ab-9dbf-c247707fc80d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:35:01.593376 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-318976f6-7363-40ab-9dbf-c247707fc80d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:35:01.594560 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-318976f6-7363-40ab-9dbf-c247707fc80d tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a" status: 200 len: 1731 microversion: 2.20 time: 0.163262 Sep 27 17:35:01.595369 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 509/993] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:35:01 2022] GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a => generated 1731 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 17:35:02.619976 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-0b2b4896-fabe-426c-9b6c-f87e342f43a4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:35:02.620636 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-0b2b4896-fabe-426c-9b6c-f87e342f43a4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: f84aa405-baed-4bb8-84db-ab3592929c8a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:35:02.627205 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0b2b4896-fabe-426c-9b6c-f87e342f43a4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:02.627686 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0b2b4896-fabe-426c-9b6c-f87e342f43a4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:02.628236 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0b2b4896-fabe-426c-9b6c-f87e342f43a4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:02.628989 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0b2b4896-fabe-426c-9b6c-f87e342f43a4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:02.629448 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0b2b4896-fabe-426c-9b6c-f87e342f43a4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:02.630086 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0b2b4896-fabe-426c-9b6c-f87e342f43a4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:02.789733 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-0b2b4896-fabe-426c-9b6c-f87e342f43a4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:35:02.797848 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-0b2b4896-fabe-426c-9b6c-f87e342f43a4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:35:02.799331 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-0b2b4896-fabe-426c-9b6c-f87e342f43a4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:35:02.800610 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-0b2b4896-fabe-426c-9b6c-f87e342f43a4 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a" status: 200 len: 1731 microversion: 2.20 time: 0.184639 Sep 27 17:35:02.801173 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 485/994] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:35:02 2022] GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a => generated 1731 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:35:03.825787 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-203842ef-350a-4e9e-acd0-4c8ea1c572bd tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:35:03.826477 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-203842ef-350a-4e9e-acd0-4c8ea1c572bd tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: f84aa405-baed-4bb8-84db-ab3592929c8a] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:35:03.833081 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-203842ef-350a-4e9e-acd0-4c8ea1c572bd tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:03.833561 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-203842ef-350a-4e9e-acd0-4c8ea1c572bd tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:03.833993 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-203842ef-350a-4e9e-acd0-4c8ea1c572bd tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:03.834709 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-203842ef-350a-4e9e-acd0-4c8ea1c572bd tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:03.835159 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-203842ef-350a-4e9e-acd0-4c8ea1c572bd tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:03.835584 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-203842ef-350a-4e9e-acd0-4c8ea1c572bd tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:03.958518 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-203842ef-350a-4e9e-acd0-4c8ea1c572bd tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:35:03.966943 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-203842ef-350a-4e9e-acd0-4c8ea1c572bd tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:35:03.968400 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-203842ef-350a-4e9e-acd0-4c8ea1c572bd tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:35:03.969549 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-203842ef-350a-4e9e-acd0-4c8ea1c572bd tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a" status: 200 len: 1731 microversion: 2.20 time: 0.147637 Sep 27 17:35:03.970137 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 510/995] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:35:03 2022] GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a => generated 1731 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:35:04.996778 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-efb75112-f7cc-470f-bce2-5c3d6738e862 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:35:04.997563 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-efb75112-f7cc-470f-bce2-5c3d6738e862 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: f84aa405-baed-4bb8-84db-ab3592929c8a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:35:05.004506 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-efb75112-f7cc-470f-bce2-5c3d6738e862 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:05.004996 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-efb75112-f7cc-470f-bce2-5c3d6738e862 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:05.005511 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-efb75112-f7cc-470f-bce2-5c3d6738e862 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:05.006301 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-efb75112-f7cc-470f-bce2-5c3d6738e862 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:05.006788 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-efb75112-f7cc-470f-bce2-5c3d6738e862 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:05.007213 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-efb75112-f7cc-470f-bce2-5c3d6738e862 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:05.160145 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-efb75112-f7cc-470f-bce2-5c3d6738e862 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:35:05.168204 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-efb75112-f7cc-470f-bce2-5c3d6738e862 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:35:05.169671 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-efb75112-f7cc-470f-bce2-5c3d6738e862 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:35:05.170850 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-efb75112-f7cc-470f-bce2-5c3d6738e862 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a" status: 200 len: 1731 microversion: 2.20 time: 0.178074 Sep 27 17:35:05.171403 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 486/996] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:35:04 2022] GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a => generated 1731 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:35:06.196016 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-ce1fae65-b4cd-4b47-adba-0dbea35e49c9 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:35:06.196554 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-ce1fae65-b4cd-4b47-adba-0dbea35e49c9 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: f84aa405-baed-4bb8-84db-ab3592929c8a] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:35:06.202387 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ce1fae65-b4cd-4b47-adba-0dbea35e49c9 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:06.202854 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ce1fae65-b4cd-4b47-adba-0dbea35e49c9 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:06.203279 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ce1fae65-b4cd-4b47-adba-0dbea35e49c9 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:06.203944 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ce1fae65-b4cd-4b47-adba-0dbea35e49c9 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:06.204385 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ce1fae65-b4cd-4b47-adba-0dbea35e49c9 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:06.204802 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ce1fae65-b4cd-4b47-adba-0dbea35e49c9 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:06.330583 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-ce1fae65-b4cd-4b47-adba-0dbea35e49c9 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:35:06.338542 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-ce1fae65-b4cd-4b47-adba-0dbea35e49c9 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:35:06.340013 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-ce1fae65-b4cd-4b47-adba-0dbea35e49c9 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:35:06.341144 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-ce1fae65-b4cd-4b47-adba-0dbea35e49c9 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a" status: 200 len: 1731 microversion: 2.20 time: 0.149059 Sep 27 17:35:06.341694 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 511/997] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:35:06 2022] GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a => generated 1731 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:35:07.366616 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-27eaf7fc-b581-4504-94b9-825163813d4b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:35:07.367227 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-27eaf7fc-b581-4504-94b9-825163813d4b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: f84aa405-baed-4bb8-84db-ab3592929c8a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:35:07.373568 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-27eaf7fc-b581-4504-94b9-825163813d4b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:07.374058 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-27eaf7fc-b581-4504-94b9-825163813d4b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:07.374535 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-27eaf7fc-b581-4504-94b9-825163813d4b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:07.375223 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-27eaf7fc-b581-4504-94b9-825163813d4b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:07.375688 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-27eaf7fc-b581-4504-94b9-825163813d4b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:07.376105 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-27eaf7fc-b581-4504-94b9-825163813d4b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:07.500947 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-27eaf7fc-b581-4504-94b9-825163813d4b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:35:07.509854 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-27eaf7fc-b581-4504-94b9-825163813d4b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:35:07.511283 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-27eaf7fc-b581-4504-94b9-825163813d4b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:35:07.512441 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-27eaf7fc-b581-4504-94b9-825163813d4b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a" status: 200 len: 1731 microversion: 2.20 time: 0.149873 Sep 27 17:35:07.513003 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 487/998] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:35:07 2022] GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:35:08.538449 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-cc11c28a-9dfe-4476-a28a-66085daea632 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:35:08.539042 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-cc11c28a-9dfe-4476-a28a-66085daea632 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: f84aa405-baed-4bb8-84db-ab3592929c8a] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:35:08.544847 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-cc11c28a-9dfe-4476-a28a-66085daea632 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:08.545323 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-cc11c28a-9dfe-4476-a28a-66085daea632 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:08.545753 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-cc11c28a-9dfe-4476-a28a-66085daea632 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:08.546532 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-cc11c28a-9dfe-4476-a28a-66085daea632 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:08.546981 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-cc11c28a-9dfe-4476-a28a-66085daea632 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:08.547402 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-cc11c28a-9dfe-4476-a28a-66085daea632 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:08.682698 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-cc11c28a-9dfe-4476-a28a-66085daea632 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:35:08.691385 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-cc11c28a-9dfe-4476-a28a-66085daea632 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:35:08.692828 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-cc11c28a-9dfe-4476-a28a-66085daea632 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:35:08.693972 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-cc11c28a-9dfe-4476-a28a-66085daea632 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a" status: 200 len: 1731 microversion: 2.20 time: 0.159491 Sep 27 17:35:08.694568 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 512/999] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:35:08 2022] GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:35:09.719144 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-0136d492-22c7-4005-a887-585b5eb3ec18 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:35:09.719785 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-0136d492-22c7-4005-a887-585b5eb3ec18 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: f84aa405-baed-4bb8-84db-ab3592929c8a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:35:09.726241 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0136d492-22c7-4005-a887-585b5eb3ec18 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:09.726746 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0136d492-22c7-4005-a887-585b5eb3ec18 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:09.727184 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0136d492-22c7-4005-a887-585b5eb3ec18 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:09.727864 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0136d492-22c7-4005-a887-585b5eb3ec18 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:09.728314 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0136d492-22c7-4005-a887-585b5eb3ec18 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:09.728732 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0136d492-22c7-4005-a887-585b5eb3ec18 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:09.855665 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-0136d492-22c7-4005-a887-585b5eb3ec18 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:35:09.864491 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-0136d492-22c7-4005-a887-585b5eb3ec18 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:35:09.865925 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-0136d492-22c7-4005-a887-585b5eb3ec18 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:35:09.867114 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-0136d492-22c7-4005-a887-585b5eb3ec18 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a" status: 200 len: 1731 microversion: 2.20 time: 0.151937 Sep 27 17:35:09.867664 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 488/1000] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:35:09 2022] GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:35:10.891752 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-bb08f9b6-56a7-415d-92c5-7dbce3227b7b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:35:10.892360 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-bb08f9b6-56a7-415d-92c5-7dbce3227b7b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: f84aa405-baed-4bb8-84db-ab3592929c8a] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:35:10.898935 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-bb08f9b6-56a7-415d-92c5-7dbce3227b7b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:10.899416 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-bb08f9b6-56a7-415d-92c5-7dbce3227b7b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:10.899860 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-bb08f9b6-56a7-415d-92c5-7dbce3227b7b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:10.900539 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-bb08f9b6-56a7-415d-92c5-7dbce3227b7b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:10.900990 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-bb08f9b6-56a7-415d-92c5-7dbce3227b7b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:10.901412 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-bb08f9b6-56a7-415d-92c5-7dbce3227b7b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:11.032424 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-bb08f9b6-56a7-415d-92c5-7dbce3227b7b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:35:11.040404 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-bb08f9b6-56a7-415d-92c5-7dbce3227b7b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:35:11.041850 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-bb08f9b6-56a7-415d-92c5-7dbce3227b7b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:35:11.043033 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-bb08f9b6-56a7-415d-92c5-7dbce3227b7b tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a" status: 200 len: 1731 microversion: 2.20 time: 0.155195 Sep 27 17:35:11.043593 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 513/1001] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:35:10 2022] GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:35:12.069590 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-a78879a3-9286-473a-8442-7282e9e25d34 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:35:12.070245 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-a78879a3-9286-473a-8442-7282e9e25d34 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: f84aa405-baed-4bb8-84db-ab3592929c8a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:35:12.076629 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a78879a3-9286-473a-8442-7282e9e25d34 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:12.077108 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a78879a3-9286-473a-8442-7282e9e25d34 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:12.077544 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a78879a3-9286-473a-8442-7282e9e25d34 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:12.078267 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a78879a3-9286-473a-8442-7282e9e25d34 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:12.078724 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a78879a3-9286-473a-8442-7282e9e25d34 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:12.079150 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a78879a3-9286-473a-8442-7282e9e25d34 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:12.205754 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-a78879a3-9286-473a-8442-7282e9e25d34 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:35:12.214426 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-a78879a3-9286-473a-8442-7282e9e25d34 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:35:12.216058 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-a78879a3-9286-473a-8442-7282e9e25d34 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:35:12.217481 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-a78879a3-9286-473a-8442-7282e9e25d34 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a" status: 200 len: 1731 microversion: 2.20 time: 0.152314 Sep 27 17:35:12.218216 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 489/1002] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:35:12 2022] GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:35:13.242368 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-6f5128a6-6ac4-4ef5-a95e-b5ebb05f6de8 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:35:13.242965 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-6f5128a6-6ac4-4ef5-a95e-b5ebb05f6de8 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: f84aa405-baed-4bb8-84db-ab3592929c8a] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:35:13.248949 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6f5128a6-6ac4-4ef5-a95e-b5ebb05f6de8 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:13.249422 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6f5128a6-6ac4-4ef5-a95e-b5ebb05f6de8 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:13.249848 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6f5128a6-6ac4-4ef5-a95e-b5ebb05f6de8 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:13.250561 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6f5128a6-6ac4-4ef5-a95e-b5ebb05f6de8 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:13.251007 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6f5128a6-6ac4-4ef5-a95e-b5ebb05f6de8 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:13.251426 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6f5128a6-6ac4-4ef5-a95e-b5ebb05f6de8 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:13.392055 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-6f5128a6-6ac4-4ef5-a95e-b5ebb05f6de8 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:35:13.401137 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-6f5128a6-6ac4-4ef5-a95e-b5ebb05f6de8 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:35:13.402645 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-6f5128a6-6ac4-4ef5-a95e-b5ebb05f6de8 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:35:13.403805 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-6f5128a6-6ac4-4ef5-a95e-b5ebb05f6de8 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a" status: 200 len: 1731 microversion: 2.20 time: 0.165414 Sep 27 17:35:13.404361 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 514/1003] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:35:13 2022] GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:35:13.509058 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [req-032ea460-1525-40ca-b2f4-bf8aaf24532f req-c112981c-86da-4021-90ec-dded07d5a1e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f84aa405-baed-4bb8-84db-ab3592929c8a", "name": "network-vif-plugged", "status": "completed", "tag": "44bdfd6c-6234-47ec-8359-4819b713d0a5"}]} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:35:13.519003 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-032ea460-1525-40ca-b2f4-bf8aaf24532f req-c112981c-86da-4021-90ec-dded07d5a1e4 service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:13.519477 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-032ea460-1525-40ca-b2f4-bf8aaf24532f req-c112981c-86da-4021-90ec-dded07d5a1e4 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:13.519973 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-032ea460-1525-40ca-b2f4-bf8aaf24532f req-c112981c-86da-4021-90ec-dded07d5a1e4 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:13.531572 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.compute.server_external_events [req-032ea460-1525-40ca-b2f4-bf8aaf24532f req-c112981c-86da-4021-90ec-dded07d5a1e4 service nova] Creating event network-vif-plugged:44bdfd6c-6234-47ec-8359-4819b713d0a5 for instance f84aa405-baed-4bb8-84db-ab3592929c8a on hv-cinder-84914 Sep 27 17:35:13.536466 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [req-032ea460-1525-40ca-b2f4-bf8aaf24532f req-c112981c-86da-4021-90ec-dded07d5a1e4 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031760 Sep 27 17:35:13.537060 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 490/1004] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:35:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:35:13.970631 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-e3171998-3635-4783-bd7d-239806fbf6cf tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:35:13.971132 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-e3171998-3635-4783-bd7d-239806fbf6cf tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: ce5f26c2-638d-4baf-9ccb-ba578b97cfc1] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:35:13.976933 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e3171998-3635-4783-bd7d-239806fbf6cf tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:13.977415 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e3171998-3635-4783-bd7d-239806fbf6cf tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:13.977851 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e3171998-3635-4783-bd7d-239806fbf6cf tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:13.978569 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e3171998-3635-4783-bd7d-239806fbf6cf tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:13.979025 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e3171998-3635-4783-bd7d-239806fbf6cf tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:13.979455 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e3171998-3635-4783-bd7d-239806fbf6cf tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:14.004178 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-e3171998-3635-4783-bd7d-239806fbf6cf tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/ce5f26c2-638d-4baf-9ccb-ba578b97cfc1/ips" status: 200 len: 148 microversion: 2.1 time: 0.037547 Sep 27 17:35:14.006031 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 515/1005] 10.222.0.55 () {58 vars in 1248 bytes} [Tue Sep 27 17:35:13 2022] GET /compute/v2.1/servers/ce5f26c2-638d-4baf-9ccb-ba578b97cfc1/ips => generated 148 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:35:14.430943 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-4bc445be-3ce8-48ee-aac5-550aa9135726 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:35:14.431716 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-4bc445be-3ce8-48ee-aac5-550aa9135726 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: f84aa405-baed-4bb8-84db-ab3592929c8a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:35:14.438350 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4bc445be-3ce8-48ee-aac5-550aa9135726 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:14.438836 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4bc445be-3ce8-48ee-aac5-550aa9135726 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:14.439276 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4bc445be-3ce8-48ee-aac5-550aa9135726 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:14.439971 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4bc445be-3ce8-48ee-aac5-550aa9135726 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:14.440429 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4bc445be-3ce8-48ee-aac5-550aa9135726 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:14.440856 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4bc445be-3ce8-48ee-aac5-550aa9135726 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:14.687813 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-4bc445be-3ce8-48ee-aac5-550aa9135726 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:35:14.691359 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:35:14.697572 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-4bc445be-3ce8-48ee-aac5-550aa9135726 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:35:14.699061 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-4bc445be-3ce8-48ee-aac5-550aa9135726 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:35:14.700259 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-4bc445be-3ce8-48ee-aac5-550aa9135726 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a" status: 200 len: 1731 microversion: 2.20 time: 0.273862 Sep 27 17:35:14.700816 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 491/1006] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:35:14 2022] GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a => generated 1731 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:35:14.946755 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-56127787-2e31-49ec-a5b9-b217c91528b1 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:35:14.947276 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-56127787-2e31-49ec-a5b9-b217c91528b1 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] [instance: 8b3855b6-18b1-46de-a1cc-f7a2941a42b9] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:35:14.949822 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [req-d3fb96ac-49fa-499e-a9c5-5fa2e69071c6 req-19a54eb8-86da-457d-8294-abc8ae4be947 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b3855b6-18b1-46de-a1cc-f7a2941a42b9", "tag": "c0932507-0f02-4d95-8195-002c756fdef5"}]} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:35:14.953440 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-56127787-2e31-49ec-a5b9-b217c91528b1 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:14.953930 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-56127787-2e31-49ec-a5b9-b217c91528b1 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:14.954389 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-56127787-2e31-49ec-a5b9-b217c91528b1 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:14.955096 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-56127787-2e31-49ec-a5b9-b217c91528b1 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:14.955548 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-56127787-2e31-49ec-a5b9-b217c91528b1 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:14.956165 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-56127787-2e31-49ec-a5b9-b217c91528b1 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:14.960350 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-d3fb96ac-49fa-499e-a9c5-5fa2e69071c6 req-19a54eb8-86da-457d-8294-abc8ae4be947 service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:14.960526 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:35:14.961259 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-d3fb96ac-49fa-499e-a9c5-5fa2e69071c6 req-19a54eb8-86da-457d-8294-abc8ae4be947 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:14.961706 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-d3fb96ac-49fa-499e-a9c5-5fa2e69071c6 req-19a54eb8-86da-457d-8294-abc8ae4be947 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:14.974257 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.compute.server_external_events [req-d3fb96ac-49fa-499e-a9c5-5fa2e69071c6 req-19a54eb8-86da-457d-8294-abc8ae4be947 service nova] Creating event network-changed:c0932507-0f02-4d95-8195-002c756fdef5 for instance 8b3855b6-18b1-46de-a1cc-f7a2941a42b9 on hv-cinder-84914 Sep 27 17:35:14.979521 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [req-d3fb96ac-49fa-499e-a9c5-5fa2e69071c6 req-19a54eb8-86da-457d-8294-abc8ae4be947 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034909 Sep 27 17:35:14.980204 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 492/1007] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:35:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 17:35:14.986233 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-56127787-2e31-49ec-a5b9-b217c91528b1 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] [instance: 8b3855b6-18b1-46de-a1cc-f7a2941a42b9] Going to try to terminate instance {{(pid=120416) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 17:35:15.072383 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-56127787-2e31-49ec-a5b9-b217c91528b1 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] 10.222.0.55 "DELETE /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9" status: 204 len: 0 microversion: 2.1 time: 0.129970 Sep 27 17:35:15.073344 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 516/1008] 10.222.0.55 () {58 vars in 1239 bytes} [Tue Sep 27 17:35:14 2022] DELETE /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 17:35:15.083909 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-b804400b-a98a-4b66-93ce-ba95612fca52 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:35:15.088140 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-b804400b-a98a-4b66-93ce-ba95612fca52 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] [instance: 8b3855b6-18b1-46de-a1cc-f7a2941a42b9] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:35:15.097228 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b804400b-a98a-4b66-93ce-ba95612fca52 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:15.099102 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b804400b-a98a-4b66-93ce-ba95612fca52 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:15.099737 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b804400b-a98a-4b66-93ce-ba95612fca52 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:15.101370 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b804400b-a98a-4b66-93ce-ba95612fca52 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:15.103133 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b804400b-a98a-4b66-93ce-ba95612fca52 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:15.103764 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b804400b-a98a-4b66-93ce-ba95612fca52 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:15.243405 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-b804400b-a98a-4b66-93ce-ba95612fca52 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5bf070765946168f7e5937f2b076c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890469995c02465eb9b9ad2d1fb9ab6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:35:15.251182 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-b804400b-a98a-4b66-93ce-ba95612fca52 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] 10.222.0.55 "GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9" status: 200 len: 1567 microversion: 2.1 time: 0.173117 Sep 27 17:35:15.252267 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 493/1009] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:35:15 2022] GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9 => generated 1567 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:35:15.353726 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-d3609d4f-7a77-4cdb-a1f6-4420b012807f tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "23feffbb-91bd-4fe2-975e-791c2a5a8123"}} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:35:15.356260 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-d3609d4f-7a77-4cdb-a1f6-4420b012807f tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: ce5f26c2-638d-4baf-9ccb-ba578b97cfc1] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:35:15.362340 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d3609d4f-7a77-4cdb-a1f6-4420b012807f tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:15.362821 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d3609d4f-7a77-4cdb-a1f6-4420b012807f tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:15.363250 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d3609d4f-7a77-4cdb-a1f6-4420b012807f tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:15.364447 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d3609d4f-7a77-4cdb-a1f6-4420b012807f tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:15.364897 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d3609d4f-7a77-4cdb-a1f6-4420b012807f tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:15.365315 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d3609d4f-7a77-4cdb-a1f6-4420b012807f tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:15.726770 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-515ce926-c619-4bdd-9129-c16f10c5cd90 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:35:15.727369 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-515ce926-c619-4bdd-9129-c16f10c5cd90 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: f84aa405-baed-4bb8-84db-ab3592929c8a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:35:15.734007 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-515ce926-c619-4bdd-9129-c16f10c5cd90 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:15.734534 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-515ce926-c619-4bdd-9129-c16f10c5cd90 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:15.734965 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-515ce926-c619-4bdd-9129-c16f10c5cd90 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:15.735666 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-515ce926-c619-4bdd-9129-c16f10c5cd90 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:15.736095 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-515ce926-c619-4bdd-9129-c16f10c5cd90 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:15.736518 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-515ce926-c619-4bdd-9129-c16f10c5cd90 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:15.873261 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-515ce926-c619-4bdd-9129-c16f10c5cd90 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:35:15.881698 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-515ce926-c619-4bdd-9129-c16f10c5cd90 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:35:15.883167 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-515ce926-c619-4bdd-9129-c16f10c5cd90 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:35:15.884329 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-515ce926-c619-4bdd-9129-c16f10c5cd90 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a" status: 200 len: 1731 microversion: 2.20 time: 0.162044 Sep 27 17:35:15.884887 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 494/1010] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:35:15 2022] GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 17:35:16.276427 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-370378c6-4374-4def-b929-20308e8ab4cb tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:35:16.276944 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-370378c6-4374-4def-b929-20308e8ab4cb tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] [instance: 8b3855b6-18b1-46de-a1cc-f7a2941a42b9] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:35:16.283079 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-370378c6-4374-4def-b929-20308e8ab4cb tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:16.283552 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-370378c6-4374-4def-b929-20308e8ab4cb tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:16.283975 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-370378c6-4374-4def-b929-20308e8ab4cb tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:16.284657 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-370378c6-4374-4def-b929-20308e8ab4cb tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:16.285098 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-370378c6-4374-4def-b929-20308e8ab4cb tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:16.285513 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-370378c6-4374-4def-b929-20308e8ab4cb tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:16.415847 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-370378c6-4374-4def-b929-20308e8ab4cb tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5bf070765946168f7e5937f2b076c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890469995c02465eb9b9ad2d1fb9ab6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:35:16.425046 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-370378c6-4374-4def-b929-20308e8ab4cb tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] 10.222.0.55 "GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9" status: 200 len: 1567 microversion: 2.1 time: 0.152482 Sep 27 17:35:16.425999 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 495/1011] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:35:16 2022] GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:35:16.909880 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-ad670ba4-e8a4-4151-9910-f85dfaa102a2 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:35:16.910719 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-ad670ba4-e8a4-4151-9910-f85dfaa102a2 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: f84aa405-baed-4bb8-84db-ab3592929c8a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:35:16.917949 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ad670ba4-e8a4-4151-9910-f85dfaa102a2 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:16.918461 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ad670ba4-e8a4-4151-9910-f85dfaa102a2 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:16.918895 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ad670ba4-e8a4-4151-9910-f85dfaa102a2 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:16.919575 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ad670ba4-e8a4-4151-9910-f85dfaa102a2 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:16.920020 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ad670ba4-e8a4-4151-9910-f85dfaa102a2 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:16.920434 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ad670ba4-e8a4-4151-9910-f85dfaa102a2 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:17.058255 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-ad670ba4-e8a4-4151-9910-f85dfaa102a2 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:35:17.066300 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-ad670ba4-e8a4-4151-9910-f85dfaa102a2 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:35:17.068397 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-ad670ba4-e8a4-4151-9910-f85dfaa102a2 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:35:17.069551 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-ad670ba4-e8a4-4151-9910-f85dfaa102a2 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a" status: 200 len: 1731 microversion: 2.20 time: 0.164005 Sep 27 17:35:17.070131 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 496/1012] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:35:16 2022] GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 17:35:17.452213 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-6f2742ae-3880-4ca3-a63c-8136dd6c8003 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:35:17.452821 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-6f2742ae-3880-4ca3-a63c-8136dd6c8003 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] [instance: 8b3855b6-18b1-46de-a1cc-f7a2941a42b9] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:35:17.459413 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6f2742ae-3880-4ca3-a63c-8136dd6c8003 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:17.459899 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6f2742ae-3880-4ca3-a63c-8136dd6c8003 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:17.460339 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6f2742ae-3880-4ca3-a63c-8136dd6c8003 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:17.461028 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6f2742ae-3880-4ca3-a63c-8136dd6c8003 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:17.461486 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6f2742ae-3880-4ca3-a63c-8136dd6c8003 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:17.461915 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6f2742ae-3880-4ca3-a63c-8136dd6c8003 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:17.600457 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-6f2742ae-3880-4ca3-a63c-8136dd6c8003 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5bf070765946168f7e5937f2b076c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890469995c02465eb9b9ad2d1fb9ab6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:35:17.610583 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-6f2742ae-3880-4ca3-a63c-8136dd6c8003 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] 10.222.0.55 "GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9" status: 200 len: 1567 microversion: 2.1 time: 0.162114 Sep 27 17:35:17.611429 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 497/1013] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:35:17 2022] GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9 => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:35:17.667443 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-d3609d4f-7a77-4cdb-a1f6-4420b012807f tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "POST /compute/v2.1/servers/ce5f26c2-638d-4baf-9ccb-ba578b97cfc1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.318097 Sep 27 17:35:17.668732 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 517/1014] 10.222.0.55 () {60 vars in 1323 bytes} [Tue Sep 27 17:35:15 2022] POST /compute/v2.1/servers/ce5f26c2-638d-4baf-9ccb-ba578b97cfc1/os-volume_attachments => generated 194 bytes in 2320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:35:18.095657 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-ccf5fb44-2053-4a2e-aa56-10dd82f8f9f3 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:35:18.096309 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-ccf5fb44-2053-4a2e-aa56-10dd82f8f9f3 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: f84aa405-baed-4bb8-84db-ab3592929c8a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:35:18.102970 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ccf5fb44-2053-4a2e-aa56-10dd82f8f9f3 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:18.103451 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ccf5fb44-2053-4a2e-aa56-10dd82f8f9f3 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:18.103887 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ccf5fb44-2053-4a2e-aa56-10dd82f8f9f3 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:18.104603 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ccf5fb44-2053-4a2e-aa56-10dd82f8f9f3 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:18.105050 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ccf5fb44-2053-4a2e-aa56-10dd82f8f9f3 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:18.105509 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ccf5fb44-2053-4a2e-aa56-10dd82f8f9f3 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:18.143914 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [req-b3d17a7e-f3c6-4c48-be68-88765a378479 req-da765f99-06ca-4c12-a3aa-dc66557443b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b3855b6-18b1-46de-a1cc-f7a2941a42b9", "name": "network-vif-deleted", "tag": "c0932507-0f02-4d95-8195-002c756fdef5"}]} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:35:18.158181 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-b3d17a7e-f3c6-4c48-be68-88765a378479 req-da765f99-06ca-4c12-a3aa-dc66557443b2 service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:18.158665 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-b3d17a7e-f3c6-4c48-be68-88765a378479 req-da765f99-06ca-4c12-a3aa-dc66557443b2 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:18.159098 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-b3d17a7e-f3c6-4c48-be68-88765a378479 req-da765f99-06ca-4c12-a3aa-dc66557443b2 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:18.171163 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.compute.server_external_events [req-b3d17a7e-f3c6-4c48-be68-88765a378479 req-da765f99-06ca-4c12-a3aa-dc66557443b2 service nova] Creating event network-vif-deleted:c0932507-0f02-4d95-8195-002c756fdef5 for instance 8b3855b6-18b1-46de-a1cc-f7a2941a42b9 on hv-cinder-84914 Sep 27 17:35:18.177786 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [req-b3d17a7e-f3c6-4c48-be68-88765a378479 req-da765f99-06ca-4c12-a3aa-dc66557443b2 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038773 Sep 27 17:35:18.178595 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 518/1015] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:35:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:35:18.253115 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-ccf5fb44-2053-4a2e-aa56-10dd82f8f9f3 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:35:18.261211 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-ccf5fb44-2053-4a2e-aa56-10dd82f8f9f3 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:35:18.262693 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-ccf5fb44-2053-4a2e-aa56-10dd82f8f9f3 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:35:18.263861 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-ccf5fb44-2053-4a2e-aa56-10dd82f8f9f3 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a" status: 200 len: 1718 microversion: 2.20 time: 0.172752 Sep 27 17:35:18.264412 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 498/1016] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:35:18 2022] GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a => generated 1718 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:35:18.635564 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-e82739c0-9557-41cd-9f7d-75693afd3662 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:35:18.636286 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-e82739c0-9557-41cd-9f7d-75693afd3662 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] [instance: 8b3855b6-18b1-46de-a1cc-f7a2941a42b9] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:35:18.642766 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e82739c0-9557-41cd-9f7d-75693afd3662 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:18.643219 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e82739c0-9557-41cd-9f7d-75693afd3662 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:18.643644 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e82739c0-9557-41cd-9f7d-75693afd3662 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:18.644314 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e82739c0-9557-41cd-9f7d-75693afd3662 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:18.644759 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e82739c0-9557-41cd-9f7d-75693afd3662 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:18.645662 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e82739c0-9557-41cd-9f7d-75693afd3662 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:18.705619 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-e82739c0-9557-41cd-9f7d-75693afd3662 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5bf070765946168f7e5937f2b076c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890469995c02465eb9b9ad2d1fb9ab6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:35:18.713980 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-e82739c0-9557-41cd-9f7d-75693afd3662 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] 10.222.0.55 "GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9" status: 200 len: 1218 microversion: 2.1 time: 0.082646 Sep 27 17:35:18.714572 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 519/1017] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:35:18 2022] GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:35:19.737043 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-38d3d04f-8edf-445c-bf34-c164d68b650e tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:35:19.737659 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-38d3d04f-8edf-445c-bf34-c164d68b650e tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] [instance: 8b3855b6-18b1-46de-a1cc-f7a2941a42b9] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:35:19.740799 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_api:SELECT=44 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:35:19.746180 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-38d3d04f-8edf-445c-bf34-c164d68b650e tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:19.746676 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-38d3d04f-8edf-445c-bf34-c164d68b650e tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:19.747131 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-38d3d04f-8edf-445c-bf34-c164d68b650e tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:19.747820 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-38d3d04f-8edf-445c-bf34-c164d68b650e tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:19.748303 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-38d3d04f-8edf-445c-bf34-c164d68b650e tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:19.748692 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-38d3d04f-8edf-445c-bf34-c164d68b650e tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:19.780055 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-38d3d04f-8edf-445c-bf34-c164d68b650e tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:19.780538 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-38d3d04f-8edf-445c-bf34-c164d68b650e tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:19.780974 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-38d3d04f-8edf-445c-bf34-c164d68b650e tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:19.781448 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.objects.instance [None req-38d3d04f-8edf-445c-bf34-c164d68b650e tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lazy-loading 'fault' on Instance uuid 8b3855b6-18b1-46de-a1cc-f7a2941a42b9 {{(pid=120415) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 17:35:19.826838 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-38d3d04f-8edf-445c-bf34-c164d68b650e tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fa5bf070765946168f7e5937f2b076c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '890469995c02465eb9b9ad2d1fb9ab6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:35:19.835302 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-38d3d04f-8edf-445c-bf34-c164d68b650e tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] 10.222.0.55 "GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9" status: 200 len: 1177 microversion: 2.1 time: 0.101831 Sep 27 17:35:19.836270 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 499/1018] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:35:19 2022] GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9 => generated 1177 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:35:20.859429 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-7556daa0-df13-403a-b968-ce0836a52afe tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:35:20.860034 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-7556daa0-df13-403a-b968-ce0836a52afe tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] [instance: 8b3855b6-18b1-46de-a1cc-f7a2941a42b9] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:35:20.862414 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=2 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:35:20.868390 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7556daa0-df13-403a-b968-ce0836a52afe tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:20.868875 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7556daa0-df13-403a-b968-ce0836a52afe tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:20.869311 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7556daa0-df13-403a-b968-ce0836a52afe tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:20.870006 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7556daa0-df13-403a-b968-ce0836a52afe tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:20.870491 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7556daa0-df13-403a-b968-ce0836a52afe tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:20.870917 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7556daa0-df13-403a-b968-ce0836a52afe tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:20.885595 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.wsgi [None req-7556daa0-df13-403a-b968-ce0836a52afe tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] HTTP exception thrown: Instance 8b3855b6-18b1-46de-a1cc-f7a2941a42b9 could not be found. Sep 27 17:35:20.887557 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-7556daa0-df13-403a-b968-ce0836a52afe tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Request method failure captured: Sep 27 17:35:20.887557 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: request: GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9 HTTP/1.1 Sep 27 17:35:20.887557 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Accept: application/json Sep 27 17:35:20.887557 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Accept-Encoding: identity Sep 27 17:35:20.887557 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Connection: close Sep 27 17:35:20.887557 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Content-Length: 0 Sep 27 17:35:20.887557 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Content-Type: application/json Sep 27 17:35:20.887557 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Host: 10.222.0.55 Sep 27 17:35:20.887557 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Openstack-System-Scope: None Sep 27 17:35:20.887557 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: User-Agent: python-urllib3/1.26.12 Sep 27 17:35:20.887557 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Auth-Token: gAAAAABjMzLEGMd4fFor3sW5je9QUEcih6VaHuFQf3hvhMtzwmhI0BEqdIHiSfyfRC_BQmqAoA_IpHKxN3LGuBP3ncPiGnuW5HlJOoa8H1Zh8f62-DZ5foSdBgtU5TsnLJ71_dcrkTOuH-TlPx5pwOp_Qbundpj7fjVG-yc3KqxQQL_GdR07lCY Sep 27 17:35:20.887557 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Domain-Id: None Sep 27 17:35:20.887557 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Domain-Name: None Sep 27 17:35:20.887557 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Identity-Status: Confirmed Sep 27 17:35:20.887557 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Is-Admin-Project: True Sep 27 17:35:20.887557 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Domain-Id: default Sep 27 17:35:20.887557 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Domain-Name: Default Sep 27 17:35:20.887557 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Id: 890469995c02465eb9b9ad2d1fb9ab6f Sep 27 17:35:20.887557 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Name: tempest-TestShelveInstance-1533810519 Sep 27 17:35:20.887557 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Role: reader,member Sep 27 17:35:20.887557 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Roles: reader,member Sep 27 17:35:20.889269 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/890469995c02465eb9b9ad2d1fb9ab6f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_890469995c02465eb9b9ad2d1fb9ab6f", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/890469995c02465eb9b9ad2d1fb9ab6f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/890469995c02465eb9b9ad2d1fb9ab6f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 27 17:35:20.889269 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Tenant: tempest-TestShelveInstance-1533810519 Sep 27 17:35:20.889269 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Tenant-Id: 890469995c02465eb9b9ad2d1fb9ab6f Sep 27 17:35:20.889269 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Tenant-Name: tempest-TestShelveInstance-1533810519 Sep 27 17:35:20.889269 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User: tempest-TestShelveInstance-1533810519-project Sep 27 17:35:20.889269 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Domain-Id: default Sep 27 17:35:20.889269 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Domain-Name: Default Sep 27 17:35:20.889269 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Id: fa5bf070765946168f7e5937f2b076c1 Sep 27 17:35:20.889269 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Name: tempest-TestShelveInstance-1533810519-project Sep 27 17:35:20.889269 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: method: > Sep 27 17:35:20.889269 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: exception: Instance 8b3855b6-18b1-46de-a1cc-f7a2941a42b9 could not be found. Sep 27 17:35:20.889269 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: action_args: {'id': '8b3855b6-18b1-46de-a1cc-f7a2941a42b9'} Sep 27 17:35:20.890196 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 17:35:20.890196 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:35:20.890196 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 17:35:20.890196 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 17:35:20.890196 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 17:35:20.890196 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 17:35:20.890196 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 17:35:20.890196 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 17:35:20.890196 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 17:35:20.890196 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 17:35:20.890196 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b3855b6-18b1-46de-a1cc-f7a2941a42b9 could not be found. Sep 27 17:35:20.890196 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:35:20.890196 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:35:20.890196 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:35:20.890196 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:35:20.890196 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:35:20.890196 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:35:20.890196 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 17:35:20.890196 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 17:35:20.890196 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 17:35:20.891524 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 17:35:20.891524 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 17:35:20.891524 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 17:35:20.891524 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 17:35:20.891524 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 17:35:20.891524 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 17:35:20.891524 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 17:35:20.891524 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b3855b6-18b1-46de-a1cc-f7a2941a42b9 could not be found. Sep 27 17:35:20.891524 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:35:20.891524 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:35:20.891524 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:35:20.891524 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:35:20.891524 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:35:20.891524 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:35:20.891524 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 17:35:20.891524 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 17:35:20.891524 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b3855b6-18b1-46de-a1cc-f7a2941a42b9 could not be found. Sep 27 17:35:20.891524 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:35:20.892753 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-7556daa0-df13-403a-b968-ce0836a52afe tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Returning 404 to user: Instance 8b3855b6-18b1-46de-a1cc-f7a2941a42b9 could not be found. {{(pid=120416) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 17:35:20.892753 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-7556daa0-df13-403a-b968-ce0836a52afe tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] 10.222.0.55 "GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9" status: 404 len: 111 microversion: 2.1 time: 0.034095 Sep 27 17:35:20.892753 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 520/1019] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:35:20 2022] GET /compute/v2.1/servers/8b3855b6-18b1-46de-a1cc-f7a2941a42b9 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 17:35:21.052659 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-2dce11b7-1994-496c-8aa8-6579d6a798a7 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] Calling method '.version_select at 0x7fe724837430>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:35:21.057205 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2dce11b7-1994-496c-8aa8-6579d6a798a7 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] [5efce5e3-d9b1-4962-a58c-9e1bdcb28e0f] AMQP server on 10.222.0.55:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 27 17:35:22.064426 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO oslo.messaging._drivers.impl_rabbit [None req-2dce11b7-1994-496c-8aa8-6579d6a798a7 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] [5efce5e3-d9b1-4962-a58c-9e1bdcb28e0f] Reconnected to AMQP server on 10.222.0.55:5672 via [amqp] client with port 35474. Sep 27 17:35:22.082742 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-2dce11b7-1994-496c-8aa8-6579d6a798a7 tempest-TestShelveInstance-1533810519 tempest-TestShelveInstance-1533810519-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-627906043" status: 202 len: 0 microversion: 2.1 time: 1.034742 Sep 27 17:35:22.083308 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 500/1020] 10.222.0.55 () {58 vars in 1251 bytes} [Tue Sep 27 17:35:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-627906043 => generated 0 bytes in 1036 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 17:35:25.245446 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-f34f162a-a38b-4867-9e99-a99e1c680505 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "23feffbb-91bd-4fe2-975e-791c2a5a8123"}} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:35:25.247795 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-f34f162a-a38b-4867-9e99-a99e1c680505 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: ce5f26c2-638d-4baf-9ccb-ba578b97cfc1] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:35:25.254532 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f34f162a-a38b-4867-9e99-a99e1c680505 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:25.255023 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f34f162a-a38b-4867-9e99-a99e1c680505 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:25.255501 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f34f162a-a38b-4867-9e99-a99e1c680505 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:25.256205 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f34f162a-a38b-4867-9e99-a99e1c680505 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:25.256660 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f34f162a-a38b-4867-9e99-a99e1c680505 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:25.257085 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f34f162a-a38b-4867-9e99-a99e1c680505 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:25.344236 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.wsgi [None req-f34f162a-a38b-4867-9e99-a99e1c680505 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] HTTP exception thrown: Invalid volume: volume 23feffbb-91bd-4fe2-975e-791c2a5a8123 is already attached to instances: ce5f26c2-638d-4baf-9ccb-ba578b97cfc1 Sep 27 17:35:25.345854 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-f34f162a-a38b-4867-9e99-a99e1c680505 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Request method failure captured: Sep 27 17:35:25.345854 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: request: POST /compute/v2.1/servers/ce5f26c2-638d-4baf-9ccb-ba578b97cfc1/os-volume_attachments HTTP/1.1 Sep 27 17:35:25.345854 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Accept: application/json Sep 27 17:35:25.345854 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Accept-Encoding: identity Sep 27 17:35:25.345854 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Connection: close Sep 27 17:35:25.345854 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Content-Length: 74 Sep 27 17:35:25.345854 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Content-Type: application/json Sep 27 17:35:25.345854 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Host: 10.222.0.55 Sep 27 17:35:25.345854 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Openstack-System-Scope: None Sep 27 17:35:25.345854 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: User-Agent: python-urllib3/1.26.12 Sep 27 17:35:25.345854 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Auth-Token: gAAAAABjMzJLbcCEQOqdb7vUsgmB1kYoJEkf6gmC-gBv2tRXmVys19QrTRcPsWXwKEDAq84Zx8Lk9yj3l6xwznprR9KLIbGZ9V7KSdvhEmUqz6sxyX18DRVOHZ32x9KkM54n-fmW5MzSlVPgKqrw3Lvqvb4fGZ9DWc41NDKWL10YNVKBy3FY280 Sep 27 17:35:25.345854 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Domain-Id: None Sep 27 17:35:25.345854 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Domain-Name: None Sep 27 17:35:25.345854 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Identity-Status: Confirmed Sep 27 17:35:25.345854 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Is-Admin-Project: True Sep 27 17:35:25.345854 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Domain-Id: default Sep 27 17:35:25.345854 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Domain-Name: Default Sep 27 17:35:25.345854 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Id: ef13103d3d8b43e1882d4820c8d9247b Sep 27 17:35:25.345854 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Name: tempest-AttachVolumeNegativeTest-1423690367 Sep 27 17:35:25.345854 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Role: reader,member Sep 27 17:35:25.345854 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Roles: reader,member Sep 27 17:35:25.347340 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ef13103d3d8b43e1882d4820c8d9247b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_ef13103d3d8b43e1882d4820c8d9247b", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ef13103d3d8b43e1882d4820c8d9247b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/ef13103d3d8b43e1882d4820c8d9247b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 27 17:35:25.347340 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Tenant: tempest-AttachVolumeNegativeTest-1423690367 Sep 27 17:35:25.347340 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Tenant-Id: ef13103d3d8b43e1882d4820c8d9247b Sep 27 17:35:25.347340 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1423690367 Sep 27 17:35:25.347340 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User: tempest-AttachVolumeNegativeTest-1423690367-project Sep 27 17:35:25.347340 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Domain-Id: default Sep 27 17:35:25.347340 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Domain-Name: Default Sep 27 17:35:25.347340 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Id: 0b02c2ba9a0a48c294a11b42cbfe28e3 Sep 27 17:35:25.347340 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Name: tempest-AttachVolumeNegativeTest-1423690367-project Sep 27 17:35:25.347340 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Sep 27 17:35:25.347340 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: {"volumeAttachment": {"volumeId": "23feffbb-91bd-4fe2-975e-791c2a5a8123"}} Sep 27 17:35:25.347340 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: method: > Sep 27 17:35:25.352029 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: exception: Invalid volume: volume 23feffbb-91bd-4fe2-975e-791c2a5a8123 is already attached to instances: ce5f26c2-638d-4baf-9ccb-ba578b97cfc1 Sep 27 17:35:25.352029 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: action_args: {'server_id': 'ce5f26c2-638d-4baf-9ccb-ba578b97cfc1', 'body': {'volumeAttachment': {'volumeId': '23feffbb-91bd-4fe2-975e-791c2a5a8123'}}} Sep 27 17:35:25.352029 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 17:35:25.352029 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:35:25.352029 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 27 17:35:25.352029 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 27 17:35:25.352029 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 27 17:35:25.352029 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 27 17:35:25.352029 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 27 17:35:25.352029 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 27 17:35:25.352029 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 27 17:35:25.352029 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 27 17:35:25.352029 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 27 17:35:25.352029 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 27 17:35:25.352029 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 23feffbb-91bd-4fe2-975e-791c2a5a8123 is already attached to instances: ce5f26c2-638d-4baf-9ccb-ba578b97cfc1 Sep 27 17:35:25.352029 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:35:25.352029 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:35:25.352029 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:35:25.352029 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:35:25.353441 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:35:25.353441 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:35:25.353441 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 17:35:25.353441 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 17:35:25.353441 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 17:35:25.353441 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 17:35:25.353441 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 17:35:25.353441 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 17:35:25.353441 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 17:35:25.353441 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 17:35:25.353441 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 27 17:35:25.353441 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 27 17:35:25.353441 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 27 17:35:25.353441 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 27 17:35:25.353441 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 23feffbb-91bd-4fe2-975e-791c2a5a8123 is already attached to instances: ce5f26c2-638d-4baf-9ccb-ba578b97cfc1 Sep 27 17:35:25.353441 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:35:25.353441 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:35:25.353441 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:35:25.353441 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:35:25.353441 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:35:25.356069 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:35:25.356069 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 17:35:25.356069 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 17:35:25.356069 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 23feffbb-91bd-4fe2-975e-791c2a5a8123 is already attached to instances: ce5f26c2-638d-4baf-9ccb-ba578b97cfc1 Sep 27 17:35:25.356069 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:35:25.356069 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-f34f162a-a38b-4867-9e99-a99e1c680505 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Returning 400 to user: Invalid volume: volume 23feffbb-91bd-4fe2-975e-791c2a5a8123 is already attached to instances: ce5f26c2-638d-4baf-9ccb-ba578b97cfc1 {{(pid=120416) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 17:35:25.356069 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-f34f162a-a38b-4867-9e99-a99e1c680505 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "POST /compute/v2.1/servers/ce5f26c2-638d-4baf-9ccb-ba578b97cfc1/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.106280 Sep 27 17:35:25.356069 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 521/1021] 10.222.0.55 () {60 vars in 1323 bytes} [Tue Sep 27 17:35:25 2022] POST /compute/v2.1/servers/ce5f26c2-638d-4baf-9ccb-ba578b97cfc1/os-volume_attachments => generated 174 bytes in 108 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 27 17:35:25.421753 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-3ceb24c6-fd02-4b1a-9a09-6166b1ed7c65 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:35:25.423699 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-3ceb24c6-fd02-4b1a-9a09-6166b1ed7c65 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: ce5f26c2-638d-4baf-9ccb-ba578b97cfc1] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:35:25.430792 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3ceb24c6-fd02-4b1a-9a09-6166b1ed7c65 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:25.431502 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3ceb24c6-fd02-4b1a-9a09-6166b1ed7c65 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:25.432120 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3ceb24c6-fd02-4b1a-9a09-6166b1ed7c65 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:25.433006 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3ceb24c6-fd02-4b1a-9a09-6166b1ed7c65 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:25.433660 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3ceb24c6-fd02-4b1a-9a09-6166b1ed7c65 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:25.434121 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3ceb24c6-fd02-4b1a-9a09-6166b1ed7c65 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:25.552508 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.objects.instance [None req-3ceb24c6-fd02-4b1a-9a09-6166b1ed7c65 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lazy-loading 'services' on Instance uuid ce5f26c2-638d-4baf-9ccb-ba578b97cfc1 {{(pid=120415) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 17:35:25.649582 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-3ceb24c6-fd02-4b1a-9a09-6166b1ed7c65 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "DELETE /compute/v2.1/servers/ce5f26c2-638d-4baf-9ccb-ba578b97cfc1/os-volume_attachments/23feffbb-91bd-4fe2-975e-791c2a5a8123" status: 202 len: 0 microversion: 2.1 time: 0.233605 Sep 27 17:35:25.650797 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 501/1022] 10.222.0.55 () {58 vars in 1416 bytes} [Tue Sep 27 17:35:25 2022] DELETE /compute/v2.1/servers/ce5f26c2-638d-4baf-9ccb-ba578b97cfc1/os-volume_attachments/23feffbb-91bd-4fe2-975e-791c2a5a8123 => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 17:35:25.658995 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-bb0d1a9e-396c-40b6-ba03-957737cb82bd tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:35:25.663161 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-bb0d1a9e-396c-40b6-ba03-957737cb82bd tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: ce5f26c2-638d-4baf-9ccb-ba578b97cfc1] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:35:25.670854 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-bb0d1a9e-396c-40b6-ba03-957737cb82bd tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:25.671227 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-bb0d1a9e-396c-40b6-ba03-957737cb82bd tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:25.671882 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-bb0d1a9e-396c-40b6-ba03-957737cb82bd tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:25.673358 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-bb0d1a9e-396c-40b6-ba03-957737cb82bd tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:25.674022 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-bb0d1a9e-396c-40b6-ba03-957737cb82bd tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:25.674676 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-bb0d1a9e-396c-40b6-ba03-957737cb82bd tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:25.720048 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-bb0d1a9e-396c-40b6-ba03-957737cb82bd tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/ce5f26c2-638d-4baf-9ccb-ba578b97cfc1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064951 Sep 27 17:35:25.720930 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 522/1023] 10.222.0.55 () {58 vars in 1302 bytes} [Tue Sep 27 17:35:25 2022] GET /compute/v2.1/servers/ce5f26c2-638d-4baf-9ccb-ba578b97cfc1/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:35:26.734425 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-f8079a87-78d1-4ebf-9b16-3fa44694f1ca tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:35:26.736770 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-f8079a87-78d1-4ebf-9b16-3fa44694f1ca tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: ce5f26c2-638d-4baf-9ccb-ba578b97cfc1] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:35:26.743630 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f8079a87-78d1-4ebf-9b16-3fa44694f1ca tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:26.743991 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f8079a87-78d1-4ebf-9b16-3fa44694f1ca tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:26.744451 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f8079a87-78d1-4ebf-9b16-3fa44694f1ca tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:26.745138 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f8079a87-78d1-4ebf-9b16-3fa44694f1ca tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:26.745591 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f8079a87-78d1-4ebf-9b16-3fa44694f1ca tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:26.746017 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f8079a87-78d1-4ebf-9b16-3fa44694f1ca tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:26.775594 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-f8079a87-78d1-4ebf-9b16-3fa44694f1ca tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/ce5f26c2-638d-4baf-9ccb-ba578b97cfc1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046467 Sep 27 17:35:26.776166 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 502/1024] 10.222.0.55 () {58 vars in 1302 bytes} [Tue Sep 27 17:35:26 2022] GET /compute/v2.1/servers/ce5f26c2-638d-4baf-9ccb-ba578b97cfc1/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 17:35:26.839155 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-82d5eab6-a14e-4ed7-8324-efb658bab3d4 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:35:26.839674 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-82d5eab6-a14e-4ed7-8324-efb658bab3d4 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: ce5f26c2-638d-4baf-9ccb-ba578b97cfc1] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:35:26.845852 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-82d5eab6-a14e-4ed7-8324-efb658bab3d4 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:26.846365 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-82d5eab6-a14e-4ed7-8324-efb658bab3d4 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:26.846800 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-82d5eab6-a14e-4ed7-8324-efb658bab3d4 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:26.847483 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-82d5eab6-a14e-4ed7-8324-efb658bab3d4 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:26.847937 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-82d5eab6-a14e-4ed7-8324-efb658bab3d4 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:26.848565 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-82d5eab6-a14e-4ed7-8324-efb658bab3d4 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:26.876997 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-82d5eab6-a14e-4ed7-8324-efb658bab3d4 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: ce5f26c2-638d-4baf-9ccb-ba578b97cfc1] Going to try to terminate instance {{(pid=120416) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 17:35:26.960546 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-82d5eab6-a14e-4ed7-8324-efb658bab3d4 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "DELETE /compute/v2.1/servers/ce5f26c2-638d-4baf-9ccb-ba578b97cfc1" status: 204 len: 0 microversion: 2.1 time: 0.124864 Sep 27 17:35:26.962909 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 523/1025] 10.222.0.55 () {58 vars in 1239 bytes} [Tue Sep 27 17:35:26 2022] DELETE /compute/v2.1/servers/ce5f26c2-638d-4baf-9ccb-ba578b97cfc1 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 17:35:26.971877 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-b3710b3c-ff86-4d53-9d22-205b968d1173 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:35:26.972473 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-b3710b3c-ff86-4d53-9d22-205b968d1173 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: ce5f26c2-638d-4baf-9ccb-ba578b97cfc1] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:35:26.984801 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b3710b3c-ff86-4d53-9d22-205b968d1173 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:26.985548 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b3710b3c-ff86-4d53-9d22-205b968d1173 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:26.986260 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b3710b3c-ff86-4d53-9d22-205b968d1173 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:26.987180 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b3710b3c-ff86-4d53-9d22-205b968d1173 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:26.987635 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b3710b3c-ff86-4d53-9d22-205b968d1173 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:26.988060 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b3710b3c-ff86-4d53-9d22-205b968d1173 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:27.134707 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-b3710b3c-ff86-4d53-9d22-205b968d1173 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b02c2ba9a0a48c294a11b42cbfe28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef13103d3d8b43e1882d4820c8d9247b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:35:27.143136 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-b3710b3c-ff86-4d53-9d22-205b968d1173 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/ce5f26c2-638d-4baf-9ccb-ba578b97cfc1" status: 200 len: 1681 microversion: 2.1 time: 0.175045 Sep 27 17:35:27.143838 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 503/1026] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:35:26 2022] GET /compute/v2.1/servers/ce5f26c2-638d-4baf-9ccb-ba578b97cfc1 => generated 1681 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:35:28.167950 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-fb35cb77-ab0d-41fa-8f5d-d136535aa271 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:35:28.168682 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-fb35cb77-ab0d-41fa-8f5d-d136535aa271 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: ce5f26c2-638d-4baf-9ccb-ba578b97cfc1] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:35:28.178122 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-fb35cb77-ab0d-41fa-8f5d-d136535aa271 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:28.178599 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-fb35cb77-ab0d-41fa-8f5d-d136535aa271 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:28.179033 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-fb35cb77-ab0d-41fa-8f5d-d136535aa271 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:28.179722 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-fb35cb77-ab0d-41fa-8f5d-d136535aa271 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:28.180170 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-fb35cb77-ab0d-41fa-8f5d-d136535aa271 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:28.180590 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-fb35cb77-ab0d-41fa-8f5d-d136535aa271 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:28.448239 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-fb35cb77-ab0d-41fa-8f5d-d136535aa271 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b02c2ba9a0a48c294a11b42cbfe28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef13103d3d8b43e1882d4820c8d9247b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:35:28.456909 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-fb35cb77-ab0d-41fa-8f5d-d136535aa271 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/ce5f26c2-638d-4baf-9ccb-ba578b97cfc1" status: 200 len: 1681 microversion: 2.1 time: 0.293861 Sep 27 17:35:28.457511 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 524/1027] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:35:28 2022] GET /compute/v2.1/servers/ce5f26c2-638d-4baf-9ccb-ba578b97cfc1 => generated 1681 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:35:29.481794 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-3a616a63-2a1a-40a4-8924-77de29fc924c tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:35:29.482681 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-3a616a63-2a1a-40a4-8924-77de29fc924c tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: ce5f26c2-638d-4baf-9ccb-ba578b97cfc1] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:35:29.489471 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3a616a63-2a1a-40a4-8924-77de29fc924c tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:29.489961 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3a616a63-2a1a-40a4-8924-77de29fc924c tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:29.490429 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3a616a63-2a1a-40a4-8924-77de29fc924c tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:29.491346 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3a616a63-2a1a-40a4-8924-77de29fc924c tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:29.491804 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3a616a63-2a1a-40a4-8924-77de29fc924c tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:29.492228 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3a616a63-2a1a-40a4-8924-77de29fc924c tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:29.745973 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-3a616a63-2a1a-40a4-8924-77de29fc924c tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b02c2ba9a0a48c294a11b42cbfe28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef13103d3d8b43e1882d4820c8d9247b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:35:29.760342 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-3a616a63-2a1a-40a4-8924-77de29fc924c tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/ce5f26c2-638d-4baf-9ccb-ba578b97cfc1" status: 200 len: 1681 microversion: 2.1 time: 0.282644 Sep 27 17:35:29.760941 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 504/1028] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:35:29 2022] GET /compute/v2.1/servers/ce5f26c2-638d-4baf-9ccb-ba578b97cfc1 => generated 1681 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:35:30.214950 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [req-a6b00440-0ae8-4da6-ac77-a5ee5900816d req-ef291f94-8140-488f-9556-a9eeed483546 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce5f26c2-638d-4baf-9ccb-ba578b97cfc1", "name": "network-vif-deleted", "tag": "ef3355f1-2589-4b0a-bdb1-68cba54179a8"}]} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:35:30.249175 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-a6b00440-0ae8-4da6-ac77-a5ee5900816d req-ef291f94-8140-488f-9556-a9eeed483546 service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:30.249709 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-a6b00440-0ae8-4da6-ac77-a5ee5900816d req-ef291f94-8140-488f-9556-a9eeed483546 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:30.250190 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-a6b00440-0ae8-4da6-ac77-a5ee5900816d req-ef291f94-8140-488f-9556-a9eeed483546 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:30.274209 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.compute.server_external_events [req-a6b00440-0ae8-4da6-ac77-a5ee5900816d req-ef291f94-8140-488f-9556-a9eeed483546 service nova] Creating event network-vif-deleted:ef3355f1-2589-4b0a-bdb1-68cba54179a8 for instance ce5f26c2-638d-4baf-9ccb-ba578b97cfc1 on hv-cinder-84914 Sep 27 17:35:30.279908 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [req-a6b00440-0ae8-4da6-ac77-a5ee5900816d req-ef291f94-8140-488f-9556-a9eeed483546 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068394 Sep 27 17:35:30.281191 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 525/1029] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:35:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:35:30.784707 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-c2ac063f-b73f-4e83-bc7b-5f6a3ac5beb0 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:35:30.785316 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-c2ac063f-b73f-4e83-bc7b-5f6a3ac5beb0 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: ce5f26c2-638d-4baf-9ccb-ba578b97cfc1] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:35:30.792603 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c2ac063f-b73f-4e83-bc7b-5f6a3ac5beb0 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:30.793316 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c2ac063f-b73f-4e83-bc7b-5f6a3ac5beb0 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:30.793917 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c2ac063f-b73f-4e83-bc7b-5f6a3ac5beb0 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:30.794826 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c2ac063f-b73f-4e83-bc7b-5f6a3ac5beb0 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:30.795447 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c2ac063f-b73f-4e83-bc7b-5f6a3ac5beb0 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:30.796031 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c2ac063f-b73f-4e83-bc7b-5f6a3ac5beb0 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:30.827847 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c2ac063f-b73f-4e83-bc7b-5f6a3ac5beb0 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:30.828570 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c2ac063f-b73f-4e83-bc7b-5f6a3ac5beb0 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:30.829177 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c2ac063f-b73f-4e83-bc7b-5f6a3ac5beb0 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:30.829632 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.objects.instance [None req-c2ac063f-b73f-4e83-bc7b-5f6a3ac5beb0 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lazy-loading 'fault' on Instance uuid ce5f26c2-638d-4baf-9ccb-ba578b97cfc1 {{(pid=120415) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 17:35:30.878988 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-c2ac063f-b73f-4e83-bc7b-5f6a3ac5beb0 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b02c2ba9a0a48c294a11b42cbfe28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef13103d3d8b43e1882d4820c8d9247b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:35:30.887812 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-c2ac063f-b73f-4e83-bc7b-5f6a3ac5beb0 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/ce5f26c2-638d-4baf-9ccb-ba578b97cfc1" status: 200 len: 1332 microversion: 2.1 time: 0.106923 Sep 27 17:35:30.888386 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 505/1030] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:35:30 2022] GET /compute/v2.1/servers/ce5f26c2-638d-4baf-9ccb-ba578b97cfc1 => generated 1332 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:35:31.913753 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-b098b50d-a8ae-4066-ad2c-28e19dc3ba4d tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:35:31.914478 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-b098b50d-a8ae-4066-ad2c-28e19dc3ba4d tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: ce5f26c2-638d-4baf-9ccb-ba578b97cfc1] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:35:31.920918 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b098b50d-a8ae-4066-ad2c-28e19dc3ba4d tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:31.921387 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b098b50d-a8ae-4066-ad2c-28e19dc3ba4d tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:31.921813 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b098b50d-a8ae-4066-ad2c-28e19dc3ba4d tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:31.922519 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b098b50d-a8ae-4066-ad2c-28e19dc3ba4d tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:31.922970 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b098b50d-a8ae-4066-ad2c-28e19dc3ba4d tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:31.923412 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b098b50d-a8ae-4066-ad2c-28e19dc3ba4d tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:31.936098 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.wsgi [None req-b098b50d-a8ae-4066-ad2c-28e19dc3ba4d tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] HTTP exception thrown: Instance ce5f26c2-638d-4baf-9ccb-ba578b97cfc1 could not be found. Sep 27 17:35:31.937659 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-b098b50d-a8ae-4066-ad2c-28e19dc3ba4d tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Request method failure captured: Sep 27 17:35:31.937659 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: request: GET /compute/v2.1/servers/ce5f26c2-638d-4baf-9ccb-ba578b97cfc1 HTTP/1.1 Sep 27 17:35:31.937659 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Accept: application/json Sep 27 17:35:31.937659 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Accept-Encoding: identity Sep 27 17:35:31.937659 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Connection: close Sep 27 17:35:31.937659 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Content-Length: 0 Sep 27 17:35:31.937659 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Content-Type: application/json Sep 27 17:35:31.937659 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Host: 10.222.0.55 Sep 27 17:35:31.937659 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Openstack-System-Scope: None Sep 27 17:35:31.937659 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: User-Agent: python-urllib3/1.26.12 Sep 27 17:35:31.937659 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Auth-Token: gAAAAABjMzJLbcCEQOqdb7vUsgmB1kYoJEkf6gmC-gBv2tRXmVys19QrTRcPsWXwKEDAq84Zx8Lk9yj3l6xwznprR9KLIbGZ9V7KSdvhEmUqz6sxyX18DRVOHZ32x9KkM54n-fmW5MzSlVPgKqrw3Lvqvb4fGZ9DWc41NDKWL10YNVKBy3FY280 Sep 27 17:35:31.937659 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Domain-Id: None Sep 27 17:35:31.937659 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Domain-Name: None Sep 27 17:35:31.937659 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Identity-Status: Confirmed Sep 27 17:35:31.937659 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Is-Admin-Project: True Sep 27 17:35:31.937659 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Domain-Id: default Sep 27 17:35:31.937659 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Domain-Name: Default Sep 27 17:35:31.937659 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Id: ef13103d3d8b43e1882d4820c8d9247b Sep 27 17:35:31.937659 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Name: tempest-AttachVolumeNegativeTest-1423690367 Sep 27 17:35:31.937659 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Role: reader,member Sep 27 17:35:31.937659 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Roles: reader,member Sep 27 17:35:31.939207 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ef13103d3d8b43e1882d4820c8d9247b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_ef13103d3d8b43e1882d4820c8d9247b", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ef13103d3d8b43e1882d4820c8d9247b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/ef13103d3d8b43e1882d4820c8d9247b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 27 17:35:31.939207 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Tenant: tempest-AttachVolumeNegativeTest-1423690367 Sep 27 17:35:31.939207 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Tenant-Id: ef13103d3d8b43e1882d4820c8d9247b Sep 27 17:35:31.939207 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1423690367 Sep 27 17:35:31.939207 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User: tempest-AttachVolumeNegativeTest-1423690367-project Sep 27 17:35:31.939207 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Domain-Id: default Sep 27 17:35:31.939207 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Domain-Name: Default Sep 27 17:35:31.939207 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Id: 0b02c2ba9a0a48c294a11b42cbfe28e3 Sep 27 17:35:31.939207 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Name: tempest-AttachVolumeNegativeTest-1423690367-project Sep 27 17:35:31.939207 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: method: > Sep 27 17:35:31.939207 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: exception: Instance ce5f26c2-638d-4baf-9ccb-ba578b97cfc1 could not be found. Sep 27 17:35:31.939207 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: action_args: {'id': 'ce5f26c2-638d-4baf-9ccb-ba578b97cfc1'} Sep 27 17:35:31.940817 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 17:35:31.940817 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:35:31.940817 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 17:35:31.940817 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 17:35:31.940817 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 17:35:31.940817 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 17:35:31.940817 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 17:35:31.940817 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 17:35:31.940817 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 17:35:31.940817 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 17:35:31.940817 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce5f26c2-638d-4baf-9ccb-ba578b97cfc1 could not be found. Sep 27 17:35:31.940817 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:35:31.940817 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:35:31.940817 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:35:31.940817 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:35:31.940817 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:35:31.940817 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:35:31.940817 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 17:35:31.940817 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 17:35:31.940817 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 17:35:31.942373 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 17:35:31.942373 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 17:35:31.942373 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 17:35:31.942373 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 17:35:31.942373 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 17:35:31.942373 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 17:35:31.942373 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 17:35:31.942373 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce5f26c2-638d-4baf-9ccb-ba578b97cfc1 could not be found. Sep 27 17:35:31.942373 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:35:31.942373 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:35:31.942373 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:35:31.942373 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:35:31.942373 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:35:31.942373 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:35:31.942373 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 17:35:31.942373 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 17:35:31.942373 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce5f26c2-638d-4baf-9ccb-ba578b97cfc1 could not be found. Sep 27 17:35:31.942373 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:35:31.943763 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-b098b50d-a8ae-4066-ad2c-28e19dc3ba4d tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Returning 404 to user: Instance ce5f26c2-638d-4baf-9ccb-ba578b97cfc1 could not be found. {{(pid=120416) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 17:35:31.943763 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-b098b50d-a8ae-4066-ad2c-28e19dc3ba4d tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/ce5f26c2-638d-4baf-9ccb-ba578b97cfc1" status: 404 len: 111 microversion: 2.1 time: 0.030137 Sep 27 17:35:31.943763 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 526/1031] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:35:31 2022] GET /compute/v2.1/servers/ce5f26c2-638d-4baf-9ccb-ba578b97cfc1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 17:35:31.947791 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-cef07818-1ab4-49cb-afda-a248f8883198 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '.version_select at 0x7fe724cd5c10>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:35:31.965990 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-cef07818-1ab4-49cb-afda-a248f8883198 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1433029226" status: 202 len: 0 microversion: 2.1 time: 0.021999 Sep 27 17:35:31.966591 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 506/1032] 10.222.0.55 () {58 vars in 1221 bytes} [Tue Sep 27 17:35:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1433029226 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 17:35:32.553617 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-7c9214c2-0fab-4d53-a5c0-925e17ccd6f8 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Action: 'create', calling method: .version_select at 0x7fe728367040>, body: {"keypair": {"name": "tempest-keypair-2093910123", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJNgSKQ/IVcF/vzdeF3HRURP0e7NxfqA49Bsjdyoa6UpSSfr1vEKj1J6RHINPcCNnlKu37aS8ppv98lBUDiEqJPo2A9UVB8wIiiM++DGY3y/Lf36lZSzu3SWnMuMvJSLnA=="}} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:35:32.569055 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.quota [None req-7c9214c2-0fab-4d53-a5c0-925e17ccd6f8 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Getting quotas for project ef13103d3d8b43e1882d4820c8d9247b. Resources: {'key_pairs'} {{(pid=120416) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 17:35:32.572827 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.quota [None req-7c9214c2-0fab-4d53-a5c0-925e17ccd6f8 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Getting quotas for user 0b02c2ba9a0a48c294a11b42cbfe28e3 and project ef13103d3d8b43e1882d4820c8d9247b. Resources: {'key_pairs'} {{(pid=120416) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 17:35:32.585008 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR oslo.messaging._drivers.impl_rabbit [None req-7c9214c2-0fab-4d53-a5c0-925e17ccd6f8 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [8cd292cd-384b-45e3-b5d5-4556f3dfd6ef] AMQP server on 10.222.0.55:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 27 17:35:33.592306 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO oslo.messaging._drivers.impl_rabbit [None req-7c9214c2-0fab-4d53-a5c0-925e17ccd6f8 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [8cd292cd-384b-45e3-b5d5-4556f3dfd6ef] Reconnected to AMQP server on 10.222.0.55:5672 via [amqp] client with port 35570. Sep 27 17:35:33.606770 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-7c9214c2-0fab-4d53-a5c0-925e17ccd6f8 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.057055 Sep 27 17:35:33.607370 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 527/1033] 10.222.0.55 () {60 vars in 1159 bytes} [Tue Sep 27 17:35:32 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:35:34.871819 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-c71565be-b7fa-4a48-b292-2ee595301b95 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1631627312", "imageRef": "9355bd92-0a49-42cd-b079-ff9f0d54b91b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "50dc8265-0d0d-49da-afd6-19daca5e673b"}], "security_groups": [{"name": "tempest-securitygroup--1626237388"}], "key_name": "tempest-keypair-2093910123", "user_data": "}} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:35:34.972330 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.network.neutron [None req-c71565be-b7fa-4a48-b292-2ee595301b95 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] validate_networks() for [('50dc8265-0d0d-49da-afd6-19daca5e673b', None, None, None, None, None)] {{(pid=120415) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 17:35:35.701914 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-c71565be-b7fa-4a48-b292-2ee595301b95 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Flavor limits 0:0:0 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 17:35:35.702370 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-c71565be-b7fa-4a48-b292-2ee595301b95 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Image limits 0:0:0 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 17:35:35.702844 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-c71565be-b7fa-4a48-b292-2ee595301b95 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Flavor pref 0:0:0 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 17:35:35.703248 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-c71565be-b7fa-4a48-b292-2ee595301b95 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Image pref 0:0:0 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 17:35:35.703658 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-c71565be-b7fa-4a48-b292-2ee595301b95 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 17:35:35.712291 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c71565be-b7fa-4a48-b292-2ee595301b95 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:35.712766 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c71565be-b7fa-4a48-b292-2ee595301b95 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:35.713196 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c71565be-b7fa-4a48-b292-2ee595301b95 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:35.713911 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c71565be-b7fa-4a48-b292-2ee595301b95 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:35.714397 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c71565be-b7fa-4a48-b292-2ee595301b95 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:35.714817 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c71565be-b7fa-4a48-b292-2ee595301b95 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:35.731382 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.quota [None req-c71565be-b7fa-4a48-b292-2ee595301b95 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Getting quotas for project ef13103d3d8b43e1882d4820c8d9247b. Resources: {'cores', 'ram', 'instances'} {{(pid=120415) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 17:35:35.735807 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.quota [None req-c71565be-b7fa-4a48-b292-2ee595301b95 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Getting quotas for user 0b02c2ba9a0a48c294a11b42cbfe28e3 and project ef13103d3d8b43e1882d4820c8d9247b. Resources: {'cores', 'ram', 'instances'} {{(pid=120415) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 17:35:35.747080 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-c71565be-b7fa-4a48-b292-2ee595301b95 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Going to run 1 instances... {{(pid=120415) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 17:35:35.749311 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-c71565be-b7fa-4a48-b292-2ee595301b95 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: 8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9355bd92-0a49-42cd-b079-ff9f0d54b91b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120415) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 17:35:35.797900 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-c71565be-b7fa-4a48-b292-2ee595301b95 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.930937 Sep 27 17:35:35.798590 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 507/1034] 10.222.0.55 () {60 vars in 1147 bytes} [Tue Sep 27 17:35:34 2022] POST /compute/v2.1/servers => generated 402 bytes in 932 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 17:35:35.810756 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-37218f82-a091-4409-998d-afcf956bc11b tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:35:35.811368 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-37218f82-a091-4409-998d-afcf956bc11b tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: 8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:35:35.869709 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-37218f82-a091-4409-998d-afcf956bc11b tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b02c2ba9a0a48c294a11b42cbfe28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef13103d3d8b43e1882d4820c8d9247b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:35:35.876707 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-37218f82-a091-4409-998d-afcf956bc11b tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486" status: 200 len: 1242 microversion: 2.1 time: 0.070457 Sep 27 17:35:35.877269 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 528/1035] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:35:35 2022] GET /compute/v2.1/servers/8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486 => generated 1242 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:35:36.901482 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-f88e5308-b3e7-48db-b36b-bd96ab785dae tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:35:36.902105 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-f88e5308-b3e7-48db-b36b-bd96ab785dae tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: 8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:35:36.908151 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f88e5308-b3e7-48db-b36b-bd96ab785dae tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:36.908635 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f88e5308-b3e7-48db-b36b-bd96ab785dae tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:36.909070 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f88e5308-b3e7-48db-b36b-bd96ab785dae tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:36.909756 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f88e5308-b3e7-48db-b36b-bd96ab785dae tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:36.910240 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f88e5308-b3e7-48db-b36b-bd96ab785dae tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:36.910667 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f88e5308-b3e7-48db-b36b-bd96ab785dae tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:36.971706 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-f88e5308-b3e7-48db-b36b-bd96ab785dae tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b02c2ba9a0a48c294a11b42cbfe28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef13103d3d8b43e1882d4820c8d9247b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:35:36.980265 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-f88e5308-b3e7-48db-b36b-bd96ab785dae tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486" status: 200 len: 1294 microversion: 2.1 time: 0.083811 Sep 27 17:35:36.980833 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 508/1036] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:35:36 2022] GET /compute/v2.1/servers/8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486 => generated 1294 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:35:38.004076 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-7957159f-1fd3-43e5-81c1-55370549033a tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:35:38.005329 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-7957159f-1fd3-43e5-81c1-55370549033a tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: 8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:35:38.012994 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7957159f-1fd3-43e5-81c1-55370549033a tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:38.013483 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7957159f-1fd3-43e5-81c1-55370549033a tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:38.013931 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7957159f-1fd3-43e5-81c1-55370549033a tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:38.014853 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7957159f-1fd3-43e5-81c1-55370549033a tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:38.015485 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7957159f-1fd3-43e5-81c1-55370549033a tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:38.015930 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7957159f-1fd3-43e5-81c1-55370549033a tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:38.239451 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-7957159f-1fd3-43e5-81c1-55370549033a tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b02c2ba9a0a48c294a11b42cbfe28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef13103d3d8b43e1882d4820c8d9247b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:35:38.248124 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-7957159f-1fd3-43e5-81c1-55370549033a tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486" status: 200 len: 1368 microversion: 2.1 time: 0.248004 Sep 27 17:35:38.248693 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 529/1037] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:35:37 2022] GET /compute/v2.1/servers/8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486 => generated 1368 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:35:38.736514 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [req-c44a4e7a-cd1c-4aa6-8600-029316d0977c req-cf1be370-0912-4b9e-b6fd-229894a50d30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486", "tag": "2ada2339-648c-4124-a9c2-ed0cd3edf8ef"}]} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:35:38.746050 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-c44a4e7a-cd1c-4aa6-8600-029316d0977c req-cf1be370-0912-4b9e-b6fd-229894a50d30 service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:38.746568 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-c44a4e7a-cd1c-4aa6-8600-029316d0977c req-cf1be370-0912-4b9e-b6fd-229894a50d30 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:38.747027 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-c44a4e7a-cd1c-4aa6-8600-029316d0977c req-cf1be370-0912-4b9e-b6fd-229894a50d30 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:38.757847 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.compute.server_external_events [req-c44a4e7a-cd1c-4aa6-8600-029316d0977c req-cf1be370-0912-4b9e-b6fd-229894a50d30 service nova] Creating event network-changed:2ada2339-648c-4124-a9c2-ed0cd3edf8ef for instance 8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486 on hv-cinder-84914 Sep 27 17:35:38.764378 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [req-c44a4e7a-cd1c-4aa6-8600-029316d0977c req-cf1be370-0912-4b9e-b6fd-229894a50d30 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.156226 Sep 27 17:35:38.764978 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 509/1038] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:35:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:35:39.271205 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-acb5949f-d148-44b3-8a1d-93309ca70adb tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:35:39.271966 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-acb5949f-d148-44b3-8a1d-93309ca70adb tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: 8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:35:39.278826 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-acb5949f-d148-44b3-8a1d-93309ca70adb tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:39.279305 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-acb5949f-d148-44b3-8a1d-93309ca70adb tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:39.279735 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-acb5949f-d148-44b3-8a1d-93309ca70adb tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:39.280423 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-acb5949f-d148-44b3-8a1d-93309ca70adb tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:39.280871 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-acb5949f-d148-44b3-8a1d-93309ca70adb tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:39.281291 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-acb5949f-d148-44b3-8a1d-93309ca70adb tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:39.406372 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-acb5949f-d148-44b3-8a1d-93309ca70adb tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b02c2ba9a0a48c294a11b42cbfe28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef13103d3d8b43e1882d4820c8d9247b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:35:39.413806 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-acb5949f-d148-44b3-8a1d-93309ca70adb tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486" status: 200 len: 1368 microversion: 2.1 time: 0.146504 Sep 27 17:35:39.414395 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 530/1039] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:35:39 2022] GET /compute/v2.1/servers/8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486 => generated 1368 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:35:40.438378 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-310af924-7358-4f78-9f6e-305b2e18efc1 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:35:40.439097 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-310af924-7358-4f78-9f6e-305b2e18efc1 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: 8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:35:40.445675 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-310af924-7358-4f78-9f6e-305b2e18efc1 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:40.446183 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-310af924-7358-4f78-9f6e-305b2e18efc1 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:40.446621 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-310af924-7358-4f78-9f6e-305b2e18efc1 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:40.447309 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-310af924-7358-4f78-9f6e-305b2e18efc1 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:40.447766 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-310af924-7358-4f78-9f6e-305b2e18efc1 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:40.448189 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-310af924-7358-4f78-9f6e-305b2e18efc1 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:40.580000 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-310af924-7358-4f78-9f6e-305b2e18efc1 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b02c2ba9a0a48c294a11b42cbfe28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef13103d3d8b43e1882d4820c8d9247b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:35:40.588297 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-310af924-7358-4f78-9f6e-305b2e18efc1 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486" status: 200 len: 1368 microversion: 2.1 time: 0.154712 Sep 27 17:35:40.588865 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 510/1040] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:35:40 2022] GET /compute/v2.1/servers/8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486 => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:35:41.611613 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-f253d32a-d7ce-41a6-8c0f-44569f146e11 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:35:41.612224 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-f253d32a-d7ce-41a6-8c0f-44569f146e11 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: 8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:35:41.619076 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f253d32a-d7ce-41a6-8c0f-44569f146e11 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:41.619556 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f253d32a-d7ce-41a6-8c0f-44569f146e11 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:41.619991 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f253d32a-d7ce-41a6-8c0f-44569f146e11 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:41.620673 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f253d32a-d7ce-41a6-8c0f-44569f146e11 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:41.621125 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f253d32a-d7ce-41a6-8c0f-44569f146e11 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:41.621543 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f253d32a-d7ce-41a6-8c0f-44569f146e11 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:41.827501 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-f253d32a-d7ce-41a6-8c0f-44569f146e11 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b02c2ba9a0a48c294a11b42cbfe28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef13103d3d8b43e1882d4820c8d9247b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:35:41.835287 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-f253d32a-d7ce-41a6-8c0f-44569f146e11 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486" status: 200 len: 1368 microversion: 2.1 time: 0.227865 Sep 27 17:35:41.835887 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 531/1041] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:35:41 2022] GET /compute/v2.1/servers/8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486 => generated 1368 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:35:42.858963 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-c4fff985-4511-49c9-893e-cd66ff2e3c02 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:35:42.859572 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-c4fff985-4511-49c9-893e-cd66ff2e3c02 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: 8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:35:42.866041 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c4fff985-4511-49c9-893e-cd66ff2e3c02 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:42.866547 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c4fff985-4511-49c9-893e-cd66ff2e3c02 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:42.866979 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c4fff985-4511-49c9-893e-cd66ff2e3c02 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:42.867659 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c4fff985-4511-49c9-893e-cd66ff2e3c02 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:42.868107 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c4fff985-4511-49c9-893e-cd66ff2e3c02 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:42.868526 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c4fff985-4511-49c9-893e-cd66ff2e3c02 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:42.872576 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:35:42.996872 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-c4fff985-4511-49c9-893e-cd66ff2e3c02 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b02c2ba9a0a48c294a11b42cbfe28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef13103d3d8b43e1882d4820c8d9247b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:35:43.004327 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-c4fff985-4511-49c9-893e-cd66ff2e3c02 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486" status: 200 len: 1368 microversion: 2.1 time: 0.149513 Sep 27 17:35:43.004900 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 511/1042] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:35:42 2022] GET /compute/v2.1/servers/8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486 => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:35:44.027612 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-3d43dda6-303a-428f-b505-48b59c80ecd9 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:35:44.028220 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-3d43dda6-303a-428f-b505-48b59c80ecd9 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: 8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:35:44.034590 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3d43dda6-303a-428f-b505-48b59c80ecd9 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:44.035067 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3d43dda6-303a-428f-b505-48b59c80ecd9 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:44.035497 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3d43dda6-303a-428f-b505-48b59c80ecd9 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:44.036179 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3d43dda6-303a-428f-b505-48b59c80ecd9 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:44.036630 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3d43dda6-303a-428f-b505-48b59c80ecd9 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:44.037051 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3d43dda6-303a-428f-b505-48b59c80ecd9 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:44.169819 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-3d43dda6-303a-428f-b505-48b59c80ecd9 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b02c2ba9a0a48c294a11b42cbfe28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef13103d3d8b43e1882d4820c8d9247b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:35:44.172208 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:35:44.179492 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-3d43dda6-303a-428f-b505-48b59c80ecd9 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486" status: 200 len: 1368 microversion: 2.1 time: 0.155169 Sep 27 17:35:44.180253 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 532/1043] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:35:44 2022] GET /compute/v2.1/servers/8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486 => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:35:45.202377 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-14d58a15-4740-4e2a-bad3-09c8a6470dd0 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:35:45.203003 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-14d58a15-4740-4e2a-bad3-09c8a6470dd0 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: 8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:35:45.209165 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-14d58a15-4740-4e2a-bad3-09c8a6470dd0 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:45.209640 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-14d58a15-4740-4e2a-bad3-09c8a6470dd0 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:45.210730 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-14d58a15-4740-4e2a-bad3-09c8a6470dd0 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:45.211443 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-14d58a15-4740-4e2a-bad3-09c8a6470dd0 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:45.211973 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-14d58a15-4740-4e2a-bad3-09c8a6470dd0 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:45.212356 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-14d58a15-4740-4e2a-bad3-09c8a6470dd0 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:45.338189 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-14d58a15-4740-4e2a-bad3-09c8a6470dd0 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b02c2ba9a0a48c294a11b42cbfe28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef13103d3d8b43e1882d4820c8d9247b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:35:45.345750 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-14d58a15-4740-4e2a-bad3-09c8a6470dd0 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486" status: 200 len: 1368 microversion: 2.1 time: 0.147294 Sep 27 17:35:45.346347 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 512/1044] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:35:45 2022] GET /compute/v2.1/servers/8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486 => generated 1368 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:35:45.702511 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [req-b018d42c-9932-4249-9b23-73f156da971a req-2a7d18c9-82d1-4b0e-bc0c-4f1d730bb1f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486", "name": "network-vif-plugged", "status": "completed", "tag": "2ada2339-648c-4124-a9c2-ed0cd3edf8ef"}]} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:35:45.712062 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-b018d42c-9932-4249-9b23-73f156da971a req-2a7d18c9-82d1-4b0e-bc0c-4f1d730bb1f0 service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:45.712572 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-b018d42c-9932-4249-9b23-73f156da971a req-2a7d18c9-82d1-4b0e-bc0c-4f1d730bb1f0 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:45.713005 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-b018d42c-9932-4249-9b23-73f156da971a req-2a7d18c9-82d1-4b0e-bc0c-4f1d730bb1f0 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:45.723737 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.compute.server_external_events [req-b018d42c-9932-4249-9b23-73f156da971a req-2a7d18c9-82d1-4b0e-bc0c-4f1d730bb1f0 service nova] Creating event network-vif-plugged:2ada2339-648c-4124-a9c2-ed0cd3edf8ef for instance 8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486 on hv-cinder-84914 Sep 27 17:35:45.729180 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [req-b018d42c-9932-4249-9b23-73f156da971a req-2a7d18c9-82d1-4b0e-bc0c-4f1d730bb1f0 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097984 Sep 27 17:35:45.729939 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 533/1045] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:35:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:35:46.369298 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-510ac610-b3d2-41c9-827e-59045c4b2088 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:35:46.369911 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-510ac610-b3d2-41c9-827e-59045c4b2088 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: 8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:35:46.371855 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell0:SELECT=2 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:35:46.372516 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell0:SELECT=6 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:35:46.379055 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-510ac610-b3d2-41c9-827e-59045c4b2088 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:46.379541 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-510ac610-b3d2-41c9-827e-59045c4b2088 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:46.379980 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-510ac610-b3d2-41c9-827e-59045c4b2088 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:46.380672 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-510ac610-b3d2-41c9-827e-59045c4b2088 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:46.381131 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-510ac610-b3d2-41c9-827e-59045c4b2088 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:46.381564 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-510ac610-b3d2-41c9-827e-59045c4b2088 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:46.506354 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-510ac610-b3d2-41c9-827e-59045c4b2088 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b02c2ba9a0a48c294a11b42cbfe28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef13103d3d8b43e1882d4820c8d9247b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:35:46.514342 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-510ac610-b3d2-41c9-827e-59045c4b2088 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486" status: 200 len: 1368 microversion: 2.1 time: 0.148962 Sep 27 17:35:46.514917 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 513/1046] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:35:46 2022] GET /compute/v2.1/servers/8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486 => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:35:47.538910 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-dd6292e8-8f66-40c4-9350-9769c56eb747 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:35:47.539536 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-dd6292e8-8f66-40c4-9350-9769c56eb747 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: 8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:35:47.541484 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_cell0:SELECT=6 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:35:47.547330 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-dd6292e8-8f66-40c4-9350-9769c56eb747 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:47.547798 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-dd6292e8-8f66-40c4-9350-9769c56eb747 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:47.548224 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-dd6292e8-8f66-40c4-9350-9769c56eb747 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:47.548893 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-dd6292e8-8f66-40c4-9350-9769c56eb747 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:47.549338 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-dd6292e8-8f66-40c4-9350-9769c56eb747 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:47.549752 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-dd6292e8-8f66-40c4-9350-9769c56eb747 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:47.680287 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-dd6292e8-8f66-40c4-9350-9769c56eb747 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b02c2ba9a0a48c294a11b42cbfe28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef13103d3d8b43e1882d4820c8d9247b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:35:47.688052 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-dd6292e8-8f66-40c4-9350-9769c56eb747 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486" status: 200 len: 1559 microversion: 2.1 time: 0.153936 Sep 27 17:35:47.688814 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 534/1047] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:35:47 2022] GET /compute/v2.1/servers/8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:35:47.711289 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-b330eb2d-d955-49f4-a635-c7f5cdb1401c tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:35:47.711818 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-b330eb2d-d955-49f4-a635-c7f5cdb1401c tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: 8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:35:47.718454 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b330eb2d-d955-49f4-a635-c7f5cdb1401c tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:47.718994 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b330eb2d-d955-49f4-a635-c7f5cdb1401c tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:47.719379 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b330eb2d-d955-49f4-a635-c7f5cdb1401c tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:47.720071 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b330eb2d-d955-49f4-a635-c7f5cdb1401c tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:47.720600 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b330eb2d-d955-49f4-a635-c7f5cdb1401c tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:47.720951 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b330eb2d-d955-49f4-a635-c7f5cdb1401c tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:47.801644 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-b330eb2d-d955-49f4-a635-c7f5cdb1401c tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094672 Sep 27 17:35:47.802275 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 514/1048] 10.222.0.55 () {58 vars in 1275 bytes} [Tue Sep 27 17:35:47 2022] GET /compute/v2.1/servers/8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 17:35:48.724879 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [req-0b4cda66-d083-42a0-93eb-914ce15e02f3 req-601d8455-ddd9-40bd-8437-15aeea65f2dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486", "tag": "2ada2339-648c-4124-a9c2-ed0cd3edf8ef"}]} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:35:48.735738 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-0b4cda66-d083-42a0-93eb-914ce15e02f3 req-601d8455-ddd9-40bd-8437-15aeea65f2dc service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:35:48.736696 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-0b4cda66-d083-42a0-93eb-914ce15e02f3 req-601d8455-ddd9-40bd-8437-15aeea65f2dc service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:35:48.736696 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-0b4cda66-d083-42a0-93eb-914ce15e02f3 req-601d8455-ddd9-40bd-8437-15aeea65f2dc service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:35:48.748035 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.compute.server_external_events [req-0b4cda66-d083-42a0-93eb-914ce15e02f3 req-601d8455-ddd9-40bd-8437-15aeea65f2dc service nova] Creating event network-changed:2ada2339-648c-4124-a9c2-ed0cd3edf8ef for instance 8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486 on hv-cinder-84914 Sep 27 17:35:48.753206 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [req-0b4cda66-d083-42a0-93eb-914ce15e02f3 req-601d8455-ddd9-40bd-8437-15aeea65f2dc service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031800 Sep 27 17:35:48.754147 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 535/1049] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:35:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:36:14.758505 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_api:SELECT=50,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:36:14.759248 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell1:SELECT=20 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:36:14.763955 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-15e68471-51ce-4ffe-8958-7194d21b2d95 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:36:14.766196 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-15e68471-51ce-4ffe-8958-7194d21b2d95 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: f84aa405-baed-4bb8-84db-ab3592929c8a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:36:14.773624 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-15e68471-51ce-4ffe-8958-7194d21b2d95 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:36:14.774125 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-15e68471-51ce-4ffe-8958-7194d21b2d95 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:36:14.774559 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-15e68471-51ce-4ffe-8958-7194d21b2d95 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:36:14.775276 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-15e68471-51ce-4ffe-8958-7194d21b2d95 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:36:14.775721 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-15e68471-51ce-4ffe-8958-7194d21b2d95 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:36:14.776138 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-15e68471-51ce-4ffe-8958-7194d21b2d95 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:36:14.806253 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-15e68471-51ce-4ffe-8958-7194d21b2d95 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048492 Sep 27 17:36:14.806840 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 515/1050] 10.222.0.55 () {60 vars in 1343 bytes} [Tue Sep 27 17:36:14 2022] GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:36:14.870288 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-ea14f9ac-ee77-417d-a89a-191c741e938e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:36:14.870862 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-ea14f9ac-ee77-417d-a89a-191c741e938e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: f84aa405-baed-4bb8-84db-ab3592929c8a] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:36:14.873380 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:36:14.874011 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_cell1:SELECT=11 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:36:14.880143 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ea14f9ac-ee77-417d-a89a-191c741e938e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:36:14.880611 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ea14f9ac-ee77-417d-a89a-191c741e938e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:36:14.881036 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ea14f9ac-ee77-417d-a89a-191c741e938e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:36:14.881713 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ea14f9ac-ee77-417d-a89a-191c741e938e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:36:14.882247 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ea14f9ac-ee77-417d-a89a-191c741e938e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:36:14.882667 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ea14f9ac-ee77-417d-a89a-191c741e938e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:36:14.908376 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-ea14f9ac-ee77-417d-a89a-191c741e938e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: f84aa405-baed-4bb8-84db-ab3592929c8a] Going to try to terminate instance {{(pid=120416) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 17:36:14.999328 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-ea14f9ac-ee77-417d-a89a-191c741e938e tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "DELETE /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a" status: 204 len: 0 microversion: 2.20 time: 0.132160 Sep 27 17:36:14.999328 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 536/1051] 10.222.0.55 () {60 vars in 1280 bytes} [Tue Sep 27 17:36:14 2022] DELETE /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 27 17:36:15.007570 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-a0926b33-03c9-4ae3-a465-a0c5c1afd691 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:36:15.008180 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-a0926b33-03c9-4ae3-a465-a0c5c1afd691 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: f84aa405-baed-4bb8-84db-ab3592929c8a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:36:15.014156 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a0926b33-03c9-4ae3-a465-a0c5c1afd691 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:36:15.014638 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a0926b33-03c9-4ae3-a465-a0c5c1afd691 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:36:15.015076 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a0926b33-03c9-4ae3-a465-a0c5c1afd691 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:36:15.015759 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a0926b33-03c9-4ae3-a465-a0c5c1afd691 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:36:15.016209 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a0926b33-03c9-4ae3-a465-a0c5c1afd691 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:36:15.016630 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a0926b33-03c9-4ae3-a465-a0c5c1afd691 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:36:15.145781 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-a0926b33-03c9-4ae3-a465-a0c5c1afd691 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:36:15.154259 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-a0926b33-03c9-4ae3-a465-a0c5c1afd691 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:36:15.155708 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-a0926b33-03c9-4ae3-a465-a0c5c1afd691 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:36:15.156878 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-a0926b33-03c9-4ae3-a465-a0c5c1afd691 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a" status: 200 len: 1724 microversion: 2.20 time: 0.153637 Sep 27 17:36:15.157439 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 516/1052] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:36:15 2022] GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 27 17:36:16.183409 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-90e640b8-0914-4988-9df4-78c6ce1437d8 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:36:16.184033 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-90e640b8-0914-4988-9df4-78c6ce1437d8 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: f84aa405-baed-4bb8-84db-ab3592929c8a] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:36:16.190097 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-90e640b8-0914-4988-9df4-78c6ce1437d8 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:36:16.190581 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-90e640b8-0914-4988-9df4-78c6ce1437d8 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:36:16.191013 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-90e640b8-0914-4988-9df4-78c6ce1437d8 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:36:16.191717 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-90e640b8-0914-4988-9df4-78c6ce1437d8 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:36:16.192150 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-90e640b8-0914-4988-9df4-78c6ce1437d8 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:36:16.192575 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-90e640b8-0914-4988-9df4-78c6ce1437d8 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:36:16.323655 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-90e640b8-0914-4988-9df4-78c6ce1437d8 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:36:16.332245 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-90e640b8-0914-4988-9df4-78c6ce1437d8 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:36:16.333703 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-90e640b8-0914-4988-9df4-78c6ce1437d8 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:36:16.334892 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-90e640b8-0914-4988-9df4-78c6ce1437d8 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a" status: 200 len: 1724 microversion: 2.20 time: 0.155921 Sep 27 17:36:16.335452 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 537/1053] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:36:16 2022] GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:36:17.361130 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-eb3fa310-346e-4e7a-a82d-a0c8fd504c08 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:36:17.361870 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-eb3fa310-346e-4e7a-a82d-a0c8fd504c08 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: f84aa405-baed-4bb8-84db-ab3592929c8a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:36:17.368232 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-eb3fa310-346e-4e7a-a82d-a0c8fd504c08 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:36:17.368718 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-eb3fa310-346e-4e7a-a82d-a0c8fd504c08 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:36:17.369159 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-eb3fa310-346e-4e7a-a82d-a0c8fd504c08 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:36:17.369850 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-eb3fa310-346e-4e7a-a82d-a0c8fd504c08 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:36:17.370336 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-eb3fa310-346e-4e7a-a82d-a0c8fd504c08 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:36:17.370762 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-eb3fa310-346e-4e7a-a82d-a0c8fd504c08 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:36:17.836229 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-eb3fa310-346e-4e7a-a82d-a0c8fd504c08 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:36:17.845160 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-eb3fa310-346e-4e7a-a82d-a0c8fd504c08 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:36:17.846633 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-eb3fa310-346e-4e7a-a82d-a0c8fd504c08 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1dde550901f04ea695b85db4e41d9628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37e99b06d94d4893963a88cd5333ec5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:36:17.847797 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-eb3fa310-346e-4e7a-a82d-a0c8fd504c08 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a" status: 200 len: 1724 microversion: 2.20 time: 0.490933 Sep 27 17:36:17.848359 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 517/1054] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:36:17 2022] GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a => generated 1724 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 27 17:36:18.060937 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [req-91ff1895-f9e5-4d2b-bbae-f8283c5bb12a req-8bfdfde2-c01e-4909-807a-ad00dd57b973 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f84aa405-baed-4bb8-84db-ab3592929c8a", "name": "network-vif-deleted", "tag": "44bdfd6c-6234-47ec-8359-4819b713d0a5"}]} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:36:18.083250 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-91ff1895-f9e5-4d2b-bbae-f8283c5bb12a req-8bfdfde2-c01e-4909-807a-ad00dd57b973 service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:36:18.083746 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-91ff1895-f9e5-4d2b-bbae-f8283c5bb12a req-8bfdfde2-c01e-4909-807a-ad00dd57b973 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:36:18.084224 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-91ff1895-f9e5-4d2b-bbae-f8283c5bb12a req-8bfdfde2-c01e-4909-807a-ad00dd57b973 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:36:18.104432 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.compute.server_external_events [req-91ff1895-f9e5-4d2b-bbae-f8283c5bb12a req-8bfdfde2-c01e-4909-807a-ad00dd57b973 service nova] Creating event network-vif-deleted:44bdfd6c-6234-47ec-8359-4819b713d0a5 for instance f84aa405-baed-4bb8-84db-ab3592929c8a on hv-cinder-84914 Sep 27 17:36:18.110437 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [req-91ff1895-f9e5-4d2b-bbae-f8283c5bb12a req-8bfdfde2-c01e-4909-807a-ad00dd57b973 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054669 Sep 27 17:36:18.111409 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 538/1055] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:36:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:36:18.873784 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-2afa334f-5a94-4fe2-9ae5-da84d743e919 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:36:18.874413 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-2afa334f-5a94-4fe2-9ae5-da84d743e919 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: f84aa405-baed-4bb8-84db-ab3592929c8a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:36:18.880848 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2afa334f-5a94-4fe2-9ae5-da84d743e919 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:36:18.881322 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2afa334f-5a94-4fe2-9ae5-da84d743e919 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:36:18.881782 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2afa334f-5a94-4fe2-9ae5-da84d743e919 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:36:18.882571 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2afa334f-5a94-4fe2-9ae5-da84d743e919 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:36:18.883020 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2afa334f-5a94-4fe2-9ae5-da84d743e919 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:36:18.883471 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2afa334f-5a94-4fe2-9ae5-da84d743e919 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:36:18.897421 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.wsgi [None req-2afa334f-5a94-4fe2-9ae5-da84d743e919 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] HTTP exception thrown: Instance f84aa405-baed-4bb8-84db-ab3592929c8a could not be found. Sep 27 17:36:18.900121 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-2afa334f-5a94-4fe2-9ae5-da84d743e919 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Request method failure captured: Sep 27 17:36:18.900121 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: request: GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a HTTP/1.1 Sep 27 17:36:18.900121 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Accept: application/json Sep 27 17:36:18.900121 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Accept-Encoding: identity Sep 27 17:36:18.900121 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Connection: close Sep 27 17:36:18.900121 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Content-Length: 0 Sep 27 17:36:18.900121 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Content-Type: application/json Sep 27 17:36:18.900121 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Host: 10.222.0.55 Sep 27 17:36:18.900121 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Openstack-System-Scope: None Sep 27 17:36:18.900121 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: User-Agent: python-urllib3/1.26.12 Sep 27 17:36:18.900121 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Auth-Token: gAAAAABjMzHAUiO-mPVUnCvy6QI7Oq1nDlIAD_-_evMkfe_qxqArGHJxRGlzShHUdps_laFtBISooFJxpfzb2M3mHoK6u-tIvYODDQoBNgF0Mt4SBb9l9NLNg2qWl-CrRmghfQ7kn6fXQei6ULZGIWjiGAHEMPr7t58rdN50BvMp8i3LNg7Gytw Sep 27 17:36:18.900121 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Domain-Id: None Sep 27 17:36:18.900121 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Domain-Name: None Sep 27 17:36:18.900121 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Identity-Status: Confirmed Sep 27 17:36:18.900121 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Is-Admin-Project: True Sep 27 17:36:18.900121 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Openstack-Nova-Api-Version: 2.20 Sep 27 17:36:18.900121 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Domain-Id: default Sep 27 17:36:18.900121 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Domain-Name: Default Sep 27 17:36:18.900121 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Id: 37e99b06d94d4893963a88cd5333ec5b Sep 27 17:36:18.900121 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1168253535 Sep 27 17:36:18.900121 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Role: reader,member Sep 27 17:36:18.900121 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Roles: reader,member Sep 27 17:36:18.901890 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/37e99b06d94d4893963a88cd5333ec5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_37e99b06d94d4893963a88cd5333ec5b", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/37e99b06d94d4893963a88cd5333ec5b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/37e99b06d94d4893963a88cd5333ec5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 27 17:36:18.901890 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1168253535 Sep 27 17:36:18.901890 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Tenant-Id: 37e99b06d94d4893963a88cd5333ec5b Sep 27 17:36:18.901890 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1168253535 Sep 27 17:36:18.901890 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User: tempest-AttachVolumeShelveTestJSON-1168253535-project Sep 27 17:36:18.901890 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Domain-Id: default Sep 27 17:36:18.901890 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Domain-Name: Default Sep 27 17:36:18.901890 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Id: 1dde550901f04ea695b85db4e41d9628 Sep 27 17:36:18.901890 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1168253535-project Sep 27 17:36:18.901890 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: method: > Sep 27 17:36:18.901890 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: exception: Instance f84aa405-baed-4bb8-84db-ab3592929c8a could not be found. Sep 27 17:36:18.901890 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: action_args: {'id': 'f84aa405-baed-4bb8-84db-ab3592929c8a'} Sep 27 17:36:18.902985 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 17:36:18.902985 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:36:18.902985 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 17:36:18.902985 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 17:36:18.902985 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 17:36:18.902985 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 17:36:18.902985 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 17:36:18.902985 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 17:36:18.902985 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 17:36:18.902985 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 17:36:18.902985 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f84aa405-baed-4bb8-84db-ab3592929c8a could not be found. Sep 27 17:36:18.902985 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:36:18.902985 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:36:18.902985 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:36:18.902985 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:36:18.902985 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:36:18.902985 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:36:18.902985 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 17:36:18.902985 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 17:36:18.902985 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 17:36:18.904388 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 17:36:18.904388 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 17:36:18.904388 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 17:36:18.904388 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 17:36:18.904388 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 17:36:18.904388 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 17:36:18.904388 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 17:36:18.904388 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f84aa405-baed-4bb8-84db-ab3592929c8a could not be found. Sep 27 17:36:18.904388 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:36:18.904388 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:36:18.904388 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:36:18.904388 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:36:18.904388 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:36:18.904388 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:36:18.904388 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 17:36:18.904388 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 17:36:18.904388 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f84aa405-baed-4bb8-84db-ab3592929c8a could not be found. Sep 27 17:36:18.904388 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:36:18.906240 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-2afa334f-5a94-4fe2-9ae5-da84d743e919 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Returning 404 to user: Instance f84aa405-baed-4bb8-84db-ab3592929c8a could not be found. {{(pid=120415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 17:36:18.906240 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-2afa334f-5a94-4fe2-9ae5-da84d743e919 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a" status: 404 len: 111 microversion: 2.20 time: 0.031316 Sep 27 17:36:18.906240 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 518/1056] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:36:18 2022] GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 27 17:36:18.910451 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-fc1304d3-387d-4e74-ae5c-6d70b8dabec8 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '.version_select at 0x7fe728253430>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:36:18.929525 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-fc1304d3-387d-4e74-ae5c-6d70b8dabec8 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2115451150" status: 204 len: 0 microversion: 2.20 time: 0.023137 Sep 27 17:36:18.930529 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 539/1057] 10.222.0.55 () {60 vars in 1262 bytes} [Tue Sep 27 17:36:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2115451150 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 27 17:36:20.693568 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-2987c685-dead-4ce9-be90-e9b95f92f0b1 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:36:20.694088 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-2987c685-dead-4ce9-be90-e9b95f92f0b1 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: f84aa405-baed-4bb8-84db-ab3592929c8a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:36:20.700900 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2987c685-dead-4ce9-be90-e9b95f92f0b1 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:36:20.701385 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2987c685-dead-4ce9-be90-e9b95f92f0b1 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:36:20.701824 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2987c685-dead-4ce9-be90-e9b95f92f0b1 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:36:20.702551 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2987c685-dead-4ce9-be90-e9b95f92f0b1 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:36:20.703003 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2987c685-dead-4ce9-be90-e9b95f92f0b1 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:36:20.703427 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2987c685-dead-4ce9-be90-e9b95f92f0b1 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:36:20.717295 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.wsgi [None req-2987c685-dead-4ce9-be90-e9b95f92f0b1 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] HTTP exception thrown: Instance f84aa405-baed-4bb8-84db-ab3592929c8a could not be found. Sep 27 17:36:20.718869 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-2987c685-dead-4ce9-be90-e9b95f92f0b1 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Request method failure captured: Sep 27 17:36:20.718869 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: request: DELETE /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a HTTP/1.1 Sep 27 17:36:20.718869 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Accept: application/json Sep 27 17:36:20.718869 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Accept-Encoding: identity Sep 27 17:36:20.718869 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Connection: close Sep 27 17:36:20.718869 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Content-Length: 0 Sep 27 17:36:20.718869 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Content-Type: application/json Sep 27 17:36:20.718869 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Host: 10.222.0.55 Sep 27 17:36:20.718869 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Openstack-System-Scope: None Sep 27 17:36:20.718869 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: User-Agent: python-urllib3/1.26.12 Sep 27 17:36:20.718869 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Auth-Token: gAAAAABjMzHAUiO-mPVUnCvy6QI7Oq1nDlIAD_-_evMkfe_qxqArGHJxRGlzShHUdps_laFtBISooFJxpfzb2M3mHoK6u-tIvYODDQoBNgF0Mt4SBb9l9NLNg2qWl-CrRmghfQ7kn6fXQei6ULZGIWjiGAHEMPr7t58rdN50BvMp8i3LNg7Gytw Sep 27 17:36:20.718869 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Domain-Id: None Sep 27 17:36:20.718869 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Domain-Name: None Sep 27 17:36:20.718869 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Identity-Status: Confirmed Sep 27 17:36:20.718869 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Is-Admin-Project: True Sep 27 17:36:20.718869 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Openstack-Nova-Api-Version: 2.20 Sep 27 17:36:20.718869 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Domain-Id: default Sep 27 17:36:20.718869 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Domain-Name: Default Sep 27 17:36:20.718869 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Id: 37e99b06d94d4893963a88cd5333ec5b Sep 27 17:36:20.718869 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1168253535 Sep 27 17:36:20.718869 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Role: reader,member Sep 27 17:36:20.718869 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Roles: reader,member Sep 27 17:36:20.720587 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/37e99b06d94d4893963a88cd5333ec5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_37e99b06d94d4893963a88cd5333ec5b", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/37e99b06d94d4893963a88cd5333ec5b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/37e99b06d94d4893963a88cd5333ec5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 27 17:36:20.720587 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1168253535 Sep 27 17:36:20.720587 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Tenant-Id: 37e99b06d94d4893963a88cd5333ec5b Sep 27 17:36:20.720587 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1168253535 Sep 27 17:36:20.720587 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User: tempest-AttachVolumeShelveTestJSON-1168253535-project Sep 27 17:36:20.720587 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Domain-Id: default Sep 27 17:36:20.720587 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Domain-Name: Default Sep 27 17:36:20.720587 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Id: 1dde550901f04ea695b85db4e41d9628 Sep 27 17:36:20.720587 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1168253535-project Sep 27 17:36:20.720587 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: method: > Sep 27 17:36:20.720587 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: exception: Instance f84aa405-baed-4bb8-84db-ab3592929c8a could not be found. Sep 27 17:36:20.720587 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: action_args: {'id': 'f84aa405-baed-4bb8-84db-ab3592929c8a'} Sep 27 17:36:20.721411 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 17:36:20.721411 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:36:20.721411 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 17:36:20.721411 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 17:36:20.721411 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 17:36:20.721411 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 17:36:20.721411 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 17:36:20.721411 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 17:36:20.721411 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 17:36:20.721411 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 17:36:20.721411 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f84aa405-baed-4bb8-84db-ab3592929c8a could not be found. Sep 27 17:36:20.721411 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:36:20.721411 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:36:20.721411 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:36:20.721411 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:36:20.721411 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:36:20.721411 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:36:20.721411 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 17:36:20.721411 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 17:36:20.721411 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 17:36:20.722690 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 17:36:20.722690 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 27 17:36:20.722690 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 27 17:36:20.722690 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 27 17:36:20.722690 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 27 17:36:20.722690 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 17:36:20.722690 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 17:36:20.722690 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 17:36:20.722690 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 17:36:20.722690 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f84aa405-baed-4bb8-84db-ab3592929c8a could not be found. Sep 27 17:36:20.722690 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:36:20.722690 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:36:20.722690 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:36:20.722690 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:36:20.722690 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:36:20.722690 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:36:20.722690 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 17:36:20.722690 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 17:36:20.722690 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f84aa405-baed-4bb8-84db-ab3592929c8a could not be found. Sep 27 17:36:20.722690 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:36:20.723931 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-2987c685-dead-4ce9-be90-e9b95f92f0b1 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Returning 404 to user: Instance f84aa405-baed-4bb8-84db-ab3592929c8a could not be found. {{(pid=120415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 17:36:20.723931 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-2987c685-dead-4ce9-be90-e9b95f92f0b1 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "DELETE /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a" status: 404 len: 111 microversion: 2.20 time: 0.030529 Sep 27 17:36:20.723931 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 519/1058] 10.222.0.55 () {60 vars in 1280 bytes} [Tue Sep 27 17:36:20 2022] DELETE /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 27 17:36:20.728659 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-5367ca97-ab03-4f45-9934-308ca541c69c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:36:20.729382 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-5367ca97-ab03-4f45-9934-308ca541c69c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: f84aa405-baed-4bb8-84db-ab3592929c8a] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:36:20.736474 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5367ca97-ab03-4f45-9934-308ca541c69c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:36:20.736945 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5367ca97-ab03-4f45-9934-308ca541c69c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:36:20.737373 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5367ca97-ab03-4f45-9934-308ca541c69c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:36:20.738043 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5367ca97-ab03-4f45-9934-308ca541c69c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:36:20.738594 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5367ca97-ab03-4f45-9934-308ca541c69c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:36:20.738995 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5367ca97-ab03-4f45-9934-308ca541c69c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:36:20.751635 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.wsgi [None req-5367ca97-ab03-4f45-9934-308ca541c69c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] HTTP exception thrown: Instance f84aa405-baed-4bb8-84db-ab3592929c8a could not be found. Sep 27 17:36:20.753195 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-5367ca97-ab03-4f45-9934-308ca541c69c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Request method failure captured: Sep 27 17:36:20.753195 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: request: GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a HTTP/1.1 Sep 27 17:36:20.753195 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Accept: application/json Sep 27 17:36:20.753195 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Accept-Encoding: identity Sep 27 17:36:20.753195 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Connection: close Sep 27 17:36:20.753195 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Content-Length: 0 Sep 27 17:36:20.753195 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Content-Type: application/json Sep 27 17:36:20.753195 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Host: 10.222.0.55 Sep 27 17:36:20.753195 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Openstack-System-Scope: None Sep 27 17:36:20.753195 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: User-Agent: python-urllib3/1.26.12 Sep 27 17:36:20.753195 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Auth-Token: gAAAAABjMzHAUiO-mPVUnCvy6QI7Oq1nDlIAD_-_evMkfe_qxqArGHJxRGlzShHUdps_laFtBISooFJxpfzb2M3mHoK6u-tIvYODDQoBNgF0Mt4SBb9l9NLNg2qWl-CrRmghfQ7kn6fXQei6ULZGIWjiGAHEMPr7t58rdN50BvMp8i3LNg7Gytw Sep 27 17:36:20.753195 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Domain-Id: None Sep 27 17:36:20.753195 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Domain-Name: None Sep 27 17:36:20.753195 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Identity-Status: Confirmed Sep 27 17:36:20.753195 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Is-Admin-Project: True Sep 27 17:36:20.753195 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Openstack-Nova-Api-Version: 2.20 Sep 27 17:36:20.753195 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Domain-Id: default Sep 27 17:36:20.753195 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Domain-Name: Default Sep 27 17:36:20.753195 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Id: 37e99b06d94d4893963a88cd5333ec5b Sep 27 17:36:20.753195 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1168253535 Sep 27 17:36:20.753195 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Role: reader,member Sep 27 17:36:20.753195 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Roles: reader,member Sep 27 17:36:20.754935 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/37e99b06d94d4893963a88cd5333ec5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_37e99b06d94d4893963a88cd5333ec5b", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/37e99b06d94d4893963a88cd5333ec5b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/37e99b06d94d4893963a88cd5333ec5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 27 17:36:20.754935 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1168253535 Sep 27 17:36:20.754935 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Tenant-Id: 37e99b06d94d4893963a88cd5333ec5b Sep 27 17:36:20.754935 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1168253535 Sep 27 17:36:20.754935 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User: tempest-AttachVolumeShelveTestJSON-1168253535-project Sep 27 17:36:20.754935 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Domain-Id: default Sep 27 17:36:20.754935 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Domain-Name: Default Sep 27 17:36:20.754935 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Id: 1dde550901f04ea695b85db4e41d9628 Sep 27 17:36:20.754935 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1168253535-project Sep 27 17:36:20.754935 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: method: > Sep 27 17:36:20.754935 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: exception: Instance f84aa405-baed-4bb8-84db-ab3592929c8a could not be found. Sep 27 17:36:20.754935 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: action_args: {'id': 'f84aa405-baed-4bb8-84db-ab3592929c8a'} Sep 27 17:36:20.755882 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 17:36:20.755882 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:36:20.755882 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 17:36:20.755882 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 17:36:20.755882 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 17:36:20.755882 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 17:36:20.755882 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 17:36:20.755882 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 17:36:20.755882 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 17:36:20.755882 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 17:36:20.755882 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f84aa405-baed-4bb8-84db-ab3592929c8a could not be found. Sep 27 17:36:20.755882 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:36:20.755882 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:36:20.755882 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:36:20.755882 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:36:20.755882 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:36:20.755882 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:36:20.755882 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 17:36:20.755882 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 17:36:20.755882 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 17:36:20.757412 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 17:36:20.757412 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 17:36:20.757412 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 17:36:20.757412 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 17:36:20.757412 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 17:36:20.757412 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 17:36:20.757412 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 17:36:20.757412 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f84aa405-baed-4bb8-84db-ab3592929c8a could not be found. Sep 27 17:36:20.757412 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:36:20.757412 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:36:20.757412 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:36:20.757412 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:36:20.757412 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:36:20.757412 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:36:20.757412 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 17:36:20.757412 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 17:36:20.757412 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f84aa405-baed-4bb8-84db-ab3592929c8a could not be found. Sep 27 17:36:20.757412 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:36:20.758859 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-5367ca97-ab03-4f45-9934-308ca541c69c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Returning 404 to user: Instance f84aa405-baed-4bb8-84db-ab3592929c8a could not be found. {{(pid=120416) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 17:36:20.758859 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-5367ca97-ab03-4f45-9934-308ca541c69c tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a" status: 404 len: 111 microversion: 2.20 time: 0.029833 Sep 27 17:36:20.758859 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 540/1059] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:36:20 2022] GET /compute/v2.1/servers/f84aa405-baed-4bb8-84db-ab3592929c8a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 27 17:36:21.891787 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-c0c6cc33-be58-496b-b256-df529a00f1ff tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:36:21.892288 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-c0c6cc33-be58-496b-b256-df529a00f1ff tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:36:21.898738 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c0c6cc33-be58-496b-b256-df529a00f1ff tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:36:21.899224 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c0c6cc33-be58-496b-b256-df529a00f1ff tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:36:21.899664 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c0c6cc33-be58-496b-b256-df529a00f1ff tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:36:21.900842 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c0c6cc33-be58-496b-b256-df529a00f1ff tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:36:21.901302 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c0c6cc33-be58-496b-b256-df529a00f1ff tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:36:21.901737 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c0c6cc33-be58-496b-b256-df529a00f1ff tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:36:21.919653 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.wsgi [None req-c0c6cc33-be58-496b-b256-df529a00f1ff tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] HTTP exception thrown: Instance d209f2ce-43c8-422a-a703-cdc9a9fb5cee could not be found. Sep 27 17:36:21.921249 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-c0c6cc33-be58-496b-b256-df529a00f1ff tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Request method failure captured: Sep 27 17:36:21.921249 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: request: DELETE /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee HTTP/1.1 Sep 27 17:36:21.921249 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Accept: application/json Sep 27 17:36:21.921249 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Accept-Encoding: identity Sep 27 17:36:21.921249 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Connection: close Sep 27 17:36:21.921249 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Content-Length: 0 Sep 27 17:36:21.921249 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Content-Type: application/json Sep 27 17:36:21.921249 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Host: 10.222.0.55 Sep 27 17:36:21.921249 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Openstack-System-Scope: None Sep 27 17:36:21.921249 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: User-Agent: python-urllib3/1.26.12 Sep 27 17:36:21.921249 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Auth-Token: gAAAAABjMzHAUiO-mPVUnCvy6QI7Oq1nDlIAD_-_evMkfe_qxqArGHJxRGlzShHUdps_laFtBISooFJxpfzb2M3mHoK6u-tIvYODDQoBNgF0Mt4SBb9l9NLNg2qWl-CrRmghfQ7kn6fXQei6ULZGIWjiGAHEMPr7t58rdN50BvMp8i3LNg7Gytw Sep 27 17:36:21.921249 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Domain-Id: None Sep 27 17:36:21.921249 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Domain-Name: None Sep 27 17:36:21.921249 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Identity-Status: Confirmed Sep 27 17:36:21.921249 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Is-Admin-Project: True Sep 27 17:36:21.921249 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Openstack-Nova-Api-Version: 2.20 Sep 27 17:36:21.921249 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Domain-Id: default Sep 27 17:36:21.921249 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Domain-Name: Default Sep 27 17:36:21.921249 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Id: 37e99b06d94d4893963a88cd5333ec5b Sep 27 17:36:21.921249 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1168253535 Sep 27 17:36:21.921249 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Role: reader,member Sep 27 17:36:21.921249 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Roles: reader,member Sep 27 17:36:21.923002 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/37e99b06d94d4893963a88cd5333ec5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_37e99b06d94d4893963a88cd5333ec5b", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/37e99b06d94d4893963a88cd5333ec5b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/37e99b06d94d4893963a88cd5333ec5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 27 17:36:21.923002 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1168253535 Sep 27 17:36:21.923002 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Tenant-Id: 37e99b06d94d4893963a88cd5333ec5b Sep 27 17:36:21.923002 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1168253535 Sep 27 17:36:21.923002 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User: tempest-AttachVolumeShelveTestJSON-1168253535-project Sep 27 17:36:21.923002 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Domain-Id: default Sep 27 17:36:21.923002 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Domain-Name: Default Sep 27 17:36:21.923002 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Id: 1dde550901f04ea695b85db4e41d9628 Sep 27 17:36:21.923002 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1168253535-project Sep 27 17:36:21.923002 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: method: > Sep 27 17:36:21.923002 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: exception: Instance d209f2ce-43c8-422a-a703-cdc9a9fb5cee could not be found. Sep 27 17:36:21.923002 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: action_args: {'id': 'd209f2ce-43c8-422a-a703-cdc9a9fb5cee'} Sep 27 17:36:21.923958 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 17:36:21.923958 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:36:21.923958 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 17:36:21.923958 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 17:36:21.923958 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 17:36:21.923958 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 17:36:21.923958 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 17:36:21.923958 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 17:36:21.923958 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 17:36:21.923958 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 17:36:21.923958 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d209f2ce-43c8-422a-a703-cdc9a9fb5cee could not be found. Sep 27 17:36:21.923958 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:36:21.923958 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:36:21.923958 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:36:21.923958 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:36:21.923958 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:36:21.923958 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:36:21.923958 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 17:36:21.923958 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 17:36:21.923958 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 17:36:21.925646 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 17:36:21.925646 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 27 17:36:21.925646 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 27 17:36:21.925646 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 27 17:36:21.925646 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 27 17:36:21.925646 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 17:36:21.925646 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 17:36:21.925646 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 17:36:21.925646 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 17:36:21.925646 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d209f2ce-43c8-422a-a703-cdc9a9fb5cee could not be found. Sep 27 17:36:21.925646 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:36:21.925646 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:36:21.925646 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:36:21.925646 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:36:21.925646 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:36:21.925646 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:36:21.925646 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 17:36:21.925646 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 17:36:21.925646 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d209f2ce-43c8-422a-a703-cdc9a9fb5cee could not be found. Sep 27 17:36:21.925646 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:36:21.927534 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-c0c6cc33-be58-496b-b256-df529a00f1ff tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Returning 404 to user: Instance d209f2ce-43c8-422a-a703-cdc9a9fb5cee could not be found. {{(pid=120415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 17:36:21.927534 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-c0c6cc33-be58-496b-b256-df529a00f1ff tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "DELETE /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 404 len: 111 microversion: 2.20 time: 0.035114 Sep 27 17:36:21.927534 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 520/1060] 10.222.0.55 () {60 vars in 1280 bytes} [Tue Sep 27 17:36:21 2022] DELETE /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 27 17:36:21.931488 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-ebdef4cb-35f7-4c23-8846-3b041b694335 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:36:21.932166 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-ebdef4cb-35f7-4c23-8846-3b041b694335 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] [instance: d209f2ce-43c8-422a-a703-cdc9a9fb5cee] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:36:21.938479 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ebdef4cb-35f7-4c23-8846-3b041b694335 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:36:21.938949 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ebdef4cb-35f7-4c23-8846-3b041b694335 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:36:21.939373 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ebdef4cb-35f7-4c23-8846-3b041b694335 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:36:21.940044 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ebdef4cb-35f7-4c23-8846-3b041b694335 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:36:21.940485 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ebdef4cb-35f7-4c23-8846-3b041b694335 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:36:21.940906 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ebdef4cb-35f7-4c23-8846-3b041b694335 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:36:21.953664 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.wsgi [None req-ebdef4cb-35f7-4c23-8846-3b041b694335 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] HTTP exception thrown: Instance d209f2ce-43c8-422a-a703-cdc9a9fb5cee could not be found. Sep 27 17:36:21.955235 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-ebdef4cb-35f7-4c23-8846-3b041b694335 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Request method failure captured: Sep 27 17:36:21.955235 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: request: GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee HTTP/1.1 Sep 27 17:36:21.955235 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Accept: application/json Sep 27 17:36:21.955235 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Accept-Encoding: identity Sep 27 17:36:21.955235 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Connection: close Sep 27 17:36:21.955235 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Content-Length: 0 Sep 27 17:36:21.955235 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Content-Type: application/json Sep 27 17:36:21.955235 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Host: 10.222.0.55 Sep 27 17:36:21.955235 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Openstack-System-Scope: None Sep 27 17:36:21.955235 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: User-Agent: python-urllib3/1.26.12 Sep 27 17:36:21.955235 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Auth-Token: gAAAAABjMzHAUiO-mPVUnCvy6QI7Oq1nDlIAD_-_evMkfe_qxqArGHJxRGlzShHUdps_laFtBISooFJxpfzb2M3mHoK6u-tIvYODDQoBNgF0Mt4SBb9l9NLNg2qWl-CrRmghfQ7kn6fXQei6ULZGIWjiGAHEMPr7t58rdN50BvMp8i3LNg7Gytw Sep 27 17:36:21.955235 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Domain-Id: None Sep 27 17:36:21.955235 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Domain-Name: None Sep 27 17:36:21.955235 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Identity-Status: Confirmed Sep 27 17:36:21.955235 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Is-Admin-Project: True Sep 27 17:36:21.955235 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Openstack-Nova-Api-Version: 2.20 Sep 27 17:36:21.955235 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Domain-Id: default Sep 27 17:36:21.955235 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Domain-Name: Default Sep 27 17:36:21.955235 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Id: 37e99b06d94d4893963a88cd5333ec5b Sep 27 17:36:21.955235 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1168253535 Sep 27 17:36:21.955235 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Role: reader,member Sep 27 17:36:21.955235 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Roles: reader,member Sep 27 17:36:21.956950 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/37e99b06d94d4893963a88cd5333ec5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_37e99b06d94d4893963a88cd5333ec5b", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/37e99b06d94d4893963a88cd5333ec5b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/37e99b06d94d4893963a88cd5333ec5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 27 17:36:21.956950 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1168253535 Sep 27 17:36:21.956950 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Tenant-Id: 37e99b06d94d4893963a88cd5333ec5b Sep 27 17:36:21.956950 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1168253535 Sep 27 17:36:21.956950 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User: tempest-AttachVolumeShelveTestJSON-1168253535-project Sep 27 17:36:21.956950 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Domain-Id: default Sep 27 17:36:21.956950 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Domain-Name: Default Sep 27 17:36:21.956950 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Id: 1dde550901f04ea695b85db4e41d9628 Sep 27 17:36:21.956950 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1168253535-project Sep 27 17:36:21.956950 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: method: > Sep 27 17:36:21.956950 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: exception: Instance d209f2ce-43c8-422a-a703-cdc9a9fb5cee could not be found. Sep 27 17:36:21.956950 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: action_args: {'id': 'd209f2ce-43c8-422a-a703-cdc9a9fb5cee'} Sep 27 17:36:21.957904 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 17:36:21.957904 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:36:21.957904 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 17:36:21.957904 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 17:36:21.957904 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 17:36:21.957904 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 17:36:21.957904 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 17:36:21.957904 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 17:36:21.957904 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 17:36:21.957904 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 17:36:21.957904 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d209f2ce-43c8-422a-a703-cdc9a9fb5cee could not be found. Sep 27 17:36:21.957904 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:36:21.957904 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:36:21.957904 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:36:21.957904 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:36:21.957904 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:36:21.957904 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:36:21.957904 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 17:36:21.957904 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 17:36:21.957904 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 17:36:21.959248 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 17:36:21.959248 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 17:36:21.959248 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 17:36:21.959248 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 17:36:21.959248 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 17:36:21.959248 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 17:36:21.959248 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 17:36:21.959248 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d209f2ce-43c8-422a-a703-cdc9a9fb5cee could not be found. Sep 27 17:36:21.959248 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:36:21.959248 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:36:21.959248 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:36:21.959248 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:36:21.959248 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:36:21.959248 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:36:21.959248 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 17:36:21.959248 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 17:36:21.959248 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d209f2ce-43c8-422a-a703-cdc9a9fb5cee could not be found. Sep 27 17:36:21.959248 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:36:21.960357 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-ebdef4cb-35f7-4c23-8846-3b041b694335 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] Returning 404 to user: Instance d209f2ce-43c8-422a-a703-cdc9a9fb5cee could not be found. {{(pid=120416) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 17:36:21.960357 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-ebdef4cb-35f7-4c23-8846-3b041b694335 tempest-AttachVolumeShelveTestJSON-1168253535 tempest-AttachVolumeShelveTestJSON-1168253535-project] 10.222.0.55 "GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee" status: 404 len: 111 microversion: 2.20 time: 0.029015 Sep 27 17:36:21.960357 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 541/1061] 10.222.0.55 () {60 vars in 1277 bytes} [Tue Sep 27 17:36:21 2022] GET /compute/v2.1/servers/d209f2ce-43c8-422a-a703-cdc9a9fb5cee => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 27 17:36:30.611655 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-bca4ab1e-d553-40ea-9537-4fea7a07ca7b tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Action: 'create', calling method: .version_select at 0x7fe724cd9280>, body: {"keypair": {"name": "tempest-keypair-1948400134", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNdGJF5jrlad0bwWuPELKKltXddUh0jqe4s57FAIFEZGiMUdDpzxAorks2a7SAJdnR3oPLnJP1zefymkUevcE8t1N9mBdKLnvP6SSX0YtS9eQ5VSeJu5fuR2CGiU1BNTCg=="}} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:36:30.627996 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.quota [None req-bca4ab1e-d553-40ea-9537-4fea7a07ca7b tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Getting quotas for project 0bd65ea59a6d41219ecf99f5a554056a. Resources: {'key_pairs'} {{(pid=120415) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 17:36:30.631989 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.quota [None req-bca4ab1e-d553-40ea-9537-4fea7a07ca7b tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Getting quotas for user 1b888fd409954909874b5443cfed2838 and project 0bd65ea59a6d41219ecf99f5a554056a. Resources: {'key_pairs'} {{(pid=120415) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 17:36:30.655394 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-bca4ab1e-d553-40ea-9537-4fea7a07ca7b tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.163717 Sep 27 17:36:30.655998 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 521/1062] 10.222.0.55 () {60 vars in 1159 bytes} [Tue Sep 27 17:36:30 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:36:32.162852 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-7a2e239a-e9c9-419f-bfeb-b279f350cded tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1784902290", "imageRef": "9355bd92-0a49-42cd-b079-ff9f0d54b91b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "49c3b1bc-0887-4bf4-a331-6a649d0d76a8"}], "security_groups": [{"name": "tempest-securitygroup--1180759051"}], "key_name": "tempest-keypair-1948400134", "user_data": "}} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:36:32.172433 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:36:32.173233 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:36:32.270822 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.network.neutron [None req-7a2e239a-e9c9-419f-bfeb-b279f350cded tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] validate_networks() for [('49c3b1bc-0887-4bf4-a331-6a649d0d76a8', None, None, None, None, None)] {{(pid=120416) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 17:36:32.708902 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.virt.hardware [None req-7a2e239a-e9c9-419f-bfeb-b279f350cded tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Flavor limits 0:0:0 {{(pid=120416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 17:36:32.709361 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.virt.hardware [None req-7a2e239a-e9c9-419f-bfeb-b279f350cded tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Image limits 0:0:0 {{(pid=120416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 17:36:32.709858 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.virt.hardware [None req-7a2e239a-e9c9-419f-bfeb-b279f350cded tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Flavor pref 0:0:0 {{(pid=120416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 17:36:32.710292 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.virt.hardware [None req-7a2e239a-e9c9-419f-bfeb-b279f350cded tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Image pref 0:0:0 {{(pid=120416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 17:36:32.710695 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.virt.hardware [None req-7a2e239a-e9c9-419f-bfeb-b279f350cded tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 17:36:32.719663 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7a2e239a-e9c9-419f-bfeb-b279f350cded tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:36:32.720341 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7a2e239a-e9c9-419f-bfeb-b279f350cded tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:36:32.720842 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7a2e239a-e9c9-419f-bfeb-b279f350cded tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:36:32.721581 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7a2e239a-e9c9-419f-bfeb-b279f350cded tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:36:32.722041 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7a2e239a-e9c9-419f-bfeb-b279f350cded tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:36:32.722514 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7a2e239a-e9c9-419f-bfeb-b279f350cded tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:36:32.739901 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.quota [None req-7a2e239a-e9c9-419f-bfeb-b279f350cded tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Getting quotas for project 0bd65ea59a6d41219ecf99f5a554056a. Resources: {'cores', 'ram', 'instances'} {{(pid=120416) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 17:36:32.743907 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.quota [None req-7a2e239a-e9c9-419f-bfeb-b279f350cded tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Getting quotas for user 1b888fd409954909874b5443cfed2838 and project 0bd65ea59a6d41219ecf99f5a554056a. Resources: {'cores', 'ram', 'instances'} {{(pid=120416) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 17:36:32.755872 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-7a2e239a-e9c9-419f-bfeb-b279f350cded tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Going to run 1 instances... {{(pid=120416) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 17:36:32.758276 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-7a2e239a-e9c9-419f-bfeb-b279f350cded tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: 9e6cccab-407e-45f8-9eb3-586fa28cd817] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9355bd92-0a49-42cd-b079-ff9f0d54b91b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120416) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 17:36:32.818024 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-7a2e239a-e9c9-419f-bfeb-b279f350cded tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.659486 Sep 27 17:36:32.818716 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 542/1063] 10.222.0.55 () {60 vars in 1147 bytes} [Tue Sep 27 17:36:32 2022] POST /compute/v2.1/servers => generated 402 bytes in 661 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 17:36:32.827207 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell1:SELECT=24 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:36:32.831565 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-ce022ffb-d265-4116-88bc-56adebd32766 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:36:32.832183 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-ce022ffb-d265-4116-88bc-56adebd32766 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: 9e6cccab-407e-45f8-9eb3-586fa28cd817] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:36:32.888396 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-ce022ffb-d265-4116-88bc-56adebd32766 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b888fd409954909874b5443cfed2838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd65ea59a6d41219ecf99f5a554056a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:36:32.896991 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-ce022ffb-d265-4116-88bc-56adebd32766 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817" status: 200 len: 1238 microversion: 2.1 time: 0.070849 Sep 27 17:36:32.897396 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 522/1064] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:36:32 2022] GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817 => generated 1238 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:36:33.921681 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-0862928d-ca2e-4979-b12f-2d6903f9d35b tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:36:33.922330 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-0862928d-ca2e-4979-b12f-2d6903f9d35b tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: 9e6cccab-407e-45f8-9eb3-586fa28cd817] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:36:33.929232 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-0862928d-ca2e-4979-b12f-2d6903f9d35b tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:36:33.929729 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-0862928d-ca2e-4979-b12f-2d6903f9d35b tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:36:33.930195 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-0862928d-ca2e-4979-b12f-2d6903f9d35b tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:36:33.930903 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-0862928d-ca2e-4979-b12f-2d6903f9d35b tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:36:33.931363 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-0862928d-ca2e-4979-b12f-2d6903f9d35b tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:36:33.931795 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-0862928d-ca2e-4979-b12f-2d6903f9d35b tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:36:33.996409 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-0862928d-ca2e-4979-b12f-2d6903f9d35b tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b888fd409954909874b5443cfed2838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd65ea59a6d41219ecf99f5a554056a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:36:34.004360 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-0862928d-ca2e-4979-b12f-2d6903f9d35b tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817" status: 200 len: 1290 microversion: 2.1 time: 0.086974 Sep 27 17:36:34.004937 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 543/1065] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:36:33 2022] GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817 => generated 1290 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:36:35.028838 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-5e95ae79-dc5f-418e-bee7-f9175623fadd tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:36:35.029459 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-5e95ae79-dc5f-418e-bee7-f9175623fadd tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: 9e6cccab-407e-45f8-9eb3-586fa28cd817] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:36:35.035889 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5e95ae79-dc5f-418e-bee7-f9175623fadd tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:36:35.036378 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5e95ae79-dc5f-418e-bee7-f9175623fadd tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:36:35.036820 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5e95ae79-dc5f-418e-bee7-f9175623fadd tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:36:35.037522 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5e95ae79-dc5f-418e-bee7-f9175623fadd tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:36:35.037974 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5e95ae79-dc5f-418e-bee7-f9175623fadd tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:36:35.038434 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5e95ae79-dc5f-418e-bee7-f9175623fadd tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:36:35.265684 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-5e95ae79-dc5f-418e-bee7-f9175623fadd tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b888fd409954909874b5443cfed2838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd65ea59a6d41219ecf99f5a554056a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:36:35.273233 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-5e95ae79-dc5f-418e-bee7-f9175623fadd tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817" status: 200 len: 1364 microversion: 2.1 time: 0.248988 Sep 27 17:36:35.273795 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 523/1066] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:36:35 2022] GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817 => generated 1364 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:36:35.633088 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [req-dca6b871-4cfa-478b-b7cd-b3027be183ab req-9af36bc8-e49f-4fe1-9ebd-a453fcc7d54d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e6cccab-407e-45f8-9eb3-586fa28cd817", "tag": "af24e484-4901-4878-9eb2-665f90e32d28"}]} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:36:35.643600 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-dca6b871-4cfa-478b-b7cd-b3027be183ab req-9af36bc8-e49f-4fe1-9ebd-a453fcc7d54d service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:36:35.644108 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-dca6b871-4cfa-478b-b7cd-b3027be183ab req-9af36bc8-e49f-4fe1-9ebd-a453fcc7d54d service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:36:35.644546 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-dca6b871-4cfa-478b-b7cd-b3027be183ab req-9af36bc8-e49f-4fe1-9ebd-a453fcc7d54d service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:36:35.655559 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.compute.server_external_events [req-dca6b871-4cfa-478b-b7cd-b3027be183ab req-9af36bc8-e49f-4fe1-9ebd-a453fcc7d54d service nova] Creating event network-changed:af24e484-4901-4878-9eb2-665f90e32d28 for instance 9e6cccab-407e-45f8-9eb3-586fa28cd817 on hv-cinder-84914 Sep 27 17:36:35.660690 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [req-dca6b871-4cfa-478b-b7cd-b3027be183ab req-9af36bc8-e49f-4fe1-9ebd-a453fcc7d54d service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032075 Sep 27 17:36:35.661285 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 544/1067] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:36:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:36:36.296394 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-8fa65f93-5932-4fe8-b76d-519bf34bc5f8 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:36:36.297008 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-8fa65f93-5932-4fe8-b76d-519bf34bc5f8 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: 9e6cccab-407e-45f8-9eb3-586fa28cd817] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:36:36.303395 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8fa65f93-5932-4fe8-b76d-519bf34bc5f8 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:36:36.303876 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8fa65f93-5932-4fe8-b76d-519bf34bc5f8 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:36:36.304312 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8fa65f93-5932-4fe8-b76d-519bf34bc5f8 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:36:36.305003 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8fa65f93-5932-4fe8-b76d-519bf34bc5f8 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:36:36.305457 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8fa65f93-5932-4fe8-b76d-519bf34bc5f8 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:36:36.305890 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8fa65f93-5932-4fe8-b76d-519bf34bc5f8 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:36:36.435643 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-8fa65f93-5932-4fe8-b76d-519bf34bc5f8 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b888fd409954909874b5443cfed2838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd65ea59a6d41219ecf99f5a554056a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:36:36.443206 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-8fa65f93-5932-4fe8-b76d-519bf34bc5f8 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817" status: 200 len: 1364 microversion: 2.1 time: 0.150728 Sep 27 17:36:36.443773 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 524/1068] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:36:36 2022] GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:36:37.467939 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-be071435-f7e4-478d-94e9-ab1446631253 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:36:37.468631 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-be071435-f7e4-478d-94e9-ab1446631253 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: 9e6cccab-407e-45f8-9eb3-586fa28cd817] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:36:37.474805 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-be071435-f7e4-478d-94e9-ab1446631253 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:36:37.475283 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-be071435-f7e4-478d-94e9-ab1446631253 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:36:37.475714 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-be071435-f7e4-478d-94e9-ab1446631253 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:36:37.476395 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-be071435-f7e4-478d-94e9-ab1446631253 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:36:37.476846 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-be071435-f7e4-478d-94e9-ab1446631253 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:36:37.477270 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-be071435-f7e4-478d-94e9-ab1446631253 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:36:37.607842 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-be071435-f7e4-478d-94e9-ab1446631253 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b888fd409954909874b5443cfed2838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd65ea59a6d41219ecf99f5a554056a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:36:37.615747 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-be071435-f7e4-478d-94e9-ab1446631253 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817" status: 200 len: 1364 microversion: 2.1 time: 0.153015 Sep 27 17:36:37.616307 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 545/1069] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:36:37 2022] GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:36:38.639663 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-ac8b2103-3782-437d-b96d-d7dd28dab4eb tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:36:38.640280 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-ac8b2103-3782-437d-b96d-d7dd28dab4eb tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: 9e6cccab-407e-45f8-9eb3-586fa28cd817] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:36:38.646679 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ac8b2103-3782-437d-b96d-d7dd28dab4eb tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:36:38.647158 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ac8b2103-3782-437d-b96d-d7dd28dab4eb tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:36:38.647590 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ac8b2103-3782-437d-b96d-d7dd28dab4eb tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:36:38.648273 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ac8b2103-3782-437d-b96d-d7dd28dab4eb tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:36:38.648720 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ac8b2103-3782-437d-b96d-d7dd28dab4eb tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:36:38.649136 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ac8b2103-3782-437d-b96d-d7dd28dab4eb tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:36:38.775448 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-ac8b2103-3782-437d-b96d-d7dd28dab4eb tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b888fd409954909874b5443cfed2838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd65ea59a6d41219ecf99f5a554056a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:36:38.783602 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-ac8b2103-3782-437d-b96d-d7dd28dab4eb tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817" status: 200 len: 1364 microversion: 2.1 time: 0.149292 Sep 27 17:36:38.784164 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 525/1070] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:36:38 2022] GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817 => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:36:39.806240 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-701780c0-3dd8-4e28-958d-199ce128234e tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:36:39.806853 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-701780c0-3dd8-4e28-958d-199ce128234e tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: 9e6cccab-407e-45f8-9eb3-586fa28cd817] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:36:39.813896 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-701780c0-3dd8-4e28-958d-199ce128234e tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:36:39.814416 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-701780c0-3dd8-4e28-958d-199ce128234e tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:36:39.814860 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-701780c0-3dd8-4e28-958d-199ce128234e tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:36:39.815548 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-701780c0-3dd8-4e28-958d-199ce128234e tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:36:39.816004 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-701780c0-3dd8-4e28-958d-199ce128234e tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:36:39.816431 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-701780c0-3dd8-4e28-958d-199ce128234e tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:36:40.028022 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-701780c0-3dd8-4e28-958d-199ce128234e tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b888fd409954909874b5443cfed2838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd65ea59a6d41219ecf99f5a554056a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:36:40.035779 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-701780c0-3dd8-4e28-958d-199ce128234e tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817" status: 200 len: 1364 microversion: 2.1 time: 0.233393 Sep 27 17:36:40.036543 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 546/1071] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:36:39 2022] GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817 => generated 1364 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:36:40.178499 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-baa399cc-a196-4796-b915-997f80240d36 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1908450858", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2033463902", "security_groups": [{"name": "tempest-secgroup-smoke-981048707"}], "block_device_mapping_v2": [{"uuid": "308bdece-58b7-417b-b3ec-78ff200edc86", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e7d51347-695f-4b89-ba87-954fe70eed97"}]}} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:36:40.321951 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.network.neutron [None req-baa399cc-a196-4796-b915-997f80240d36 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] validate_networks() for [('e7d51347-695f-4b89-ba87-954fe70eed97', None, None, None, None, None)] {{(pid=120415) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 17:36:40.754926 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-baa399cc-a196-4796-b915-997f80240d36 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Flavor limits 0:0:0 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 17:36:40.755345 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-baa399cc-a196-4796-b915-997f80240d36 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Image limits 0:0:0 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 17:36:40.755816 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-baa399cc-a196-4796-b915-997f80240d36 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Flavor pref 0:0:0 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 17:36:40.756216 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-baa399cc-a196-4796-b915-997f80240d36 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Image pref 0:0:0 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 17:36:40.756647 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-baa399cc-a196-4796-b915-997f80240d36 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 17:36:40.765776 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-baa399cc-a196-4796-b915-997f80240d36 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:36:40.766284 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-baa399cc-a196-4796-b915-997f80240d36 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:36:40.766710 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-baa399cc-a196-4796-b915-997f80240d36 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:36:40.767424 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-baa399cc-a196-4796-b915-997f80240d36 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:36:40.767870 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-baa399cc-a196-4796-b915-997f80240d36 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:36:40.768285 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-baa399cc-a196-4796-b915-997f80240d36 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:36:40.785174 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.quota [None req-baa399cc-a196-4796-b915-997f80240d36 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Getting quotas for project f4db1a85e2504cb9956a6461b5072aa3. Resources: {'cores', 'ram', 'instances'} {{(pid=120415) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 17:36:40.789000 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.quota [None req-baa399cc-a196-4796-b915-997f80240d36 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Getting quotas for user cac1528c35fb464db00b5d18396b8eac and project f4db1a85e2504cb9956a6461b5072aa3. Resources: {'cores', 'ram', 'instances'} {{(pid=120415) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 17:36:40.844760 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-baa399cc-a196-4796-b915-997f80240d36 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Going to run 1 instances... {{(pid=120415) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 17:36:40.846925 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-baa399cc-a196-4796-b915-997f80240d36 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] [instance: 027d6837-5551-4ceb-8905-d16c9a7a382d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='308bdece-58b7-417b-b3ec-78ff200edc86',volume_size=None,volume_type=None)] {{(pid=120415) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 17:36:40.983575 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-baa399cc-a196-4796-b915-997f80240d36 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.809014 Sep 27 17:36:40.984474 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 526/1072] 10.222.0.55 () {60 vars in 1147 bytes} [Tue Sep 27 17:36:40 2022] POST /compute/v2.1/servers => generated 405 bytes in 810 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 17:36:40.995708 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-b072c2ac-5287-4344-b23f-9652f89e95d4 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:36:40.996323 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-b072c2ac-5287-4344-b23f-9652f89e95d4 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] [instance: 027d6837-5551-4ceb-8905-d16c9a7a382d] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:36:41.048956 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-b072c2ac-5287-4344-b23f-9652f89e95d4 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac1528c35fb464db00b5d18396b8eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4db1a85e2504cb9956a6461b5072aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:36:41.057404 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-b072c2ac-5287-4344-b23f-9652f89e95d4 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] 10.222.0.55 "GET /compute/v2.1/servers/027d6837-5551-4ceb-8905-d16c9a7a382d" status: 200 len: 1095 microversion: 2.1 time: 0.065723 Sep 27 17:36:41.058144 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 547/1073] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:36:40 2022] GET /compute/v2.1/servers/027d6837-5551-4ceb-8905-d16c9a7a382d => generated 1095 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:36:41.059278 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-fafb86ba-7a49-4e16-a3fc-c9423260be21 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:36:41.059929 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-fafb86ba-7a49-4e16-a3fc-c9423260be21 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: 9e6cccab-407e-45f8-9eb3-586fa28cd817] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:36:41.066165 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fafb86ba-7a49-4e16-a3fc-c9423260be21 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:36:41.066688 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fafb86ba-7a49-4e16-a3fc-c9423260be21 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:36:41.067223 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fafb86ba-7a49-4e16-a3fc-c9423260be21 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:36:41.068057 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fafb86ba-7a49-4e16-a3fc-c9423260be21 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:36:41.068518 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fafb86ba-7a49-4e16-a3fc-c9423260be21 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:36:41.068947 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fafb86ba-7a49-4e16-a3fc-c9423260be21 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:36:41.205682 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-fafb86ba-7a49-4e16-a3fc-c9423260be21 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b888fd409954909874b5443cfed2838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd65ea59a6d41219ecf99f5a554056a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:36:41.213541 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-fafb86ba-7a49-4e16-a3fc-c9423260be21 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817" status: 200 len: 1364 microversion: 2.1 time: 0.158789 Sep 27 17:36:41.214125 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 527/1074] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:36:41 2022] GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817 => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:36:42.080168 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-13c3e8d7-37ea-4409-bd04-65c233a8eae2 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:36:42.080818 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-13c3e8d7-37ea-4409-bd04-65c233a8eae2 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] [instance: 027d6837-5551-4ceb-8905-d16c9a7a382d] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:36:42.091896 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-13c3e8d7-37ea-4409-bd04-65c233a8eae2 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:36:42.092462 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-13c3e8d7-37ea-4409-bd04-65c233a8eae2 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:36:42.093150 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-13c3e8d7-37ea-4409-bd04-65c233a8eae2 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:36:42.094226 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-13c3e8d7-37ea-4409-bd04-65c233a8eae2 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:36:42.094906 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-13c3e8d7-37ea-4409-bd04-65c233a8eae2 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:36:42.095356 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-13c3e8d7-37ea-4409-bd04-65c233a8eae2 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:36:42.185008 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-13c3e8d7-37ea-4409-bd04-65c233a8eae2 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac1528c35fb464db00b5d18396b8eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4db1a85e2504cb9956a6461b5072aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:36:42.192887 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-13c3e8d7-37ea-4409-bd04-65c233a8eae2 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] 10.222.0.55 "GET /compute/v2.1/servers/027d6837-5551-4ceb-8905-d16c9a7a382d" status: 200 len: 1201 microversion: 2.1 time: 0.116866 Sep 27 17:36:42.193678 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 548/1075] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:36:42 2022] GET /compute/v2.1/servers/027d6837-5551-4ceb-8905-d16c9a7a382d => generated 1201 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:36:42.237072 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-578305b6-05a2-4dce-a408-9c787b043505 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:36:42.237684 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-578305b6-05a2-4dce-a408-9c787b043505 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: 9e6cccab-407e-45f8-9eb3-586fa28cd817] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:36:42.244050 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-578305b6-05a2-4dce-a408-9c787b043505 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:36:42.244531 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-578305b6-05a2-4dce-a408-9c787b043505 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:36:42.244997 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-578305b6-05a2-4dce-a408-9c787b043505 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:36:42.245680 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-578305b6-05a2-4dce-a408-9c787b043505 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:36:42.246157 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-578305b6-05a2-4dce-a408-9c787b043505 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:36:42.246589 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-578305b6-05a2-4dce-a408-9c787b043505 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:36:42.460783 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-578305b6-05a2-4dce-a408-9c787b043505 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b888fd409954909874b5443cfed2838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd65ea59a6d41219ecf99f5a554056a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:36:42.468959 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-578305b6-05a2-4dce-a408-9c787b043505 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817" status: 200 len: 1364 microversion: 2.1 time: 0.235978 Sep 27 17:36:42.469532 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 528/1076] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:36:42 2022] GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817 => generated 1364 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:36:43.216269 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-e168ba0d-1caa-4277-9161-424894f97aea tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:36:43.216902 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-e168ba0d-1caa-4277-9161-424894f97aea tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] [instance: 027d6837-5551-4ceb-8905-d16c9a7a382d] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:36:43.219067 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_cell0:SELECT=2 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:36:43.225646 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e168ba0d-1caa-4277-9161-424894f97aea tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:36:43.226064 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e168ba0d-1caa-4277-9161-424894f97aea tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:36:43.226732 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e168ba0d-1caa-4277-9161-424894f97aea tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:36:43.227700 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e168ba0d-1caa-4277-9161-424894f97aea tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:36:43.228945 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e168ba0d-1caa-4277-9161-424894f97aea tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:36:43.229933 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e168ba0d-1caa-4277-9161-424894f97aea tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:36:43.491837 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-ca1dc315-9496-48e2-8f8c-28e289e14e3a tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:36:43.492405 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-ca1dc315-9496-48e2-8f8c-28e289e14e3a tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: 9e6cccab-407e-45f8-9eb3-586fa28cd817] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:36:43.498703 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ca1dc315-9496-48e2-8f8c-28e289e14e3a tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:36:43.499177 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ca1dc315-9496-48e2-8f8c-28e289e14e3a tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:36:43.499605 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ca1dc315-9496-48e2-8f8c-28e289e14e3a tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:36:43.500283 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ca1dc315-9496-48e2-8f8c-28e289e14e3a tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:36:43.500732 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ca1dc315-9496-48e2-8f8c-28e289e14e3a tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:36:43.501149 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ca1dc315-9496-48e2-8f8c-28e289e14e3a tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:36:43.663007 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-e168ba0d-1caa-4277-9161-424894f97aea tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac1528c35fb464db00b5d18396b8eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4db1a85e2504cb9956a6461b5072aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:36:43.671175 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-e168ba0d-1caa-4277-9161-424894f97aea tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] 10.222.0.55 "GET /compute/v2.1/servers/027d6837-5551-4ceb-8905-d16c9a7a382d" status: 200 len: 1266 microversion: 2.1 time: 0.458961 Sep 27 17:36:43.684749 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 549/1077] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:36:43 2022] GET /compute/v2.1/servers/027d6837-5551-4ceb-8905-d16c9a7a382d => generated 1266 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:36:43.744143 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-ca1dc315-9496-48e2-8f8c-28e289e14e3a tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b888fd409954909874b5443cfed2838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd65ea59a6d41219ecf99f5a554056a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:36:43.751701 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-ca1dc315-9496-48e2-8f8c-28e289e14e3a tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817" status: 200 len: 1364 microversion: 2.1 time: 0.263799 Sep 27 17:36:43.752266 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 529/1078] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:36:43 2022] GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817 => generated 1364 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:36:44.096480 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [req-df9eec93-ef68-470b-91cc-c8ad2a0f4760 req-fa5aa0c2-9cff-471f-bcaf-ca8af2d16a0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "027d6837-5551-4ceb-8905-d16c9a7a382d", "tag": "fc6dbea1-68ea-46ef-8b57-1403451f9deb"}]} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:36:44.102710 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [req-1d8db898-506d-4f38-9105-a7aa1e835314 req-390aca9a-13af-4367-b8e0-68c26f5ce1aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e6cccab-407e-45f8-9eb3-586fa28cd817", "name": "network-vif-plugged", "status": "completed", "tag": "af24e484-4901-4878-9eb2-665f90e32d28"}]} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:36:44.116568 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-df9eec93-ef68-470b-91cc-c8ad2a0f4760 req-fa5aa0c2-9cff-471f-bcaf-ca8af2d16a0d service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:36:44.117345 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-df9eec93-ef68-470b-91cc-c8ad2a0f4760 req-fa5aa0c2-9cff-471f-bcaf-ca8af2d16a0d service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:36:44.117995 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-df9eec93-ef68-470b-91cc-c8ad2a0f4760 req-fa5aa0c2-9cff-471f-bcaf-ca8af2d16a0d service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:36:44.129427 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-1d8db898-506d-4f38-9105-a7aa1e835314 req-390aca9a-13af-4367-b8e0-68c26f5ce1aa service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:36:44.129931 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-1d8db898-506d-4f38-9105-a7aa1e835314 req-390aca9a-13af-4367-b8e0-68c26f5ce1aa service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:36:44.130420 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-1d8db898-506d-4f38-9105-a7aa1e835314 req-390aca9a-13af-4367-b8e0-68c26f5ce1aa service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:36:44.132176 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.compute.server_external_events [req-df9eec93-ef68-470b-91cc-c8ad2a0f4760 req-fa5aa0c2-9cff-471f-bcaf-ca8af2d16a0d service nova] Creating event network-changed:fc6dbea1-68ea-46ef-8b57-1403451f9deb for instance 027d6837-5551-4ceb-8905-d16c9a7a382d on hv-cinder-84914 Sep 27 17:36:44.140034 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [req-df9eec93-ef68-470b-91cc-c8ad2a0f4760 req-fa5aa0c2-9cff-471f-bcaf-ca8af2d16a0d service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049186 Sep 27 17:36:44.141949 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 550/1079] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:36:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:36:44.145673 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.compute.server_external_events [req-1d8db898-506d-4f38-9105-a7aa1e835314 req-390aca9a-13af-4367-b8e0-68c26f5ce1aa service nova] Creating event network-vif-plugged:af24e484-4901-4878-9eb2-665f90e32d28 for instance 9e6cccab-407e-45f8-9eb3-586fa28cd817 on hv-cinder-84914 Sep 27 17:36:44.151623 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [req-1d8db898-506d-4f38-9105-a7aa1e835314 req-390aca9a-13af-4367-b8e0-68c26f5ce1aa service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053158 Sep 27 17:36:44.152342 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 530/1080] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:36:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:36:44.694719 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-9a06d7c7-47d6-4c5f-946a-2cf4de676515 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:36:44.695420 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-9a06d7c7-47d6-4c5f-946a-2cf4de676515 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] [instance: 027d6837-5551-4ceb-8905-d16c9a7a382d] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:36:44.701401 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9a06d7c7-47d6-4c5f-946a-2cf4de676515 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:36:44.702011 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9a06d7c7-47d6-4c5f-946a-2cf4de676515 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:36:44.702479 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9a06d7c7-47d6-4c5f-946a-2cf4de676515 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:36:44.703157 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9a06d7c7-47d6-4c5f-946a-2cf4de676515 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:36:44.703607 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9a06d7c7-47d6-4c5f-946a-2cf4de676515 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:36:44.704027 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9a06d7c7-47d6-4c5f-946a-2cf4de676515 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:36:44.780765 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-a917c03b-105e-4bff-a416-8a92c42e7785 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:36:44.781583 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-a917c03b-105e-4bff-a416-8a92c42e7785 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: 9e6cccab-407e-45f8-9eb3-586fa28cd817] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:36:44.787902 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a917c03b-105e-4bff-a416-8a92c42e7785 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:36:44.788466 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a917c03b-105e-4bff-a416-8a92c42e7785 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:36:44.788995 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a917c03b-105e-4bff-a416-8a92c42e7785 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:36:44.789772 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a917c03b-105e-4bff-a416-8a92c42e7785 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:36:44.790338 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a917c03b-105e-4bff-a416-8a92c42e7785 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:36:44.790764 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a917c03b-105e-4bff-a416-8a92c42e7785 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:36:44.935736 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-9a06d7c7-47d6-4c5f-946a-2cf4de676515 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac1528c35fb464db00b5d18396b8eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4db1a85e2504cb9956a6461b5072aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:36:44.944146 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-9a06d7c7-47d6-4c5f-946a-2cf4de676515 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] 10.222.0.55 "GET /compute/v2.1/servers/027d6837-5551-4ceb-8905-d16c9a7a382d" status: 200 len: 1266 microversion: 2.1 time: 0.253906 Sep 27 17:36:44.944654 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 551/1081] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:36:44 2022] GET /compute/v2.1/servers/027d6837-5551-4ceb-8905-d16c9a7a382d => generated 1266 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:36:45.014920 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-a917c03b-105e-4bff-a416-8a92c42e7785 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b888fd409954909874b5443cfed2838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd65ea59a6d41219ecf99f5a554056a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:36:45.022500 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-a917c03b-105e-4bff-a416-8a92c42e7785 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817" status: 200 len: 1364 microversion: 2.1 time: 0.247129 Sep 27 17:36:45.023068 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 531/1082] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:36:44 2022] GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817 => generated 1364 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:36:45.967353 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-56dde56c-e1c1-475a-a22c-bcaeddecb362 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:36:45.967966 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-56dde56c-e1c1-475a-a22c-bcaeddecb362 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] [instance: 027d6837-5551-4ceb-8905-d16c9a7a382d] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:36:45.973850 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-56dde56c-e1c1-475a-a22c-bcaeddecb362 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:36:45.974366 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-56dde56c-e1c1-475a-a22c-bcaeddecb362 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:36:45.974806 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-56dde56c-e1c1-475a-a22c-bcaeddecb362 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:36:45.975495 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-56dde56c-e1c1-475a-a22c-bcaeddecb362 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:36:45.975951 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-56dde56c-e1c1-475a-a22c-bcaeddecb362 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:36:45.976379 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-56dde56c-e1c1-475a-a22c-bcaeddecb362 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:36:46.045012 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-8499cda1-0f7d-4133-a7c0-81d5e088ac7b tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:36:46.045711 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-8499cda1-0f7d-4133-a7c0-81d5e088ac7b tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: 9e6cccab-407e-45f8-9eb3-586fa28cd817] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:36:46.048201 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=4 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:36:46.053605 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8499cda1-0f7d-4133-a7c0-81d5e088ac7b tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:36:46.054121 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8499cda1-0f7d-4133-a7c0-81d5e088ac7b tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:36:46.054565 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8499cda1-0f7d-4133-a7c0-81d5e088ac7b tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:36:46.055264 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8499cda1-0f7d-4133-a7c0-81d5e088ac7b tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:36:46.055720 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8499cda1-0f7d-4133-a7c0-81d5e088ac7b tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:36:46.056146 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8499cda1-0f7d-4133-a7c0-81d5e088ac7b tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:36:46.118135 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-56dde56c-e1c1-475a-a22c-bcaeddecb362 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac1528c35fb464db00b5d18396b8eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4db1a85e2504cb9956a6461b5072aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:36:46.125741 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-56dde56c-e1c1-475a-a22c-bcaeddecb362 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] 10.222.0.55 "GET /compute/v2.1/servers/027d6837-5551-4ceb-8905-d16c9a7a382d" status: 200 len: 1266 microversion: 2.1 time: 0.162937 Sep 27 17:36:46.126335 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 552/1083] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:36:45 2022] GET /compute/v2.1/servers/027d6837-5551-4ceb-8905-d16c9a7a382d => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:36:46.203432 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-8499cda1-0f7d-4133-a7c0-81d5e088ac7b tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b888fd409954909874b5443cfed2838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd65ea59a6d41219ecf99f5a554056a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:36:46.211024 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-8499cda1-0f7d-4133-a7c0-81d5e088ac7b tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817" status: 200 len: 1364 microversion: 2.1 time: 0.170192 Sep 27 17:36:46.211600 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 532/1084] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:36:46 2022] GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817 => generated 1364 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:36:47.148923 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-64a9aa99-3fda-499f-b2fa-938d12606b95 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:36:47.149554 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-64a9aa99-3fda-499f-b2fa-938d12606b95 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] [instance: 027d6837-5551-4ceb-8905-d16c9a7a382d] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:36:47.156349 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-64a9aa99-3fda-499f-b2fa-938d12606b95 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:36:47.156825 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-64a9aa99-3fda-499f-b2fa-938d12606b95 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:36:47.157259 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-64a9aa99-3fda-499f-b2fa-938d12606b95 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:36:47.157947 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-64a9aa99-3fda-499f-b2fa-938d12606b95 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:36:47.158424 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-64a9aa99-3fda-499f-b2fa-938d12606b95 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:36:47.158845 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-64a9aa99-3fda-499f-b2fa-938d12606b95 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:36:47.235614 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-450e37e2-e1c1-4e9e-9b66-3544e8f014ad tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:36:47.236232 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-450e37e2-e1c1-4e9e-9b66-3544e8f014ad tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: 9e6cccab-407e-45f8-9eb3-586fa28cd817] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:36:47.242683 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-450e37e2-e1c1-4e9e-9b66-3544e8f014ad tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:36:47.243171 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-450e37e2-e1c1-4e9e-9b66-3544e8f014ad tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:36:47.243610 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-450e37e2-e1c1-4e9e-9b66-3544e8f014ad tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:36:47.244302 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-450e37e2-e1c1-4e9e-9b66-3544e8f014ad tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:36:47.244787 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-450e37e2-e1c1-4e9e-9b66-3544e8f014ad tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:36:47.245443 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-450e37e2-e1c1-4e9e-9b66-3544e8f014ad tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:36:47.430625 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-64a9aa99-3fda-499f-b2fa-938d12606b95 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac1528c35fb464db00b5d18396b8eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4db1a85e2504cb9956a6461b5072aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:36:47.438598 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-64a9aa99-3fda-499f-b2fa-938d12606b95 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] 10.222.0.55 "GET /compute/v2.1/servers/027d6837-5551-4ceb-8905-d16c9a7a382d" status: 200 len: 1266 microversion: 2.1 time: 0.293641 Sep 27 17:36:47.439293 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 553/1085] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:36:47 2022] GET /compute/v2.1/servers/027d6837-5551-4ceb-8905-d16c9a7a382d => generated 1266 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:36:47.457730 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-450e37e2-e1c1-4e9e-9b66-3544e8f014ad tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b888fd409954909874b5443cfed2838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd65ea59a6d41219ecf99f5a554056a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:36:47.466106 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-450e37e2-e1c1-4e9e-9b66-3544e8f014ad tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817" status: 200 len: 1551 microversion: 2.1 time: 0.234598 Sep 27 17:36:47.466674 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 533/1086] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:36:47 2022] GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817 => generated 1551 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:36:47.489065 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-7be81482-f02d-4054-9f9e-fdde31cffcb0 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:36:47.489563 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-7be81482-f02d-4054-9f9e-fdde31cffcb0 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: 9e6cccab-407e-45f8-9eb3-586fa28cd817] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:36:47.495442 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7be81482-f02d-4054-9f9e-fdde31cffcb0 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:36:47.495923 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7be81482-f02d-4054-9f9e-fdde31cffcb0 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:36:47.496357 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7be81482-f02d-4054-9f9e-fdde31cffcb0 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:36:47.497044 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7be81482-f02d-4054-9f9e-fdde31cffcb0 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:36:47.497499 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7be81482-f02d-4054-9f9e-fdde31cffcb0 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:36:47.497925 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7be81482-f02d-4054-9f9e-fdde31cffcb0 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:36:47.580278 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-7be81482-f02d-4054-9f9e-fdde31cffcb0 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094980 Sep 27 17:36:47.580878 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 554/1087] 10.222.0.55 () {58 vars in 1275 bytes} [Tue Sep 27 17:36:47 2022] GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:36:48.461143 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-c66ec497-e0b3-4e56-bce2-f5293b281a10 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:36:48.461738 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-c66ec497-e0b3-4e56-bce2-f5293b281a10 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] [instance: 027d6837-5551-4ceb-8905-d16c9a7a382d] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:36:48.468817 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c66ec497-e0b3-4e56-bce2-f5293b281a10 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:36:48.469726 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c66ec497-e0b3-4e56-bce2-f5293b281a10 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:36:48.469856 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c66ec497-e0b3-4e56-bce2-f5293b281a10 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:36:48.470494 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c66ec497-e0b3-4e56-bce2-f5293b281a10 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:36:48.471037 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c66ec497-e0b3-4e56-bce2-f5293b281a10 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:36:48.471665 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c66ec497-e0b3-4e56-bce2-f5293b281a10 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:36:48.508433 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [req-47d2e809-ff8a-404d-a49c-27890894af4c req-234e1892-4606-421d-aa70-e751bf833f9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e6cccab-407e-45f8-9eb3-586fa28cd817", "tag": "af24e484-4901-4878-9eb2-665f90e32d28"}]} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:36:48.518234 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-47d2e809-ff8a-404d-a49c-27890894af4c req-234e1892-4606-421d-aa70-e751bf833f9c service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:36:48.518982 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-47d2e809-ff8a-404d-a49c-27890894af4c req-234e1892-4606-421d-aa70-e751bf833f9c service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:36:48.519639 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-47d2e809-ff8a-404d-a49c-27890894af4c req-234e1892-4606-421d-aa70-e751bf833f9c service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:36:48.531959 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.compute.server_external_events [req-47d2e809-ff8a-404d-a49c-27890894af4c req-234e1892-4606-421d-aa70-e751bf833f9c service nova] Creating event network-changed:af24e484-4901-4878-9eb2-665f90e32d28 for instance 9e6cccab-407e-45f8-9eb3-586fa28cd817 on hv-cinder-84914 Sep 27 17:36:48.537205 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [req-47d2e809-ff8a-404d-a49c-27890894af4c req-234e1892-4606-421d-aa70-e751bf833f9c service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033932 Sep 27 17:36:48.538351 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 555/1088] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:36:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 17:36:48.661627 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-c66ec497-e0b3-4e56-bce2-f5293b281a10 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac1528c35fb464db00b5d18396b8eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4db1a85e2504cb9956a6461b5072aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:36:48.670252 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-c66ec497-e0b3-4e56-bce2-f5293b281a10 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] 10.222.0.55 "GET /compute/v2.1/servers/027d6837-5551-4ceb-8905-d16c9a7a382d" status: 200 len: 1266 microversion: 2.1 time: 0.213066 Sep 27 17:36:48.671045 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 534/1089] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:36:48 2022] GET /compute/v2.1/servers/027d6837-5551-4ceb-8905-d16c9a7a382d => generated 1266 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:36:49.693891 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-804a7cb2-37a9-4e94-a409-cb83cb498bef tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:36:49.694560 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-804a7cb2-37a9-4e94-a409-cb83cb498bef tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] [instance: 027d6837-5551-4ceb-8905-d16c9a7a382d] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:36:49.701230 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-804a7cb2-37a9-4e94-a409-cb83cb498bef tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:36:49.701709 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-804a7cb2-37a9-4e94-a409-cb83cb498bef tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:36:49.702172 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-804a7cb2-37a9-4e94-a409-cb83cb498bef tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:36:49.702857 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-804a7cb2-37a9-4e94-a409-cb83cb498bef tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:36:49.703310 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-804a7cb2-37a9-4e94-a409-cb83cb498bef tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:36:49.703732 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-804a7cb2-37a9-4e94-a409-cb83cb498bef tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:36:49.836413 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-804a7cb2-37a9-4e94-a409-cb83cb498bef tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac1528c35fb464db00b5d18396b8eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4db1a85e2504cb9956a6461b5072aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:36:49.845640 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-804a7cb2-37a9-4e94-a409-cb83cb498bef tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] 10.222.0.55 "GET /compute/v2.1/servers/027d6837-5551-4ceb-8905-d16c9a7a382d" status: 200 len: 1266 microversion: 2.1 time: 0.156538 Sep 27 17:36:49.846240 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 556/1090] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:36:49 2022] GET /compute/v2.1/servers/027d6837-5551-4ceb-8905-d16c9a7a382d => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:36:50.868661 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-d69da49a-effd-4dba-957f-dbd0f6615163 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:36:50.869266 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-d69da49a-effd-4dba-957f-dbd0f6615163 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] [instance: 027d6837-5551-4ceb-8905-d16c9a7a382d] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:36:50.873093 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell0:SELECT=2 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:36:50.873734 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell0:SELECT=12 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:36:50.877902 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d69da49a-effd-4dba-957f-dbd0f6615163 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:36:50.878405 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d69da49a-effd-4dba-957f-dbd0f6615163 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:36:50.878836 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d69da49a-effd-4dba-957f-dbd0f6615163 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:36:50.879512 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d69da49a-effd-4dba-957f-dbd0f6615163 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:36:50.879953 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d69da49a-effd-4dba-957f-dbd0f6615163 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:36:50.880366 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d69da49a-effd-4dba-957f-dbd0f6615163 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:36:51.009435 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-d69da49a-effd-4dba-957f-dbd0f6615163 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac1528c35fb464db00b5d18396b8eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4db1a85e2504cb9956a6461b5072aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:36:51.020336 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-d69da49a-effd-4dba-957f-dbd0f6615163 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] 10.222.0.55 "GET /compute/v2.1/servers/027d6837-5551-4ceb-8905-d16c9a7a382d" status: 200 len: 1266 microversion: 2.1 time: 0.154562 Sep 27 17:36:51.020926 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 535/1091] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:36:50 2022] GET /compute/v2.1/servers/027d6837-5551-4ceb-8905-d16c9a7a382d => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:36:52.047776 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-51a58fa1-da47-4510-91f5-e116d4fb2a33 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:36:52.048387 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-51a58fa1-da47-4510-91f5-e116d4fb2a33 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] [instance: 027d6837-5551-4ceb-8905-d16c9a7a382d] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:36:52.050796 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_cell0:SELECT=8 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:36:52.056072 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-51a58fa1-da47-4510-91f5-e116d4fb2a33 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:36:52.056545 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-51a58fa1-da47-4510-91f5-e116d4fb2a33 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:36:52.056979 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-51a58fa1-da47-4510-91f5-e116d4fb2a33 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:36:52.057658 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-51a58fa1-da47-4510-91f5-e116d4fb2a33 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:36:52.058138 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-51a58fa1-da47-4510-91f5-e116d4fb2a33 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:36:52.058566 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-51a58fa1-da47-4510-91f5-e116d4fb2a33 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:36:52.186207 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-51a58fa1-da47-4510-91f5-e116d4fb2a33 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac1528c35fb464db00b5d18396b8eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4db1a85e2504cb9956a6461b5072aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:36:52.193780 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-51a58fa1-da47-4510-91f5-e116d4fb2a33 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] 10.222.0.55 "GET /compute/v2.1/servers/027d6837-5551-4ceb-8905-d16c9a7a382d" status: 200 len: 1266 microversion: 2.1 time: 0.149923 Sep 27 17:36:52.194451 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 557/1092] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:36:52 2022] GET /compute/v2.1/servers/027d6837-5551-4ceb-8905-d16c9a7a382d => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:36:53.217634 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-02805e41-f6f6-41a4-b82a-15d21d07c64b tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:36:53.218962 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-02805e41-f6f6-41a4-b82a-15d21d07c64b tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] [instance: 027d6837-5551-4ceb-8905-d16c9a7a382d] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:36:53.226009 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-02805e41-f6f6-41a4-b82a-15d21d07c64b tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:36:53.226533 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-02805e41-f6f6-41a4-b82a-15d21d07c64b tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:36:53.226973 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-02805e41-f6f6-41a4-b82a-15d21d07c64b tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:36:53.227661 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-02805e41-f6f6-41a4-b82a-15d21d07c64b tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:36:53.228119 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-02805e41-f6f6-41a4-b82a-15d21d07c64b tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:36:53.228548 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-02805e41-f6f6-41a4-b82a-15d21d07c64b tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:36:53.359323 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-02805e41-f6f6-41a4-b82a-15d21d07c64b tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac1528c35fb464db00b5d18396b8eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4db1a85e2504cb9956a6461b5072aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:36:53.367537 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-02805e41-f6f6-41a4-b82a-15d21d07c64b tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] 10.222.0.55 "GET /compute/v2.1/servers/027d6837-5551-4ceb-8905-d16c9a7a382d" status: 200 len: 1266 microversion: 2.1 time: 0.154436 Sep 27 17:36:53.368143 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 536/1093] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:36:53 2022] GET /compute/v2.1/servers/027d6837-5551-4ceb-8905-d16c9a7a382d => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:36:54.390395 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-6d36a92d-010f-4210-8923-dc8cb0326a85 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:36:54.391000 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-6d36a92d-010f-4210-8923-dc8cb0326a85 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] [instance: 027d6837-5551-4ceb-8905-d16c9a7a382d] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:36:54.398551 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6d36a92d-010f-4210-8923-dc8cb0326a85 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:36:54.399032 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6d36a92d-010f-4210-8923-dc8cb0326a85 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:36:54.399463 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6d36a92d-010f-4210-8923-dc8cb0326a85 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:36:54.400143 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6d36a92d-010f-4210-8923-dc8cb0326a85 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:36:54.400591 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6d36a92d-010f-4210-8923-dc8cb0326a85 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:36:54.401604 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6d36a92d-010f-4210-8923-dc8cb0326a85 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:36:54.533115 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-6d36a92d-010f-4210-8923-dc8cb0326a85 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac1528c35fb464db00b5d18396b8eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4db1a85e2504cb9956a6461b5072aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:36:54.540706 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-6d36a92d-010f-4210-8923-dc8cb0326a85 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] 10.222.0.55 "GET /compute/v2.1/servers/027d6837-5551-4ceb-8905-d16c9a7a382d" status: 200 len: 1266 microversion: 2.1 time: 0.154202 Sep 27 17:36:54.541271 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 558/1094] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:36:54 2022] GET /compute/v2.1/servers/027d6837-5551-4ceb-8905-d16c9a7a382d => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:36:55.562446 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-13e20aa9-e5a6-4d5f-87ac-7a5854bbafa4 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:36:55.563057 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-13e20aa9-e5a6-4d5f-87ac-7a5854bbafa4 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] [instance: 027d6837-5551-4ceb-8905-d16c9a7a382d] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:36:55.569183 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-13e20aa9-e5a6-4d5f-87ac-7a5854bbafa4 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:36:55.569611 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-13e20aa9-e5a6-4d5f-87ac-7a5854bbafa4 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:36:55.570044 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-13e20aa9-e5a6-4d5f-87ac-7a5854bbafa4 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:36:55.570753 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-13e20aa9-e5a6-4d5f-87ac-7a5854bbafa4 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:36:55.571208 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-13e20aa9-e5a6-4d5f-87ac-7a5854bbafa4 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:36:55.571628 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-13e20aa9-e5a6-4d5f-87ac-7a5854bbafa4 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:36:55.697462 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-13e20aa9-e5a6-4d5f-87ac-7a5854bbafa4 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac1528c35fb464db00b5d18396b8eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4db1a85e2504cb9956a6461b5072aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:36:55.705149 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-13e20aa9-e5a6-4d5f-87ac-7a5854bbafa4 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] 10.222.0.55 "GET /compute/v2.1/servers/027d6837-5551-4ceb-8905-d16c9a7a382d" status: 200 len: 1266 microversion: 2.1 time: 0.146770 Sep 27 17:36:55.705720 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 537/1095] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:36:55 2022] GET /compute/v2.1/servers/027d6837-5551-4ceb-8905-d16c9a7a382d => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:36:56.728522 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-30523238-d82f-459b-977c-869fabe7f91c tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:36:56.729917 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-30523238-d82f-459b-977c-869fabe7f91c tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] [instance: 027d6837-5551-4ceb-8905-d16c9a7a382d] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:36:56.736951 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-30523238-d82f-459b-977c-869fabe7f91c tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:36:56.737441 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-30523238-d82f-459b-977c-869fabe7f91c tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:36:56.737881 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-30523238-d82f-459b-977c-869fabe7f91c tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:36:56.738605 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-30523238-d82f-459b-977c-869fabe7f91c tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:36:56.739067 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-30523238-d82f-459b-977c-869fabe7f91c tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:36:56.739523 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-30523238-d82f-459b-977c-869fabe7f91c tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:36:56.870455 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-30523238-d82f-459b-977c-869fabe7f91c tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac1528c35fb464db00b5d18396b8eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4db1a85e2504cb9956a6461b5072aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:36:56.878534 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-30523238-d82f-459b-977c-869fabe7f91c tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] 10.222.0.55 "GET /compute/v2.1/servers/027d6837-5551-4ceb-8905-d16c9a7a382d" status: 200 len: 1266 microversion: 2.1 time: 0.153787 Sep 27 17:36:56.879565 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 559/1096] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:36:56 2022] GET /compute/v2.1/servers/027d6837-5551-4ceb-8905-d16c9a7a382d => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:36:57.900702 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-e55b0c7b-2bcf-48cd-821a-ed262d063eb4 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:36:57.901343 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-e55b0c7b-2bcf-48cd-821a-ed262d063eb4 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] [instance: 027d6837-5551-4ceb-8905-d16c9a7a382d] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:36:57.907816 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e55b0c7b-2bcf-48cd-821a-ed262d063eb4 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:36:57.908298 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e55b0c7b-2bcf-48cd-821a-ed262d063eb4 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:36:57.908735 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e55b0c7b-2bcf-48cd-821a-ed262d063eb4 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:36:57.909439 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e55b0c7b-2bcf-48cd-821a-ed262d063eb4 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:36:57.909892 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e55b0c7b-2bcf-48cd-821a-ed262d063eb4 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:36:57.910341 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e55b0c7b-2bcf-48cd-821a-ed262d063eb4 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:36:58.039021 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-e55b0c7b-2bcf-48cd-821a-ed262d063eb4 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac1528c35fb464db00b5d18396b8eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4db1a85e2504cb9956a6461b5072aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:36:58.047567 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-e55b0c7b-2bcf-48cd-821a-ed262d063eb4 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] 10.222.0.55 "GET /compute/v2.1/servers/027d6837-5551-4ceb-8905-d16c9a7a382d" status: 200 len: 1266 microversion: 2.1 time: 0.150733 Sep 27 17:36:58.048320 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 538/1097] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:36:57 2022] GET /compute/v2.1/servers/027d6837-5551-4ceb-8905-d16c9a7a382d => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:36:58.173896 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [req-1822d19d-feca-4751-bec6-c18c0d6947a1 req-37b888e5-08f6-416e-9e30-9e2e3da83b92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "027d6837-5551-4ceb-8905-d16c9a7a382d", "name": "network-vif-plugged", "status": "completed", "tag": "fc6dbea1-68ea-46ef-8b57-1403451f9deb"}]} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:36:58.184337 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-1822d19d-feca-4751-bec6-c18c0d6947a1 req-37b888e5-08f6-416e-9e30-9e2e3da83b92 service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:36:58.184828 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-1822d19d-feca-4751-bec6-c18c0d6947a1 req-37b888e5-08f6-416e-9e30-9e2e3da83b92 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:36:58.185252 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-1822d19d-feca-4751-bec6-c18c0d6947a1 req-37b888e5-08f6-416e-9e30-9e2e3da83b92 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:36:58.196018 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.compute.server_external_events [req-1822d19d-feca-4751-bec6-c18c0d6947a1 req-37b888e5-08f6-416e-9e30-9e2e3da83b92 service nova] Creating event network-vif-plugged:fc6dbea1-68ea-46ef-8b57-1403451f9deb for instance 027d6837-5551-4ceb-8905-d16c9a7a382d on hv-cinder-84914 Sep 27 17:36:58.201411 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [req-1822d19d-feca-4751-bec6-c18c0d6947a1 req-37b888e5-08f6-416e-9e30-9e2e3da83b92 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031260 Sep 27 17:36:58.202064 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 560/1098] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:36:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:36:59.071016 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-53efe76b-d529-4d23-9127-a1bb7d736bb6 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:36:59.071624 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-53efe76b-d529-4d23-9127-a1bb7d736bb6 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] [instance: 027d6837-5551-4ceb-8905-d16c9a7a382d] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:36:59.078111 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-53efe76b-d529-4d23-9127-a1bb7d736bb6 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:36:59.078592 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-53efe76b-d529-4d23-9127-a1bb7d736bb6 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:36:59.079021 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-53efe76b-d529-4d23-9127-a1bb7d736bb6 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:36:59.079706 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-53efe76b-d529-4d23-9127-a1bb7d736bb6 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:36:59.080157 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-53efe76b-d529-4d23-9127-a1bb7d736bb6 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:36:59.080578 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-53efe76b-d529-4d23-9127-a1bb7d736bb6 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:36:59.207714 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-53efe76b-d529-4d23-9127-a1bb7d736bb6 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac1528c35fb464db00b5d18396b8eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4db1a85e2504cb9956a6461b5072aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:36:59.215764 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-53efe76b-d529-4d23-9127-a1bb7d736bb6 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] 10.222.0.55 "GET /compute/v2.1/servers/027d6837-5551-4ceb-8905-d16c9a7a382d" status: 200 len: 1266 microversion: 2.1 time: 0.148658 Sep 27 17:36:59.216726 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 539/1099] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:36:59 2022] GET /compute/v2.1/servers/027d6837-5551-4ceb-8905-d16c9a7a382d => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:37:00.240649 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-30833418-8a4d-4c52-b79d-cbe7584ae1c2 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:37:00.241415 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-30833418-8a4d-4c52-b79d-cbe7584ae1c2 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] [instance: 027d6837-5551-4ceb-8905-d16c9a7a382d] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:37:00.247612 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-30833418-8a4d-4c52-b79d-cbe7584ae1c2 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:37:00.248094 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-30833418-8a4d-4c52-b79d-cbe7584ae1c2 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:37:00.248529 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-30833418-8a4d-4c52-b79d-cbe7584ae1c2 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:37:00.249217 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-30833418-8a4d-4c52-b79d-cbe7584ae1c2 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:37:00.249818 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-30833418-8a4d-4c52-b79d-cbe7584ae1c2 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:37:00.250670 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-30833418-8a4d-4c52-b79d-cbe7584ae1c2 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:37:00.384309 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-30833418-8a4d-4c52-b79d-cbe7584ae1c2 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac1528c35fb464db00b5d18396b8eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4db1a85e2504cb9956a6461b5072aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:37:00.392340 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-30833418-8a4d-4c52-b79d-cbe7584ae1c2 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] 10.222.0.55 "GET /compute/v2.1/servers/027d6837-5551-4ceb-8905-d16c9a7a382d" status: 200 len: 1454 microversion: 2.1 time: 0.157286 Sep 27 17:37:00.392900 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 561/1100] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:37:00 2022] GET /compute/v2.1/servers/027d6837-5551-4ceb-8905-d16c9a7a382d => generated 1454 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:37:00.414804 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-79867702-4da1-43cf-8632-96081ebc6367 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:37:00.415414 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-79867702-4da1-43cf-8632-96081ebc6367 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] [instance: 027d6837-5551-4ceb-8905-d16c9a7a382d] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:37:00.421846 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-79867702-4da1-43cf-8632-96081ebc6367 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:37:00.422358 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-79867702-4da1-43cf-8632-96081ebc6367 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:37:00.422795 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-79867702-4da1-43cf-8632-96081ebc6367 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:37:00.423482 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-79867702-4da1-43cf-8632-96081ebc6367 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:37:00.423932 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-79867702-4da1-43cf-8632-96081ebc6367 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:37:00.424356 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-79867702-4da1-43cf-8632-96081ebc6367 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:37:00.831222 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-79867702-4da1-43cf-8632-96081ebc6367 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac1528c35fb464db00b5d18396b8eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4db1a85e2504cb9956a6461b5072aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:37:00.834573 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell1:SELECT=100 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:37:00.839621 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-79867702-4da1-43cf-8632-96081ebc6367 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] 10.222.0.55 "GET /compute/v2.1/servers/027d6837-5551-4ceb-8905-d16c9a7a382d" status: 200 len: 1454 microversion: 2.1 time: 0.428609 Sep 27 17:37:00.840191 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 540/1101] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:37:00 2022] GET /compute/v2.1/servers/027d6837-5551-4ceb-8905-d16c9a7a382d => generated 1454 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:37:02.511535 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [req-06828602-bafa-46bb-b084-297a447a1b13 req-8510cb8a-2d0f-462b-9813-d4754d311d85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "027d6837-5551-4ceb-8905-d16c9a7a382d", "tag": "fc6dbea1-68ea-46ef-8b57-1403451f9deb"}]} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:37:02.516924 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:37:02.522885 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-06828602-bafa-46bb-b084-297a447a1b13 req-8510cb8a-2d0f-462b-9813-d4754d311d85 service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:37:02.523351 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-06828602-bafa-46bb-b084-297a447a1b13 req-8510cb8a-2d0f-462b-9813-d4754d311d85 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:37:02.523772 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-06828602-bafa-46bb-b084-297a447a1b13 req-8510cb8a-2d0f-462b-9813-d4754d311d85 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:37:02.527753 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_cell1:SELECT=93 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:37:02.536397 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.compute.server_external_events [req-06828602-bafa-46bb-b084-297a447a1b13 req-8510cb8a-2d0f-462b-9813-d4754d311d85 service nova] Creating event network-changed:fc6dbea1-68ea-46ef-8b57-1403451f9deb for instance 027d6837-5551-4ceb-8905-d16c9a7a382d on hv-cinder-84914 Sep 27 17:37:02.541764 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [req-06828602-bafa-46bb-b084-297a447a1b13 req-8510cb8a-2d0f-462b-9813-d4754d311d85 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033494 Sep 27 17:37:02.542522 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 562/1102] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:37:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:37:15.502499 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-9bd95403-b285-4c9e-b841-12b75ee48cf0 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:37:15.503057 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-9bd95403-b285-4c9e-b841-12b75ee48cf0 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: 8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:37:15.505304 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_api:SELECT=17 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:37:15.510728 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9bd95403-b285-4c9e-b841-12b75ee48cf0 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:37:15.511214 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9bd95403-b285-4c9e-b841-12b75ee48cf0 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:37:15.511683 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9bd95403-b285-4c9e-b841-12b75ee48cf0 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:37:15.512378 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9bd95403-b285-4c9e-b841-12b75ee48cf0 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:37:15.512834 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9bd95403-b285-4c9e-b841-12b75ee48cf0 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:37:15.513260 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9bd95403-b285-4c9e-b841-12b75ee48cf0 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:37:15.536954 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-9bd95403-b285-4c9e-b841-12b75ee48cf0 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486/ips" status: 200 len: 151 microversion: 2.1 time: 0.039217 Sep 27 17:37:15.537515 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 541/1103] 10.222.0.55 () {58 vars in 1248 bytes} [Tue Sep 27 17:37:15 2022] GET /compute/v2.1/servers/8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:37:16.864059 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_api:SELECT=1 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:37:16.864831 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_cell1:SELECT=1 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:37:16.869114 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-9147c615-aa39-4474-94b5-252d07cd0164 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e4d60e71-91fe-4429-8897-15ccb7426952"}} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:37:16.871562 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-9147c615-aa39-4474-94b5-252d07cd0164 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: 8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:37:16.878304 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9147c615-aa39-4474-94b5-252d07cd0164 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:37:16.878780 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9147c615-aa39-4474-94b5-252d07cd0164 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:37:16.879212 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9147c615-aa39-4474-94b5-252d07cd0164 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:37:16.879891 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9147c615-aa39-4474-94b5-252d07cd0164 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:37:16.880341 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9147c615-aa39-4474-94b5-252d07cd0164 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:37:16.880759 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9147c615-aa39-4474-94b5-252d07cd0164 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:37:17.134174 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-9147c615-aa39-4474-94b5-252d07cd0164 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "POST /compute/v2.1/servers/8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.271354 Sep 27 17:37:17.134812 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 563/1104] 10.222.0.55 () {60 vars in 1323 bytes} [Tue Sep 27 17:37:16 2022] POST /compute/v2.1/servers/8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486/os-volume_attachments => generated 194 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:37:24.783290 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-9ee101aa-fe26-4c45-b2f6-b86c5823bf41 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:37:24.783835 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-9ee101aa-fe26-4c45-b2f6-b86c5823bf41 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: 8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:37:24.790867 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9ee101aa-fe26-4c45-b2f6-b86c5823bf41 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:37:24.791350 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9ee101aa-fe26-4c45-b2f6-b86c5823bf41 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:37:24.791789 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9ee101aa-fe26-4c45-b2f6-b86c5823bf41 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:37:24.792477 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9ee101aa-fe26-4c45-b2f6-b86c5823bf41 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:37:24.792933 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9ee101aa-fe26-4c45-b2f6-b86c5823bf41 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:37:24.793354 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9ee101aa-fe26-4c45-b2f6-b86c5823bf41 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:37:24.873653 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.objects.instance [None req-9ee101aa-fe26-4c45-b2f6-b86c5823bf41 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lazy-loading 'services' on Instance uuid 8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486 {{(pid=120415) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 17:37:24.943947 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-9ee101aa-fe26-4c45-b2f6-b86c5823bf41 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "DELETE /compute/v2.1/servers/8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486/os-volume_attachments/e4d60e71-91fe-4429-8897-15ccb7426952" status: 202 len: 0 microversion: 2.1 time: 0.164574 Sep 27 17:37:24.944524 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 542/1105] 10.222.0.55 () {58 vars in 1416 bytes} [Tue Sep 27 17:37:24 2022] DELETE /compute/v2.1/servers/8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486/os-volume_attachments/e4d60e71-91fe-4429-8897-15ccb7426952 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 17:37:24.954492 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-bd5b7df1-76bb-4438-bd72-0905852752c1 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:37:24.956852 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-bd5b7df1-76bb-4438-bd72-0905852752c1 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: 8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:37:24.963548 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-bd5b7df1-76bb-4438-bd72-0905852752c1 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:37:24.964247 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-bd5b7df1-76bb-4438-bd72-0905852752c1 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:37:24.964680 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-bd5b7df1-76bb-4438-bd72-0905852752c1 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:37:24.965424 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-bd5b7df1-76bb-4438-bd72-0905852752c1 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:37:24.965988 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-bd5b7df1-76bb-4438-bd72-0905852752c1 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:37:24.966443 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-bd5b7df1-76bb-4438-bd72-0905852752c1 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:37:24.998610 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-bd5b7df1-76bb-4438-bd72-0905852752c1 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048685 Sep 27 17:37:24.999186 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 564/1106] 10.222.0.55 () {58 vars in 1302 bytes} [Tue Sep 27 17:37:24 2022] GET /compute/v2.1/servers/8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:37:26.012704 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-a779e9aa-11d5-4820-94c5-9c634ecc8753 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:37:26.015012 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-a779e9aa-11d5-4820-94c5-9c634ecc8753 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: 8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:37:26.021170 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a779e9aa-11d5-4820-94c5-9c634ecc8753 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:37:26.021651 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a779e9aa-11d5-4820-94c5-9c634ecc8753 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:37:26.022108 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a779e9aa-11d5-4820-94c5-9c634ecc8753 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:37:26.022801 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a779e9aa-11d5-4820-94c5-9c634ecc8753 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:37:26.023250 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a779e9aa-11d5-4820-94c5-9c634ecc8753 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:37:26.023677 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a779e9aa-11d5-4820-94c5-9c634ecc8753 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:37:26.052819 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-a779e9aa-11d5-4820-94c5-9c634ecc8753 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045291 Sep 27 17:37:26.053368 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 543/1107] 10.222.0.55 () {58 vars in 1302 bytes} [Tue Sep 27 17:37:26 2022] GET /compute/v2.1/servers/8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 17:37:26.116114 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-ceed1545-bffa-4616-a39c-3bd126bec942 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:37:26.116627 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-ceed1545-bffa-4616-a39c-3bd126bec942 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: 8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:37:26.122947 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ceed1545-bffa-4616-a39c-3bd126bec942 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:37:26.123431 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ceed1545-bffa-4616-a39c-3bd126bec942 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:37:26.123865 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ceed1545-bffa-4616-a39c-3bd126bec942 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:37:26.124556 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ceed1545-bffa-4616-a39c-3bd126bec942 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:37:26.125008 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ceed1545-bffa-4616-a39c-3bd126bec942 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:37:26.125433 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ceed1545-bffa-4616-a39c-3bd126bec942 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:37:26.149424 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-ceed1545-bffa-4616-a39c-3bd126bec942 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: 8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486] Going to try to terminate instance {{(pid=120416) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 17:37:26.221869 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-ceed1545-bffa-4616-a39c-3bd126bec942 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "DELETE /compute/v2.1/servers/8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486" status: 204 len: 0 microversion: 2.1 time: 0.109332 Sep 27 17:37:26.222496 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 565/1108] 10.222.0.55 () {58 vars in 1239 bytes} [Tue Sep 27 17:37:26 2022] DELETE /compute/v2.1/servers/8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 17:37:26.230681 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-d0115e2d-bac0-44fd-93e3-3ceb1c3e212b tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:37:26.231289 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-d0115e2d-bac0-44fd-93e3-3ceb1c3e212b tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: 8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:37:26.238062 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d0115e2d-bac0-44fd-93e3-3ceb1c3e212b tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:37:26.238579 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d0115e2d-bac0-44fd-93e3-3ceb1c3e212b tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:37:26.239014 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d0115e2d-bac0-44fd-93e3-3ceb1c3e212b tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:37:26.239699 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d0115e2d-bac0-44fd-93e3-3ceb1c3e212b tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:37:26.240151 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d0115e2d-bac0-44fd-93e3-3ceb1c3e212b tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:37:26.240575 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d0115e2d-bac0-44fd-93e3-3ceb1c3e212b tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:37:26.370598 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-d0115e2d-bac0-44fd-93e3-3ceb1c3e212b tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b02c2ba9a0a48c294a11b42cbfe28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef13103d3d8b43e1882d4820c8d9247b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:37:26.378406 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-d0115e2d-bac0-44fd-93e3-3ceb1c3e212b tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486" status: 200 len: 1684 microversion: 2.1 time: 0.151503 Sep 27 17:37:26.378957 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 544/1109] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:37:26 2022] GET /compute/v2.1/servers/8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486 => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:37:27.403356 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-5785eac5-2601-4e4c-a0fb-1a3ebd3f00d8 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:37:27.404055 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-5785eac5-2601-4e4c-a0fb-1a3ebd3f00d8 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: 8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:37:27.412112 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5785eac5-2601-4e4c-a0fb-1a3ebd3f00d8 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:37:27.412588 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5785eac5-2601-4e4c-a0fb-1a3ebd3f00d8 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:37:27.413021 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5785eac5-2601-4e4c-a0fb-1a3ebd3f00d8 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:37:27.413705 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5785eac5-2601-4e4c-a0fb-1a3ebd3f00d8 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:37:27.414186 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5785eac5-2601-4e4c-a0fb-1a3ebd3f00d8 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:37:27.414609 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5785eac5-2601-4e4c-a0fb-1a3ebd3f00d8 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:37:27.542401 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-5785eac5-2601-4e4c-a0fb-1a3ebd3f00d8 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b02c2ba9a0a48c294a11b42cbfe28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef13103d3d8b43e1882d4820c8d9247b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:37:27.550094 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-5785eac5-2601-4e4c-a0fb-1a3ebd3f00d8 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486" status: 200 len: 1684 microversion: 2.1 time: 0.151379 Sep 27 17:37:27.550684 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 566/1110] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:37:27 2022] GET /compute/v2.1/servers/8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486 => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:37:28.574936 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-79b65186-ff17-404d-8177-4a986a50c5e6 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:37:28.575489 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-79b65186-ff17-404d-8177-4a986a50c5e6 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: 8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:37:28.582809 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-79b65186-ff17-404d-8177-4a986a50c5e6 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:37:28.583321 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-79b65186-ff17-404d-8177-4a986a50c5e6 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:37:28.583755 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-79b65186-ff17-404d-8177-4a986a50c5e6 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:37:28.584449 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-79b65186-ff17-404d-8177-4a986a50c5e6 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:37:28.584898 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-79b65186-ff17-404d-8177-4a986a50c5e6 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:37:28.585320 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-79b65186-ff17-404d-8177-4a986a50c5e6 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:37:28.834916 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-79b65186-ff17-404d-8177-4a986a50c5e6 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b02c2ba9a0a48c294a11b42cbfe28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef13103d3d8b43e1882d4820c8d9247b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:37:28.842701 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-79b65186-ff17-404d-8177-4a986a50c5e6 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486" status: 200 len: 1684 microversion: 2.1 time: 0.272418 Sep 27 17:37:28.843631 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 545/1111] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:37:28 2022] GET /compute/v2.1/servers/8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486 => generated 1684 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:37:29.643700 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [req-f9b0a78d-19d4-4ad1-9acc-d201b879a953 req-31b852ce-4b03-4d44-8528-3db6d32c9c28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486", "name": "network-vif-deleted", "tag": "2ada2339-648c-4124-a9c2-ed0cd3edf8ef"}]} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:37:29.654536 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-f9b0a78d-19d4-4ad1-9acc-d201b879a953 req-31b852ce-4b03-4d44-8528-3db6d32c9c28 service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:37:29.655119 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-f9b0a78d-19d4-4ad1-9acc-d201b879a953 req-31b852ce-4b03-4d44-8528-3db6d32c9c28 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:37:29.655621 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-f9b0a78d-19d4-4ad1-9acc-d201b879a953 req-31b852ce-4b03-4d44-8528-3db6d32c9c28 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:37:29.667238 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.compute.server_external_events [req-f9b0a78d-19d4-4ad1-9acc-d201b879a953 req-31b852ce-4b03-4d44-8528-3db6d32c9c28 service nova] Creating event network-vif-deleted:2ada2339-648c-4124-a9c2-ed0cd3edf8ef for instance 8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486 on hv-cinder-84914 Sep 27 17:37:29.674475 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [req-f9b0a78d-19d4-4ad1-9acc-d201b879a953 req-31b852ce-4b03-4d44-8528-3db6d32c9c28 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034230 Sep 27 17:37:29.675213 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 567/1112] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:37:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:37:29.867741 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-d099e92c-6b1a-4f60-ba61-e799b9ab35a5 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:37:29.868517 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-d099e92c-6b1a-4f60-ba61-e799b9ab35a5 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: 8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:37:29.874662 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d099e92c-6b1a-4f60-ba61-e799b9ab35a5 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:37:29.875231 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d099e92c-6b1a-4f60-ba61-e799b9ab35a5 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:37:29.875742 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d099e92c-6b1a-4f60-ba61-e799b9ab35a5 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:37:29.876516 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d099e92c-6b1a-4f60-ba61-e799b9ab35a5 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:37:29.877170 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d099e92c-6b1a-4f60-ba61-e799b9ab35a5 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:37:29.877675 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d099e92c-6b1a-4f60-ba61-e799b9ab35a5 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:37:29.923792 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d099e92c-6b1a-4f60-ba61-e799b9ab35a5 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:37:29.924276 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d099e92c-6b1a-4f60-ba61-e799b9ab35a5 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:37:29.924711 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d099e92c-6b1a-4f60-ba61-e799b9ab35a5 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:37:29.925156 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.objects.instance [None req-d099e92c-6b1a-4f60-ba61-e799b9ab35a5 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lazy-loading 'fault' on Instance uuid 8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486 {{(pid=120415) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 17:37:29.969411 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-d099e92c-6b1a-4f60-ba61-e799b9ab35a5 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b02c2ba9a0a48c294a11b42cbfe28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef13103d3d8b43e1882d4820c8d9247b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:37:29.978569 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-d099e92c-6b1a-4f60-ba61-e799b9ab35a5 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486" status: 200 len: 1332 microversion: 2.1 time: 0.115256 Sep 27 17:37:29.979504 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 546/1113] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:37:29 2022] GET /compute/v2.1/servers/8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486 => generated 1332 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:37:31.004185 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-8202031b-755e-41b8-a0a0-a50cba2e2997 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:37:31.004793 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-8202031b-755e-41b8-a0a0-a50cba2e2997 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: 8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:37:31.011373 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8202031b-755e-41b8-a0a0-a50cba2e2997 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:37:31.011844 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8202031b-755e-41b8-a0a0-a50cba2e2997 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:37:31.012269 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8202031b-755e-41b8-a0a0-a50cba2e2997 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:37:31.012942 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8202031b-755e-41b8-a0a0-a50cba2e2997 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:37:31.013869 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8202031b-755e-41b8-a0a0-a50cba2e2997 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:37:31.014324 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8202031b-755e-41b8-a0a0-a50cba2e2997 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:37:31.026989 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.wsgi [None req-8202031b-755e-41b8-a0a0-a50cba2e2997 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] HTTP exception thrown: Instance 8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486 could not be found. Sep 27 17:37:31.028538 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-8202031b-755e-41b8-a0a0-a50cba2e2997 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Request method failure captured: Sep 27 17:37:31.028538 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: request: GET /compute/v2.1/servers/8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486 HTTP/1.1 Sep 27 17:37:31.028538 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Accept: application/json Sep 27 17:37:31.028538 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Accept-Encoding: identity Sep 27 17:37:31.028538 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Connection: close Sep 27 17:37:31.028538 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Content-Length: 0 Sep 27 17:37:31.028538 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Content-Type: application/json Sep 27 17:37:31.028538 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Host: 10.222.0.55 Sep 27 17:37:31.028538 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Openstack-System-Scope: None Sep 27 17:37:31.028538 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: User-Agent: python-urllib3/1.26.12 Sep 27 17:37:31.028538 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Auth-Token: gAAAAABjMzJLbcCEQOqdb7vUsgmB1kYoJEkf6gmC-gBv2tRXmVys19QrTRcPsWXwKEDAq84Zx8Lk9yj3l6xwznprR9KLIbGZ9V7KSdvhEmUqz6sxyX18DRVOHZ32x9KkM54n-fmW5MzSlVPgKqrw3Lvqvb4fGZ9DWc41NDKWL10YNVKBy3FY280 Sep 27 17:37:31.028538 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Domain-Id: None Sep 27 17:37:31.028538 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Domain-Name: None Sep 27 17:37:31.028538 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Identity-Status: Confirmed Sep 27 17:37:31.028538 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Is-Admin-Project: True Sep 27 17:37:31.028538 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Domain-Id: default Sep 27 17:37:31.028538 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Domain-Name: Default Sep 27 17:37:31.028538 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Id: ef13103d3d8b43e1882d4820c8d9247b Sep 27 17:37:31.028538 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Name: tempest-AttachVolumeNegativeTest-1423690367 Sep 27 17:37:31.028538 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Role: reader,member Sep 27 17:37:31.028538 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Roles: reader,member Sep 27 17:37:31.030873 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ef13103d3d8b43e1882d4820c8d9247b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_ef13103d3d8b43e1882d4820c8d9247b", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ef13103d3d8b43e1882d4820c8d9247b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/ef13103d3d8b43e1882d4820c8d9247b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 27 17:37:31.030873 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Tenant: tempest-AttachVolumeNegativeTest-1423690367 Sep 27 17:37:31.030873 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Tenant-Id: ef13103d3d8b43e1882d4820c8d9247b Sep 27 17:37:31.030873 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1423690367 Sep 27 17:37:31.030873 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User: tempest-AttachVolumeNegativeTest-1423690367-project Sep 27 17:37:31.030873 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Domain-Id: default Sep 27 17:37:31.030873 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Domain-Name: Default Sep 27 17:37:31.030873 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Id: 0b02c2ba9a0a48c294a11b42cbfe28e3 Sep 27 17:37:31.030873 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Name: tempest-AttachVolumeNegativeTest-1423690367-project Sep 27 17:37:31.030873 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: method: > Sep 27 17:37:31.030873 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: exception: Instance 8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486 could not be found. Sep 27 17:37:31.030873 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: action_args: {'id': '8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486'} Sep 27 17:37:31.031855 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 17:37:31.031855 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:37:31.031855 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 17:37:31.031855 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 17:37:31.031855 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 17:37:31.031855 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 17:37:31.031855 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 17:37:31.031855 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 17:37:31.031855 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 17:37:31.031855 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 17:37:31.031855 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486 could not be found. Sep 27 17:37:31.031855 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:37:31.031855 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:37:31.031855 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:37:31.031855 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:37:31.031855 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:37:31.031855 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:37:31.031855 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 17:37:31.031855 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 17:37:31.031855 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 17:37:31.033530 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 17:37:31.033530 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 17:37:31.033530 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 17:37:31.033530 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 17:37:31.033530 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 17:37:31.033530 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 17:37:31.033530 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 17:37:31.033530 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486 could not be found. Sep 27 17:37:31.033530 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:37:31.033530 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:37:31.033530 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:37:31.033530 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:37:31.033530 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:37:31.033530 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:37:31.033530 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 17:37:31.033530 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 17:37:31.033530 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486 could not be found. Sep 27 17:37:31.033530 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:37:31.034990 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-8202031b-755e-41b8-a0a0-a50cba2e2997 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Returning 404 to user: Instance 8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486 could not be found. {{(pid=120416) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 17:37:31.034990 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-8202031b-755e-41b8-a0a0-a50cba2e2997 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486" status: 404 len: 111 microversion: 2.1 time: 0.030678 Sep 27 17:37:31.034990 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 568/1114] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:37:30 2022] GET /compute/v2.1/servers/8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 17:37:31.039432 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-35d3379e-b814-4e34-b363-d9599d2b9b4d tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '.version_select at 0x7fe725799e50>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:37:31.058942 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-35d3379e-b814-4e34-b363-d9599d2b9b4d tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2093910123" status: 202 len: 0 microversion: 2.1 time: 0.023390 Sep 27 17:37:31.059495 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 547/1115] 10.222.0.55 () {58 vars in 1221 bytes} [Tue Sep 27 17:37:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2093910123 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 17:37:32.795351 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-d22dc504-2f7c-4a8b-b23c-abb7d7658937 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:37:32.795847 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-d22dc504-2f7c-4a8b-b23c-abb7d7658937 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: 8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:37:32.802167 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d22dc504-2f7c-4a8b-b23c-abb7d7658937 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:37:32.802637 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d22dc504-2f7c-4a8b-b23c-abb7d7658937 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:37:32.803063 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d22dc504-2f7c-4a8b-b23c-abb7d7658937 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:37:32.803741 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d22dc504-2f7c-4a8b-b23c-abb7d7658937 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:37:32.804184 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d22dc504-2f7c-4a8b-b23c-abb7d7658937 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:37:32.804598 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-d22dc504-2f7c-4a8b-b23c-abb7d7658937 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:37:32.817506 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.wsgi [None req-d22dc504-2f7c-4a8b-b23c-abb7d7658937 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] HTTP exception thrown: Instance 8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486 could not be found. Sep 27 17:37:32.819042 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-d22dc504-2f7c-4a8b-b23c-abb7d7658937 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Request method failure captured: Sep 27 17:37:32.819042 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: request: DELETE /compute/v2.1/servers/8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486 HTTP/1.1 Sep 27 17:37:32.819042 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Accept: application/json Sep 27 17:37:32.819042 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Accept-Encoding: identity Sep 27 17:37:32.819042 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Connection: close Sep 27 17:37:32.819042 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Content-Length: 0 Sep 27 17:37:32.819042 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Content-Type: application/json Sep 27 17:37:32.819042 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Host: 10.222.0.55 Sep 27 17:37:32.819042 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Openstack-System-Scope: None Sep 27 17:37:32.819042 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: User-Agent: python-urllib3/1.26.12 Sep 27 17:37:32.819042 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Auth-Token: gAAAAABjMzJLbcCEQOqdb7vUsgmB1kYoJEkf6gmC-gBv2tRXmVys19QrTRcPsWXwKEDAq84Zx8Lk9yj3l6xwznprR9KLIbGZ9V7KSdvhEmUqz6sxyX18DRVOHZ32x9KkM54n-fmW5MzSlVPgKqrw3Lvqvb4fGZ9DWc41NDKWL10YNVKBy3FY280 Sep 27 17:37:32.819042 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Domain-Id: None Sep 27 17:37:32.819042 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Domain-Name: None Sep 27 17:37:32.819042 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Identity-Status: Confirmed Sep 27 17:37:32.819042 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Is-Admin-Project: True Sep 27 17:37:32.819042 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Domain-Id: default Sep 27 17:37:32.819042 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Domain-Name: Default Sep 27 17:37:32.819042 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Id: ef13103d3d8b43e1882d4820c8d9247b Sep 27 17:37:32.819042 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Name: tempest-AttachVolumeNegativeTest-1423690367 Sep 27 17:37:32.819042 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Role: reader,member Sep 27 17:37:32.819042 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Roles: reader,member Sep 27 17:37:32.820678 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ef13103d3d8b43e1882d4820c8d9247b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_ef13103d3d8b43e1882d4820c8d9247b", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ef13103d3d8b43e1882d4820c8d9247b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/ef13103d3d8b43e1882d4820c8d9247b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 27 17:37:32.820678 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Tenant: tempest-AttachVolumeNegativeTest-1423690367 Sep 27 17:37:32.820678 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Tenant-Id: ef13103d3d8b43e1882d4820c8d9247b Sep 27 17:37:32.820678 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1423690367 Sep 27 17:37:32.820678 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User: tempest-AttachVolumeNegativeTest-1423690367-project Sep 27 17:37:32.820678 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Domain-Id: default Sep 27 17:37:32.820678 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Domain-Name: Default Sep 27 17:37:32.820678 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Id: 0b02c2ba9a0a48c294a11b42cbfe28e3 Sep 27 17:37:32.820678 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Name: tempest-AttachVolumeNegativeTest-1423690367-project Sep 27 17:37:32.820678 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: method: > Sep 27 17:37:32.820678 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: exception: Instance 8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486 could not be found. Sep 27 17:37:32.820678 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: action_args: {'id': '8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486'} Sep 27 17:37:32.821507 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 17:37:32.821507 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:37:32.821507 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 17:37:32.821507 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 17:37:32.821507 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 17:37:32.821507 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 17:37:32.821507 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 17:37:32.821507 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 17:37:32.821507 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 17:37:32.821507 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 17:37:32.821507 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486 could not be found. Sep 27 17:37:32.821507 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:37:32.821507 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:37:32.821507 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:37:32.821507 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:37:32.821507 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:37:32.821507 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:37:32.821507 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 17:37:32.821507 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 17:37:32.821507 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 17:37:32.823072 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 17:37:32.823072 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 27 17:37:32.823072 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 27 17:37:32.823072 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 27 17:37:32.823072 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 27 17:37:32.823072 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 17:37:32.823072 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 17:37:32.823072 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 17:37:32.823072 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 17:37:32.823072 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486 could not be found. Sep 27 17:37:32.823072 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:37:32.823072 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:37:32.823072 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:37:32.823072 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:37:32.823072 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:37:32.823072 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:37:32.823072 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 17:37:32.823072 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 17:37:32.823072 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486 could not be found. Sep 27 17:37:32.823072 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:37:32.824659 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-d22dc504-2f7c-4a8b-b23c-abb7d7658937 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Returning 404 to user: Instance 8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486 could not be found. {{(pid=120416) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 17:37:32.824659 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-d22dc504-2f7c-4a8b-b23c-abb7d7658937 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "DELETE /compute/v2.1/servers/8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486" status: 404 len: 111 microversion: 2.1 time: 0.029542 Sep 27 17:37:32.824659 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 569/1116] 10.222.0.55 () {58 vars in 1239 bytes} [Tue Sep 27 17:37:32 2022] DELETE /compute/v2.1/servers/8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 17:37:32.829320 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-4713bdca-5a12-469f-8e84-be86f91f97f6 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:37:32.829933 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-4713bdca-5a12-469f-8e84-be86f91f97f6 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: 8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:37:32.836543 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4713bdca-5a12-469f-8e84-be86f91f97f6 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:37:32.837030 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4713bdca-5a12-469f-8e84-be86f91f97f6 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:37:32.837470 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4713bdca-5a12-469f-8e84-be86f91f97f6 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:37:32.838193 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4713bdca-5a12-469f-8e84-be86f91f97f6 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:37:32.838654 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4713bdca-5a12-469f-8e84-be86f91f97f6 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:37:32.839083 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4713bdca-5a12-469f-8e84-be86f91f97f6 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:37:32.852538 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.wsgi [None req-4713bdca-5a12-469f-8e84-be86f91f97f6 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] HTTP exception thrown: Instance 8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486 could not be found. Sep 27 17:37:32.854195 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-4713bdca-5a12-469f-8e84-be86f91f97f6 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Request method failure captured: Sep 27 17:37:32.854195 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: request: GET /compute/v2.1/servers/8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486 HTTP/1.1 Sep 27 17:37:32.854195 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Accept: application/json Sep 27 17:37:32.854195 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Accept-Encoding: identity Sep 27 17:37:32.854195 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Connection: close Sep 27 17:37:32.854195 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Content-Length: 0 Sep 27 17:37:32.854195 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Content-Type: application/json Sep 27 17:37:32.854195 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Host: 10.222.0.55 Sep 27 17:37:32.854195 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Openstack-System-Scope: None Sep 27 17:37:32.854195 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: User-Agent: python-urllib3/1.26.12 Sep 27 17:37:32.854195 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Auth-Token: gAAAAABjMzJLbcCEQOqdb7vUsgmB1kYoJEkf6gmC-gBv2tRXmVys19QrTRcPsWXwKEDAq84Zx8Lk9yj3l6xwznprR9KLIbGZ9V7KSdvhEmUqz6sxyX18DRVOHZ32x9KkM54n-fmW5MzSlVPgKqrw3Lvqvb4fGZ9DWc41NDKWL10YNVKBy3FY280 Sep 27 17:37:32.854195 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Domain-Id: None Sep 27 17:37:32.854195 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Domain-Name: None Sep 27 17:37:32.854195 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Identity-Status: Confirmed Sep 27 17:37:32.854195 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Is-Admin-Project: True Sep 27 17:37:32.854195 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Domain-Id: default Sep 27 17:37:32.854195 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Domain-Name: Default Sep 27 17:37:32.854195 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Id: ef13103d3d8b43e1882d4820c8d9247b Sep 27 17:37:32.854195 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Name: tempest-AttachVolumeNegativeTest-1423690367 Sep 27 17:37:32.854195 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Role: reader,member Sep 27 17:37:32.854195 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Roles: reader,member Sep 27 17:37:32.855833 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ef13103d3d8b43e1882d4820c8d9247b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_ef13103d3d8b43e1882d4820c8d9247b", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ef13103d3d8b43e1882d4820c8d9247b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/ef13103d3d8b43e1882d4820c8d9247b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 27 17:37:32.855833 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Tenant: tempest-AttachVolumeNegativeTest-1423690367 Sep 27 17:37:32.855833 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Tenant-Id: ef13103d3d8b43e1882d4820c8d9247b Sep 27 17:37:32.855833 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1423690367 Sep 27 17:37:32.855833 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User: tempest-AttachVolumeNegativeTest-1423690367-project Sep 27 17:37:32.855833 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Domain-Id: default Sep 27 17:37:32.855833 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Domain-Name: Default Sep 27 17:37:32.855833 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Id: 0b02c2ba9a0a48c294a11b42cbfe28e3 Sep 27 17:37:32.855833 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Name: tempest-AttachVolumeNegativeTest-1423690367-project Sep 27 17:37:32.855833 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: method: > Sep 27 17:37:32.855833 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: exception: Instance 8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486 could not be found. Sep 27 17:37:32.855833 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: action_args: {'id': '8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486'} Sep 27 17:37:32.856782 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 17:37:32.856782 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:37:32.856782 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 17:37:32.856782 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 17:37:32.856782 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 17:37:32.856782 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 17:37:32.856782 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 17:37:32.856782 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 17:37:32.856782 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 17:37:32.856782 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 17:37:32.856782 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486 could not be found. Sep 27 17:37:32.856782 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:37:32.856782 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:37:32.856782 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:37:32.856782 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:37:32.856782 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:37:32.856782 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:37:32.856782 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 17:37:32.856782 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 17:37:32.856782 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 17:37:32.858924 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 17:37:32.858924 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 17:37:32.858924 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 17:37:32.858924 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 17:37:32.858924 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 17:37:32.858924 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 17:37:32.858924 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 17:37:32.858924 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486 could not be found. Sep 27 17:37:32.858924 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:37:32.858924 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:37:32.858924 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:37:32.858924 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:37:32.858924 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:37:32.858924 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:37:32.858924 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 17:37:32.858924 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 17:37:32.858924 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486 could not be found. Sep 27 17:37:32.858924 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:37:32.860371 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-4713bdca-5a12-469f-8e84-be86f91f97f6 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Returning 404 to user: Instance 8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486 could not be found. {{(pid=120415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 17:37:32.860371 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-4713bdca-5a12-469f-8e84-be86f91f97f6 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486" status: 404 len: 111 microversion: 2.1 time: 0.030577 Sep 27 17:37:32.860371 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 548/1117] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:37:32 2022] GET /compute/v2.1/servers/8e0eccf2-0b4d-4b31-96cf-c9bf5f7a6486 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 17:37:34.002778 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-344e91c3-b631-4220-b20d-b63cf3686e49 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:37:34.006477 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-344e91c3-b631-4220-b20d-b63cf3686e49 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: ce5f26c2-638d-4baf-9ccb-ba578b97cfc1] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:37:34.009605 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-344e91c3-b631-4220-b20d-b63cf3686e49 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:37:34.010101 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-344e91c3-b631-4220-b20d-b63cf3686e49 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:37:34.010567 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-344e91c3-b631-4220-b20d-b63cf3686e49 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:37:34.011247 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-344e91c3-b631-4220-b20d-b63cf3686e49 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:37:34.011698 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-344e91c3-b631-4220-b20d-b63cf3686e49 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:37:34.012121 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-344e91c3-b631-4220-b20d-b63cf3686e49 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:37:34.025590 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.wsgi [None req-344e91c3-b631-4220-b20d-b63cf3686e49 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] HTTP exception thrown: Instance ce5f26c2-638d-4baf-9ccb-ba578b97cfc1 could not be found. Sep 27 17:37:34.027144 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-344e91c3-b631-4220-b20d-b63cf3686e49 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Request method failure captured: Sep 27 17:37:34.027144 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: request: DELETE /compute/v2.1/servers/ce5f26c2-638d-4baf-9ccb-ba578b97cfc1 HTTP/1.1 Sep 27 17:37:34.027144 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Accept: application/json Sep 27 17:37:34.027144 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Accept-Encoding: identity Sep 27 17:37:34.027144 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Connection: close Sep 27 17:37:34.027144 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Content-Length: 0 Sep 27 17:37:34.027144 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Content-Type: application/json Sep 27 17:37:34.027144 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Host: 10.222.0.55 Sep 27 17:37:34.027144 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Openstack-System-Scope: None Sep 27 17:37:34.027144 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: User-Agent: python-urllib3/1.26.12 Sep 27 17:37:34.027144 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Auth-Token: gAAAAABjMzJLbcCEQOqdb7vUsgmB1kYoJEkf6gmC-gBv2tRXmVys19QrTRcPsWXwKEDAq84Zx8Lk9yj3l6xwznprR9KLIbGZ9V7KSdvhEmUqz6sxyX18DRVOHZ32x9KkM54n-fmW5MzSlVPgKqrw3Lvqvb4fGZ9DWc41NDKWL10YNVKBy3FY280 Sep 27 17:37:34.027144 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Domain-Id: None Sep 27 17:37:34.027144 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Domain-Name: None Sep 27 17:37:34.027144 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Identity-Status: Confirmed Sep 27 17:37:34.027144 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Is-Admin-Project: True Sep 27 17:37:34.027144 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Domain-Id: default Sep 27 17:37:34.027144 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Domain-Name: Default Sep 27 17:37:34.027144 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Id: ef13103d3d8b43e1882d4820c8d9247b Sep 27 17:37:34.027144 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Name: tempest-AttachVolumeNegativeTest-1423690367 Sep 27 17:37:34.027144 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Role: reader,member Sep 27 17:37:34.027144 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Roles: reader,member Sep 27 17:37:34.028890 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ef13103d3d8b43e1882d4820c8d9247b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_ef13103d3d8b43e1882d4820c8d9247b", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ef13103d3d8b43e1882d4820c8d9247b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/ef13103d3d8b43e1882d4820c8d9247b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 27 17:37:34.028890 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Tenant: tempest-AttachVolumeNegativeTest-1423690367 Sep 27 17:37:34.028890 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Tenant-Id: ef13103d3d8b43e1882d4820c8d9247b Sep 27 17:37:34.028890 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1423690367 Sep 27 17:37:34.028890 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User: tempest-AttachVolumeNegativeTest-1423690367-project Sep 27 17:37:34.028890 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Domain-Id: default Sep 27 17:37:34.028890 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Domain-Name: Default Sep 27 17:37:34.028890 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Id: 0b02c2ba9a0a48c294a11b42cbfe28e3 Sep 27 17:37:34.028890 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Name: tempest-AttachVolumeNegativeTest-1423690367-project Sep 27 17:37:34.028890 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: method: > Sep 27 17:37:34.028890 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: exception: Instance ce5f26c2-638d-4baf-9ccb-ba578b97cfc1 could not be found. Sep 27 17:37:34.028890 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: action_args: {'id': 'ce5f26c2-638d-4baf-9ccb-ba578b97cfc1'} Sep 27 17:37:34.030515 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 17:37:34.030515 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:37:34.030515 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 17:37:34.030515 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 17:37:34.030515 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 17:37:34.030515 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 17:37:34.030515 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 17:37:34.030515 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 17:37:34.030515 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 17:37:34.030515 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 17:37:34.030515 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce5f26c2-638d-4baf-9ccb-ba578b97cfc1 could not be found. Sep 27 17:37:34.030515 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:37:34.030515 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:37:34.030515 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:37:34.030515 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:37:34.030515 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:37:34.030515 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:37:34.030515 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 17:37:34.030515 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 17:37:34.030515 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 17:37:34.032058 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 17:37:34.032058 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 27 17:37:34.032058 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 27 17:37:34.032058 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 27 17:37:34.032058 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 27 17:37:34.032058 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 17:37:34.032058 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 17:37:34.032058 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 17:37:34.032058 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 17:37:34.032058 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce5f26c2-638d-4baf-9ccb-ba578b97cfc1 could not be found. Sep 27 17:37:34.032058 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:37:34.032058 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:37:34.032058 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:37:34.032058 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:37:34.032058 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:37:34.032058 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:37:34.032058 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 17:37:34.032058 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 17:37:34.032058 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce5f26c2-638d-4baf-9ccb-ba578b97cfc1 could not be found. Sep 27 17:37:34.032058 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:37:34.033608 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-344e91c3-b631-4220-b20d-b63cf3686e49 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Returning 404 to user: Instance ce5f26c2-638d-4baf-9ccb-ba578b97cfc1 could not be found. {{(pid=120416) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 17:37:34.033608 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-344e91c3-b631-4220-b20d-b63cf3686e49 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "DELETE /compute/v2.1/servers/ce5f26c2-638d-4baf-9ccb-ba578b97cfc1" status: 404 len: 111 microversion: 2.1 time: 0.034085 Sep 27 17:37:34.033608 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 570/1118] 10.222.0.55 () {58 vars in 1239 bytes} [Tue Sep 27 17:37:33 2022] DELETE /compute/v2.1/servers/ce5f26c2-638d-4baf-9ccb-ba578b97cfc1 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 27 17:37:34.037562 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-ff225218-fb02-4d8b-82e2-c54b5d57c39b tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:37:34.038194 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-ff225218-fb02-4d8b-82e2-c54b5d57c39b tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: ce5f26c2-638d-4baf-9ccb-ba578b97cfc1] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:37:34.044606 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ff225218-fb02-4d8b-82e2-c54b5d57c39b tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:37:34.045112 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ff225218-fb02-4d8b-82e2-c54b5d57c39b tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:37:34.045544 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ff225218-fb02-4d8b-82e2-c54b5d57c39b tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:37:34.046255 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ff225218-fb02-4d8b-82e2-c54b5d57c39b tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:37:34.046710 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ff225218-fb02-4d8b-82e2-c54b5d57c39b tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:37:34.047138 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ff225218-fb02-4d8b-82e2-c54b5d57c39b tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:37:34.061702 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.wsgi [None req-ff225218-fb02-4d8b-82e2-c54b5d57c39b tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] HTTP exception thrown: Instance ce5f26c2-638d-4baf-9ccb-ba578b97cfc1 could not be found. Sep 27 17:37:34.063223 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-ff225218-fb02-4d8b-82e2-c54b5d57c39b tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Request method failure captured: Sep 27 17:37:34.063223 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: request: GET /compute/v2.1/servers/ce5f26c2-638d-4baf-9ccb-ba578b97cfc1 HTTP/1.1 Sep 27 17:37:34.063223 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Accept: application/json Sep 27 17:37:34.063223 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Accept-Encoding: identity Sep 27 17:37:34.063223 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Connection: close Sep 27 17:37:34.063223 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Content-Length: 0 Sep 27 17:37:34.063223 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Content-Type: application/json Sep 27 17:37:34.063223 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Host: 10.222.0.55 Sep 27 17:37:34.063223 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Openstack-System-Scope: None Sep 27 17:37:34.063223 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: User-Agent: python-urllib3/1.26.12 Sep 27 17:37:34.063223 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Auth-Token: gAAAAABjMzJLbcCEQOqdb7vUsgmB1kYoJEkf6gmC-gBv2tRXmVys19QrTRcPsWXwKEDAq84Zx8Lk9yj3l6xwznprR9KLIbGZ9V7KSdvhEmUqz6sxyX18DRVOHZ32x9KkM54n-fmW5MzSlVPgKqrw3Lvqvb4fGZ9DWc41NDKWL10YNVKBy3FY280 Sep 27 17:37:34.063223 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Domain-Id: None Sep 27 17:37:34.063223 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Domain-Name: None Sep 27 17:37:34.063223 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Identity-Status: Confirmed Sep 27 17:37:34.063223 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Is-Admin-Project: True Sep 27 17:37:34.063223 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Domain-Id: default Sep 27 17:37:34.063223 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Domain-Name: Default Sep 27 17:37:34.063223 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Id: ef13103d3d8b43e1882d4820c8d9247b Sep 27 17:37:34.063223 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Name: tempest-AttachVolumeNegativeTest-1423690367 Sep 27 17:37:34.063223 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Role: reader,member Sep 27 17:37:34.063223 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Roles: reader,member Sep 27 17:37:34.064851 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ef13103d3d8b43e1882d4820c8d9247b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_ef13103d3d8b43e1882d4820c8d9247b", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ef13103d3d8b43e1882d4820c8d9247b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/ef13103d3d8b43e1882d4820c8d9247b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 27 17:37:34.064851 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Tenant: tempest-AttachVolumeNegativeTest-1423690367 Sep 27 17:37:34.064851 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Tenant-Id: ef13103d3d8b43e1882d4820c8d9247b Sep 27 17:37:34.064851 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1423690367 Sep 27 17:37:34.064851 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User: tempest-AttachVolumeNegativeTest-1423690367-project Sep 27 17:37:34.064851 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Domain-Id: default Sep 27 17:37:34.064851 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Domain-Name: Default Sep 27 17:37:34.064851 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Id: 0b02c2ba9a0a48c294a11b42cbfe28e3 Sep 27 17:37:34.064851 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Name: tempest-AttachVolumeNegativeTest-1423690367-project Sep 27 17:37:34.064851 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: method: > Sep 27 17:37:34.064851 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: exception: Instance ce5f26c2-638d-4baf-9ccb-ba578b97cfc1 could not be found. Sep 27 17:37:34.064851 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: action_args: {'id': 'ce5f26c2-638d-4baf-9ccb-ba578b97cfc1'} Sep 27 17:37:34.065695 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 17:37:34.065695 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:37:34.065695 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 17:37:34.065695 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 17:37:34.065695 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 17:37:34.065695 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 17:37:34.065695 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 17:37:34.065695 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 17:37:34.065695 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 17:37:34.065695 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 17:37:34.065695 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce5f26c2-638d-4baf-9ccb-ba578b97cfc1 could not be found. Sep 27 17:37:34.065695 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:37:34.065695 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:37:34.065695 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:37:34.065695 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:37:34.065695 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:37:34.065695 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:37:34.065695 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 17:37:34.065695 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 17:37:34.065695 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 17:37:34.067011 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 17:37:34.067011 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 17:37:34.067011 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 17:37:34.067011 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 17:37:34.067011 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 17:37:34.067011 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 17:37:34.067011 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 17:37:34.067011 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce5f26c2-638d-4baf-9ccb-ba578b97cfc1 could not be found. Sep 27 17:37:34.067011 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:37:34.067011 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:37:34.067011 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:37:34.067011 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:37:34.067011 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:37:34.067011 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:37:34.067011 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 17:37:34.067011 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 17:37:34.067011 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce5f26c2-638d-4baf-9ccb-ba578b97cfc1 could not be found. Sep 27 17:37:34.067011 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:37:34.068167 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-ff225218-fb02-4d8b-82e2-c54b5d57c39b tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Returning 404 to user: Instance ce5f26c2-638d-4baf-9ccb-ba578b97cfc1 could not be found. {{(pid=120415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 17:37:34.068167 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-ff225218-fb02-4d8b-82e2-c54b5d57c39b tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/ce5f26c2-638d-4baf-9ccb-ba578b97cfc1" status: 404 len: 111 microversion: 2.1 time: 0.031018 Sep 27 17:37:34.068167 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 549/1119] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:37:34 2022] GET /compute/v2.1/servers/ce5f26c2-638d-4baf-9ccb-ba578b97cfc1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 17:37:34.073056 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-9ceb9e8f-b644-4f8e-a4fe-bda3a6439eb9 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:37:34.073549 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-9ceb9e8f-b644-4f8e-a4fe-bda3a6439eb9 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: 9cd2f537-78c4-4a00-95ab-4f7b115810cd] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:37:34.079906 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9ceb9e8f-b644-4f8e-a4fe-bda3a6439eb9 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:37:34.080384 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9ceb9e8f-b644-4f8e-a4fe-bda3a6439eb9 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:37:34.080819 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9ceb9e8f-b644-4f8e-a4fe-bda3a6439eb9 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:37:34.081508 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9ceb9e8f-b644-4f8e-a4fe-bda3a6439eb9 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:37:34.081977 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9ceb9e8f-b644-4f8e-a4fe-bda3a6439eb9 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:37:34.082433 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-9ceb9e8f-b644-4f8e-a4fe-bda3a6439eb9 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:37:34.098395 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.wsgi [None req-9ceb9e8f-b644-4f8e-a4fe-bda3a6439eb9 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] HTTP exception thrown: Instance 9cd2f537-78c4-4a00-95ab-4f7b115810cd could not be found. Sep 27 17:37:34.099908 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-9ceb9e8f-b644-4f8e-a4fe-bda3a6439eb9 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Request method failure captured: Sep 27 17:37:34.099908 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: request: DELETE /compute/v2.1/servers/9cd2f537-78c4-4a00-95ab-4f7b115810cd HTTP/1.1 Sep 27 17:37:34.099908 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Accept: application/json Sep 27 17:37:34.099908 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Accept-Encoding: identity Sep 27 17:37:34.099908 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Connection: close Sep 27 17:37:34.099908 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Content-Length: 0 Sep 27 17:37:34.099908 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Content-Type: application/json Sep 27 17:37:34.099908 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Host: 10.222.0.55 Sep 27 17:37:34.099908 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Openstack-System-Scope: None Sep 27 17:37:34.099908 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: User-Agent: python-urllib3/1.26.12 Sep 27 17:37:34.099908 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Auth-Token: gAAAAABjMzJLbcCEQOqdb7vUsgmB1kYoJEkf6gmC-gBv2tRXmVys19QrTRcPsWXwKEDAq84Zx8Lk9yj3l6xwznprR9KLIbGZ9V7KSdvhEmUqz6sxyX18DRVOHZ32x9KkM54n-fmW5MzSlVPgKqrw3Lvqvb4fGZ9DWc41NDKWL10YNVKBy3FY280 Sep 27 17:37:34.099908 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Domain-Id: None Sep 27 17:37:34.099908 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Domain-Name: None Sep 27 17:37:34.099908 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Identity-Status: Confirmed Sep 27 17:37:34.099908 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Is-Admin-Project: True Sep 27 17:37:34.099908 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Domain-Id: default Sep 27 17:37:34.099908 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Domain-Name: Default Sep 27 17:37:34.099908 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Id: ef13103d3d8b43e1882d4820c8d9247b Sep 27 17:37:34.099908 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Name: tempest-AttachVolumeNegativeTest-1423690367 Sep 27 17:37:34.099908 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Role: reader,member Sep 27 17:37:34.099908 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Roles: reader,member Sep 27 17:37:34.102512 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ef13103d3d8b43e1882d4820c8d9247b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_ef13103d3d8b43e1882d4820c8d9247b", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ef13103d3d8b43e1882d4820c8d9247b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/ef13103d3d8b43e1882d4820c8d9247b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 27 17:37:34.102512 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Tenant: tempest-AttachVolumeNegativeTest-1423690367 Sep 27 17:37:34.102512 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Tenant-Id: ef13103d3d8b43e1882d4820c8d9247b Sep 27 17:37:34.102512 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1423690367 Sep 27 17:37:34.102512 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User: tempest-AttachVolumeNegativeTest-1423690367-project Sep 27 17:37:34.102512 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Domain-Id: default Sep 27 17:37:34.102512 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Domain-Name: Default Sep 27 17:37:34.102512 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Id: 0b02c2ba9a0a48c294a11b42cbfe28e3 Sep 27 17:37:34.102512 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Name: tempest-AttachVolumeNegativeTest-1423690367-project Sep 27 17:37:34.102512 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: method: > Sep 27 17:37:34.102512 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: exception: Instance 9cd2f537-78c4-4a00-95ab-4f7b115810cd could not be found. Sep 27 17:37:34.102512 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: action_args: {'id': '9cd2f537-78c4-4a00-95ab-4f7b115810cd'} Sep 27 17:37:34.103865 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 17:37:34.103865 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:37:34.103865 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 17:37:34.103865 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 17:37:34.103865 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 17:37:34.103865 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 17:37:34.103865 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 17:37:34.103865 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 17:37:34.103865 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 17:37:34.103865 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 17:37:34.103865 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9cd2f537-78c4-4a00-95ab-4f7b115810cd could not be found. Sep 27 17:37:34.103865 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:37:34.103865 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:37:34.103865 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:37:34.103865 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:37:34.103865 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:37:34.103865 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:37:34.103865 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 17:37:34.103865 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 17:37:34.103865 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 17:37:34.106259 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 17:37:34.106259 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 27 17:37:34.106259 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 27 17:37:34.106259 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 27 17:37:34.106259 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 27 17:37:34.106259 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 17:37:34.106259 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 17:37:34.106259 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 17:37:34.106259 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 17:37:34.106259 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9cd2f537-78c4-4a00-95ab-4f7b115810cd could not be found. Sep 27 17:37:34.106259 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:37:34.106259 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:37:34.106259 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:37:34.106259 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:37:34.106259 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:37:34.106259 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:37:34.106259 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 17:37:34.106259 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 17:37:34.106259 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9cd2f537-78c4-4a00-95ab-4f7b115810cd could not be found. Sep 27 17:37:34.106259 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:37:34.108636 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-9ceb9e8f-b644-4f8e-a4fe-bda3a6439eb9 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Returning 404 to user: Instance 9cd2f537-78c4-4a00-95ab-4f7b115810cd could not be found. {{(pid=120416) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 17:37:34.108636 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-9ceb9e8f-b644-4f8e-a4fe-bda3a6439eb9 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "DELETE /compute/v2.1/servers/9cd2f537-78c4-4a00-95ab-4f7b115810cd" status: 404 len: 111 microversion: 2.1 time: 0.032037 Sep 27 17:37:34.108636 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 571/1120] 10.222.0.55 () {58 vars in 1239 bytes} [Tue Sep 27 17:37:34 2022] DELETE /compute/v2.1/servers/9cd2f537-78c4-4a00-95ab-4f7b115810cd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 17:37:34.109644 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-f5539fcd-10b9-4857-a19b-d1b37186371b tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:37:34.110295 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-f5539fcd-10b9-4857-a19b-d1b37186371b tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: 9cd2f537-78c4-4a00-95ab-4f7b115810cd] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:37:34.116432 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f5539fcd-10b9-4857-a19b-d1b37186371b tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:37:34.116943 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f5539fcd-10b9-4857-a19b-d1b37186371b tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:37:34.117383 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f5539fcd-10b9-4857-a19b-d1b37186371b tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:37:34.118087 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f5539fcd-10b9-4857-a19b-d1b37186371b tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:37:34.118560 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f5539fcd-10b9-4857-a19b-d1b37186371b tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:37:34.118985 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f5539fcd-10b9-4857-a19b-d1b37186371b tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:37:34.132152 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.wsgi [None req-f5539fcd-10b9-4857-a19b-d1b37186371b tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] HTTP exception thrown: Instance 9cd2f537-78c4-4a00-95ab-4f7b115810cd could not be found. Sep 27 17:37:34.133653 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-f5539fcd-10b9-4857-a19b-d1b37186371b tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Request method failure captured: Sep 27 17:37:34.133653 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: request: GET /compute/v2.1/servers/9cd2f537-78c4-4a00-95ab-4f7b115810cd HTTP/1.1 Sep 27 17:37:34.133653 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Accept: application/json Sep 27 17:37:34.133653 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Accept-Encoding: identity Sep 27 17:37:34.133653 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Connection: close Sep 27 17:37:34.133653 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Content-Length: 0 Sep 27 17:37:34.133653 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Content-Type: application/json Sep 27 17:37:34.133653 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Host: 10.222.0.55 Sep 27 17:37:34.133653 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Openstack-System-Scope: None Sep 27 17:37:34.133653 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: User-Agent: python-urllib3/1.26.12 Sep 27 17:37:34.133653 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Auth-Token: gAAAAABjMzJLbcCEQOqdb7vUsgmB1kYoJEkf6gmC-gBv2tRXmVys19QrTRcPsWXwKEDAq84Zx8Lk9yj3l6xwznprR9KLIbGZ9V7KSdvhEmUqz6sxyX18DRVOHZ32x9KkM54n-fmW5MzSlVPgKqrw3Lvqvb4fGZ9DWc41NDKWL10YNVKBy3FY280 Sep 27 17:37:34.133653 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Domain-Id: None Sep 27 17:37:34.133653 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Domain-Name: None Sep 27 17:37:34.133653 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Identity-Status: Confirmed Sep 27 17:37:34.133653 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Is-Admin-Project: True Sep 27 17:37:34.133653 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Domain-Id: default Sep 27 17:37:34.133653 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Domain-Name: Default Sep 27 17:37:34.133653 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Id: ef13103d3d8b43e1882d4820c8d9247b Sep 27 17:37:34.133653 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Name: tempest-AttachVolumeNegativeTest-1423690367 Sep 27 17:37:34.133653 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Role: reader,member Sep 27 17:37:34.133653 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Roles: reader,member Sep 27 17:37:34.135325 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ef13103d3d8b43e1882d4820c8d9247b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_ef13103d3d8b43e1882d4820c8d9247b", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ef13103d3d8b43e1882d4820c8d9247b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/ef13103d3d8b43e1882d4820c8d9247b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 27 17:37:34.135325 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Tenant: tempest-AttachVolumeNegativeTest-1423690367 Sep 27 17:37:34.135325 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Tenant-Id: ef13103d3d8b43e1882d4820c8d9247b Sep 27 17:37:34.135325 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1423690367 Sep 27 17:37:34.135325 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User: tempest-AttachVolumeNegativeTest-1423690367-project Sep 27 17:37:34.135325 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Domain-Id: default Sep 27 17:37:34.135325 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Domain-Name: Default Sep 27 17:37:34.135325 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Id: 0b02c2ba9a0a48c294a11b42cbfe28e3 Sep 27 17:37:34.135325 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Name: tempest-AttachVolumeNegativeTest-1423690367-project Sep 27 17:37:34.135325 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: method: > Sep 27 17:37:34.135325 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: exception: Instance 9cd2f537-78c4-4a00-95ab-4f7b115810cd could not be found. Sep 27 17:37:34.135325 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: action_args: {'id': '9cd2f537-78c4-4a00-95ab-4f7b115810cd'} Sep 27 17:37:34.136376 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 17:37:34.136376 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:37:34.136376 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 17:37:34.136376 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 17:37:34.136376 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 17:37:34.136376 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 17:37:34.136376 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 17:37:34.136376 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 17:37:34.136376 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 17:37:34.136376 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 17:37:34.136376 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9cd2f537-78c4-4a00-95ab-4f7b115810cd could not be found. Sep 27 17:37:34.136376 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:37:34.136376 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:37:34.136376 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:37:34.136376 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:37:34.136376 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:37:34.136376 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:37:34.136376 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 17:37:34.136376 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 17:37:34.136376 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 17:37:34.137983 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 17:37:34.137983 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 17:37:34.137983 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 17:37:34.137983 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 17:37:34.137983 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 17:37:34.137983 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 17:37:34.137983 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 17:37:34.137983 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9cd2f537-78c4-4a00-95ab-4f7b115810cd could not be found. Sep 27 17:37:34.137983 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:37:34.137983 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:37:34.137983 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:37:34.137983 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:37:34.137983 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:37:34.137983 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:37:34.137983 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 17:37:34.137983 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 17:37:34.137983 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9cd2f537-78c4-4a00-95ab-4f7b115810cd could not be found. Sep 27 17:37:34.137983 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:37:34.139854 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-f5539fcd-10b9-4857-a19b-d1b37186371b tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Returning 404 to user: Instance 9cd2f537-78c4-4a00-95ab-4f7b115810cd could not be found. {{(pid=120415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 17:37:34.139854 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-f5539fcd-10b9-4857-a19b-d1b37186371b tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/9cd2f537-78c4-4a00-95ab-4f7b115810cd" status: 404 len: 111 microversion: 2.1 time: 0.029206 Sep 27 17:37:34.139854 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 550/1121] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:37:34 2022] GET /compute/v2.1/servers/9cd2f537-78c4-4a00-95ab-4f7b115810cd => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 27 17:37:35.272517 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-fb0145a8-0b8c-49ba-87a3-b54dc6626e24 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:37:35.272999 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-fb0145a8-0b8c-49ba-87a3-b54dc6626e24 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: fef20d9a-42bf-4605-bbcb-b673d215a5b9] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:37:35.279755 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-fb0145a8-0b8c-49ba-87a3-b54dc6626e24 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:37:35.280234 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-fb0145a8-0b8c-49ba-87a3-b54dc6626e24 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:37:35.280671 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-fb0145a8-0b8c-49ba-87a3-b54dc6626e24 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:37:35.281348 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-fb0145a8-0b8c-49ba-87a3-b54dc6626e24 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:37:35.281793 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-fb0145a8-0b8c-49ba-87a3-b54dc6626e24 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:37:35.282256 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-fb0145a8-0b8c-49ba-87a3-b54dc6626e24 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:37:35.295803 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.wsgi [None req-fb0145a8-0b8c-49ba-87a3-b54dc6626e24 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] HTTP exception thrown: Instance fef20d9a-42bf-4605-bbcb-b673d215a5b9 could not be found. Sep 27 17:37:35.297304 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-fb0145a8-0b8c-49ba-87a3-b54dc6626e24 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Request method failure captured: Sep 27 17:37:35.297304 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: request: DELETE /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9 HTTP/1.1 Sep 27 17:37:35.297304 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Accept: application/json Sep 27 17:37:35.297304 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Accept-Encoding: identity Sep 27 17:37:35.297304 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Connection: close Sep 27 17:37:35.297304 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Content-Length: 0 Sep 27 17:37:35.297304 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Content-Type: application/json Sep 27 17:37:35.297304 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Host: 10.222.0.55 Sep 27 17:37:35.297304 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Openstack-System-Scope: None Sep 27 17:37:35.297304 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: User-Agent: python-urllib3/1.26.12 Sep 27 17:37:35.297304 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Auth-Token: gAAAAABjMzJLbcCEQOqdb7vUsgmB1kYoJEkf6gmC-gBv2tRXmVys19QrTRcPsWXwKEDAq84Zx8Lk9yj3l6xwznprR9KLIbGZ9V7KSdvhEmUqz6sxyX18DRVOHZ32x9KkM54n-fmW5MzSlVPgKqrw3Lvqvb4fGZ9DWc41NDKWL10YNVKBy3FY280 Sep 27 17:37:35.297304 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Domain-Id: None Sep 27 17:37:35.297304 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Domain-Name: None Sep 27 17:37:35.297304 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Identity-Status: Confirmed Sep 27 17:37:35.297304 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Is-Admin-Project: True Sep 27 17:37:35.297304 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Domain-Id: default Sep 27 17:37:35.297304 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Domain-Name: Default Sep 27 17:37:35.297304 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Id: ef13103d3d8b43e1882d4820c8d9247b Sep 27 17:37:35.297304 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Name: tempest-AttachVolumeNegativeTest-1423690367 Sep 27 17:37:35.297304 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Role: reader,member Sep 27 17:37:35.297304 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Roles: reader,member Sep 27 17:37:35.299002 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ef13103d3d8b43e1882d4820c8d9247b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_ef13103d3d8b43e1882d4820c8d9247b", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ef13103d3d8b43e1882d4820c8d9247b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/ef13103d3d8b43e1882d4820c8d9247b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 27 17:37:35.299002 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Tenant: tempest-AttachVolumeNegativeTest-1423690367 Sep 27 17:37:35.299002 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Tenant-Id: ef13103d3d8b43e1882d4820c8d9247b Sep 27 17:37:35.299002 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1423690367 Sep 27 17:37:35.299002 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User: tempest-AttachVolumeNegativeTest-1423690367-project Sep 27 17:37:35.299002 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Domain-Id: default Sep 27 17:37:35.299002 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Domain-Name: Default Sep 27 17:37:35.299002 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Id: 0b02c2ba9a0a48c294a11b42cbfe28e3 Sep 27 17:37:35.299002 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Name: tempest-AttachVolumeNegativeTest-1423690367-project Sep 27 17:37:35.299002 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: method: > Sep 27 17:37:35.299002 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: exception: Instance fef20d9a-42bf-4605-bbcb-b673d215a5b9 could not be found. Sep 27 17:37:35.299002 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: action_args: {'id': 'fef20d9a-42bf-4605-bbcb-b673d215a5b9'} Sep 27 17:37:35.299835 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 17:37:35.299835 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:37:35.299835 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 17:37:35.299835 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 17:37:35.299835 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 17:37:35.299835 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 17:37:35.299835 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 17:37:35.299835 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 17:37:35.299835 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 17:37:35.299835 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 17:37:35.299835 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fef20d9a-42bf-4605-bbcb-b673d215a5b9 could not be found. Sep 27 17:37:35.299835 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:37:35.299835 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:37:35.299835 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:37:35.299835 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:37:35.299835 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:37:35.299835 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:37:35.299835 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 17:37:35.299835 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 17:37:35.299835 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 17:37:35.301139 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 17:37:35.301139 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 27 17:37:35.301139 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 27 17:37:35.301139 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 27 17:37:35.301139 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 27 17:37:35.301139 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 17:37:35.301139 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 17:37:35.301139 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 17:37:35.301139 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 17:37:35.301139 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fef20d9a-42bf-4605-bbcb-b673d215a5b9 could not be found. Sep 27 17:37:35.301139 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:37:35.301139 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:37:35.301139 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:37:35.301139 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:37:35.301139 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:37:35.301139 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:37:35.301139 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 17:37:35.301139 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 17:37:35.301139 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fef20d9a-42bf-4605-bbcb-b673d215a5b9 could not be found. Sep 27 17:37:35.301139 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:37:35.302466 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-fb0145a8-0b8c-49ba-87a3-b54dc6626e24 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Returning 404 to user: Instance fef20d9a-42bf-4605-bbcb-b673d215a5b9 could not be found. {{(pid=120416) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 17:37:35.302466 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-fb0145a8-0b8c-49ba-87a3-b54dc6626e24 tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "DELETE /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9" status: 404 len: 111 microversion: 2.1 time: 0.030030 Sep 27 17:37:35.302466 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 572/1122] 10.222.0.55 () {58 vars in 1239 bytes} [Tue Sep 27 17:37:35 2022] DELETE /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 17:37:35.307003 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-996f728d-a7dc-47df-97f2-d037fcd517db tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:37:35.307621 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-996f728d-a7dc-47df-97f2-d037fcd517db tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] [instance: fef20d9a-42bf-4605-bbcb-b673d215a5b9] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:37:35.314325 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-996f728d-a7dc-47df-97f2-d037fcd517db tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:37:35.314807 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-996f728d-a7dc-47df-97f2-d037fcd517db tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:37:35.315243 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-996f728d-a7dc-47df-97f2-d037fcd517db tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:37:35.315934 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-996f728d-a7dc-47df-97f2-d037fcd517db tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:37:35.316383 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-996f728d-a7dc-47df-97f2-d037fcd517db tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:37:35.316804 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-996f728d-a7dc-47df-97f2-d037fcd517db tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:37:35.330162 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.wsgi [None req-996f728d-a7dc-47df-97f2-d037fcd517db tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] HTTP exception thrown: Instance fef20d9a-42bf-4605-bbcb-b673d215a5b9 could not be found. Sep 27 17:37:35.331674 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-996f728d-a7dc-47df-97f2-d037fcd517db tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Request method failure captured: Sep 27 17:37:35.331674 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: request: GET /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9 HTTP/1.1 Sep 27 17:37:35.331674 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Accept: application/json Sep 27 17:37:35.331674 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Accept-Encoding: identity Sep 27 17:37:35.331674 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Connection: close Sep 27 17:37:35.331674 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Content-Length: 0 Sep 27 17:37:35.331674 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Content-Type: application/json Sep 27 17:37:35.331674 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Host: 10.222.0.55 Sep 27 17:37:35.331674 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Openstack-System-Scope: None Sep 27 17:37:35.331674 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: User-Agent: python-urllib3/1.26.12 Sep 27 17:37:35.331674 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Auth-Token: gAAAAABjMzJLbcCEQOqdb7vUsgmB1kYoJEkf6gmC-gBv2tRXmVys19QrTRcPsWXwKEDAq84Zx8Lk9yj3l6xwznprR9KLIbGZ9V7KSdvhEmUqz6sxyX18DRVOHZ32x9KkM54n-fmW5MzSlVPgKqrw3Lvqvb4fGZ9DWc41NDKWL10YNVKBy3FY280 Sep 27 17:37:35.331674 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Domain-Id: None Sep 27 17:37:35.331674 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Domain-Name: None Sep 27 17:37:35.331674 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Identity-Status: Confirmed Sep 27 17:37:35.331674 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Is-Admin-Project: True Sep 27 17:37:35.331674 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Domain-Id: default Sep 27 17:37:35.331674 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Domain-Name: Default Sep 27 17:37:35.331674 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Id: ef13103d3d8b43e1882d4820c8d9247b Sep 27 17:37:35.331674 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Name: tempest-AttachVolumeNegativeTest-1423690367 Sep 27 17:37:35.331674 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Role: reader,member Sep 27 17:37:35.331674 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Roles: reader,member Sep 27 17:37:35.333347 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ef13103d3d8b43e1882d4820c8d9247b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_ef13103d3d8b43e1882d4820c8d9247b", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/ef13103d3d8b43e1882d4820c8d9247b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/ef13103d3d8b43e1882d4820c8d9247b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 27 17:37:35.333347 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Tenant: tempest-AttachVolumeNegativeTest-1423690367 Sep 27 17:37:35.333347 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Tenant-Id: ef13103d3d8b43e1882d4820c8d9247b Sep 27 17:37:35.333347 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1423690367 Sep 27 17:37:35.333347 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User: tempest-AttachVolumeNegativeTest-1423690367-project Sep 27 17:37:35.333347 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Domain-Id: default Sep 27 17:37:35.333347 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Domain-Name: Default Sep 27 17:37:35.333347 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Id: 0b02c2ba9a0a48c294a11b42cbfe28e3 Sep 27 17:37:35.333347 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Name: tempest-AttachVolumeNegativeTest-1423690367-project Sep 27 17:37:35.333347 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: method: > Sep 27 17:37:35.333347 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: exception: Instance fef20d9a-42bf-4605-bbcb-b673d215a5b9 could not be found. Sep 27 17:37:35.333347 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: action_args: {'id': 'fef20d9a-42bf-4605-bbcb-b673d215a5b9'} Sep 27 17:37:35.334227 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 17:37:35.334227 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:37:35.334227 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 17:37:35.334227 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 17:37:35.334227 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 17:37:35.334227 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 17:37:35.334227 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 17:37:35.334227 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 17:37:35.334227 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 17:37:35.334227 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 17:37:35.334227 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fef20d9a-42bf-4605-bbcb-b673d215a5b9 could not be found. Sep 27 17:37:35.334227 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:37:35.334227 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:37:35.334227 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:37:35.334227 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:37:35.334227 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:37:35.334227 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:37:35.334227 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 17:37:35.334227 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 17:37:35.334227 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 17:37:35.335549 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 17:37:35.335549 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 17:37:35.335549 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 17:37:35.335549 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 17:37:35.335549 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 17:37:35.335549 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 17:37:35.335549 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 17:37:35.335549 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fef20d9a-42bf-4605-bbcb-b673d215a5b9 could not be found. Sep 27 17:37:35.335549 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:37:35.335549 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:37:35.335549 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:37:35.335549 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:37:35.335549 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:37:35.335549 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:37:35.335549 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 17:37:35.335549 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 17:37:35.335549 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fef20d9a-42bf-4605-bbcb-b673d215a5b9 could not be found. Sep 27 17:37:35.335549 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:37:35.337420 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-996f728d-a7dc-47df-97f2-d037fcd517db tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] Returning 404 to user: Instance fef20d9a-42bf-4605-bbcb-b673d215a5b9 could not be found. {{(pid=120415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 17:37:35.337420 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-996f728d-a7dc-47df-97f2-d037fcd517db tempest-AttachVolumeNegativeTest-1423690367 tempest-AttachVolumeNegativeTest-1423690367-project] 10.222.0.55 "GET /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9" status: 404 len: 111 microversion: 2.1 time: 0.029917 Sep 27 17:37:35.337420 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 551/1123] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:37:35 2022] GET /compute/v2.1/servers/fef20d9a-42bf-4605-bbcb-b673d215a5b9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 17:38:06.749607 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-af23231f-180f-43bb-8566-2639bcc943c5 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:38:06.750196 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-af23231f-180f-43bb-8566-2639bcc943c5 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: 9e6cccab-407e-45f8-9eb3-586fa28cd817] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:38:06.753215 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:38:06.753868 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:38:06.760558 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-af23231f-180f-43bb-8566-2639bcc943c5 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:06.761044 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-af23231f-180f-43bb-8566-2639bcc943c5 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:06.761471 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-af23231f-180f-43bb-8566-2639bcc943c5 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:06.762199 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-af23231f-180f-43bb-8566-2639bcc943c5 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:06.762654 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-af23231f-180f-43bb-8566-2639bcc943c5 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:06.763079 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-af23231f-180f-43bb-8566-2639bcc943c5 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:06.790519 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-af23231f-180f-43bb-8566-2639bcc943c5 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817/ips" status: 200 len: 145 microversion: 2.1 time: 0.044552 Sep 27 17:38:06.791354 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 573/1124] 10.222.0.55 () {58 vars in 1248 bytes} [Tue Sep 27 17:38:06 2022] GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817/ips => generated 145 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:38:09.944661 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-84eb62a7-5a55-437e-b4de-b4229be5cf1b tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d4b3b5f2-7600-4e8c-9a01-3a197ea3a062"}} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:38:09.947023 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-84eb62a7-5a55-437e-b4de-b4229be5cf1b tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: 9e6cccab-407e-45f8-9eb3-586fa28cd817] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:38:09.949202 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=1 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:38:09.950171 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=1 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:38:09.957711 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-84eb62a7-5a55-437e-b4de-b4229be5cf1b tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:09.958321 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-84eb62a7-5a55-437e-b4de-b4229be5cf1b tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:09.958769 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-84eb62a7-5a55-437e-b4de-b4229be5cf1b tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:09.959486 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-84eb62a7-5a55-437e-b4de-b4229be5cf1b tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:09.959943 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-84eb62a7-5a55-437e-b4de-b4229be5cf1b tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:09.960363 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-84eb62a7-5a55-437e-b4de-b4229be5cf1b tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:10.222328 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-84eb62a7-5a55-437e-b4de-b4229be5cf1b tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "POST /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.281555 Sep 27 17:38:10.223120 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 552/1125] 10.222.0.55 () {60 vars in 1323 bytes} [Tue Sep 27 17:38:09 2022] POST /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817/os-volume_attachments => generated 194 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:38:17.777333 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-561bee3f-7f03-48ec-9916-ddfc58627e4f tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:38:17.779325 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_api:SELECT=2 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:38:17.779973 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_cell1:SELECT=4 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:38:17.786097 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-561bee3f-7f03-48ec-9916-ddfc58627e4f tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:17.786600 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-561bee3f-7f03-48ec-9916-ddfc58627e4f tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:17.787037 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-561bee3f-7f03-48ec-9916-ddfc58627e4f tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:17.846467 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-561bee3f-7f03-48ec-9916-ddfc58627e4f tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: 9e6cccab-407e-45f8-9eb3-586fa28cd817] Going to try to stop instance {{(pid=120416) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 27 17:38:17.887994 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-561bee3f-7f03-48ec-9916-ddfc58627e4f tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "POST /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817/action" status: 202 len: 0 microversion: 2.1 time: 0.114487 Sep 27 17:38:17.888577 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 574/1126] 10.222.0.55 () {60 vars in 1278 bytes} [Tue Sep 27 17:38:17 2022] POST /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 17:38:17.897185 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-e0925c27-38c1-4b40-b21d-79a55cf46912 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:38:17.897886 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-e0925c27-38c1-4b40-b21d-79a55cf46912 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: 9e6cccab-407e-45f8-9eb3-586fa28cd817] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:38:17.904573 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e0925c27-38c1-4b40-b21d-79a55cf46912 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:17.905039 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e0925c27-38c1-4b40-b21d-79a55cf46912 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:17.905491 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e0925c27-38c1-4b40-b21d-79a55cf46912 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:17.906183 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e0925c27-38c1-4b40-b21d-79a55cf46912 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:17.907249 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e0925c27-38c1-4b40-b21d-79a55cf46912 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:17.907668 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e0925c27-38c1-4b40-b21d-79a55cf46912 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:18.035900 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-e0925c27-38c1-4b40-b21d-79a55cf46912 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b888fd409954909874b5443cfed2838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd65ea59a6d41219ecf99f5a554056a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:38:18.044311 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-e0925c27-38c1-4b40-b21d-79a55cf46912 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817" status: 200 len: 1724 microversion: 2.1 time: 0.151311 Sep 27 17:38:18.044887 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 553/1127] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:38:17 2022] GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:38:18.312836 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-fa4e0dc3-b0b0-4f0e-a1aa-e43b9ae0ba91 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-728339182", "imageRef": "9355bd92-0a49-42cd-b079-ff9f0d54b91b", "flavorRef": "452", "networks": [{"uuid": "14c6aa25-6905-4b0e-9a62-d48f783a0add"}]}} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:38:18.365160 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.network.neutron [None req-fa4e0dc3-b0b0-4f0e-a1aa-e43b9ae0ba91 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] validate_networks() for [('14c6aa25-6905-4b0e-9a62-d48f783a0add', None, None, None, None, None)] {{(pid=120416) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 17:38:18.714796 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.virt.hardware [None req-fa4e0dc3-b0b0-4f0e-a1aa-e43b9ae0ba91 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Flavor limits 0:0:0 {{(pid=120416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 17:38:18.715222 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.virt.hardware [None req-fa4e0dc3-b0b0-4f0e-a1aa-e43b9ae0ba91 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Image limits 0:0:0 {{(pid=120416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 17:38:18.715700 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.virt.hardware [None req-fa4e0dc3-b0b0-4f0e-a1aa-e43b9ae0ba91 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Flavor pref 0:0:0 {{(pid=120416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 17:38:18.716111 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.virt.hardware [None req-fa4e0dc3-b0b0-4f0e-a1aa-e43b9ae0ba91 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Image pref 0:0:0 {{(pid=120416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 17:38:18.716523 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.virt.hardware [None req-fa4e0dc3-b0b0-4f0e-a1aa-e43b9ae0ba91 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 17:38:18.725285 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-fa4e0dc3-b0b0-4f0e-a1aa-e43b9ae0ba91 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:18.725703 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-fa4e0dc3-b0b0-4f0e-a1aa-e43b9ae0ba91 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:18.726170 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-fa4e0dc3-b0b0-4f0e-a1aa-e43b9ae0ba91 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:18.726893 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-fa4e0dc3-b0b0-4f0e-a1aa-e43b9ae0ba91 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:18.727348 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-fa4e0dc3-b0b0-4f0e-a1aa-e43b9ae0ba91 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:18.727770 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-fa4e0dc3-b0b0-4f0e-a1aa-e43b9ae0ba91 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:18.744557 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.quota [None req-fa4e0dc3-b0b0-4f0e-a1aa-e43b9ae0ba91 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Getting quotas for project 7a5cb427a38643a9b547e710d1c9caf5. Resources: {'cores', 'ram', 'instances'} {{(pid=120416) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 17:38:18.748537 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.quota [None req-fa4e0dc3-b0b0-4f0e-a1aa-e43b9ae0ba91 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Getting quotas for user 53fb0b1bfcb6449089f3162f88145a14 and project 7a5cb427a38643a9b547e710d1c9caf5. Resources: {'cores', 'ram', 'instances'} {{(pid=120416) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 17:38:18.759843 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-fa4e0dc3-b0b0-4f0e-a1aa-e43b9ae0ba91 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Going to run 1 instances... {{(pid=120416) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 17:38:18.762206 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-fa4e0dc3-b0b0-4f0e-a1aa-e43b9ae0ba91 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] [instance: 296ad717-cd38-4ead-a922-79fdf7d5d9b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9355bd92-0a49-42cd-b079-ff9f0d54b91b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120416) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 17:38:18.807664 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-fa4e0dc3-b0b0-4f0e-a1aa-e43b9ae0ba91 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.499023 Sep 27 17:38:18.808406 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 575/1128] 10.222.0.55 () {60 vars in 1147 bytes} [Tue Sep 27 17:38:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 500 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 17:38:18.819847 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-e7720f17-2866-4f29-9d08-1c1d5989c7e5 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:38:18.820480 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-e7720f17-2866-4f29-9d08-1c1d5989c7e5 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] [instance: 296ad717-cd38-4ead-a922-79fdf7d5d9b7] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:38:18.873612 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-e7720f17-2866-4f29-9d08-1c1d5989c7e5 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53fb0b1bfcb6449089f3162f88145a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5cb427a38643a9b547e710d1c9caf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:38:18.881341 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-e7720f17-2866-4f29-9d08-1c1d5989c7e5 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] 10.222.0.55 "GET /compute/v2.1/servers/296ad717-cd38-4ead-a922-79fdf7d5d9b7" status: 200 len: 1213 microversion: 2.1 time: 0.065318 Sep 27 17:38:18.881909 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 554/1129] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:38:18 2022] GET /compute/v2.1/servers/296ad717-cd38-4ead-a922-79fdf7d5d9b7 => generated 1213 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:38:19.068630 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-2b1d0ace-077f-407e-8244-fdbb97593052 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:38:19.069237 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-2b1d0ace-077f-407e-8244-fdbb97593052 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: 9e6cccab-407e-45f8-9eb3-586fa28cd817] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:38:19.075279 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-2b1d0ace-077f-407e-8244-fdbb97593052 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:19.075756 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-2b1d0ace-077f-407e-8244-fdbb97593052 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:19.076181 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-2b1d0ace-077f-407e-8244-fdbb97593052 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:19.077225 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-2b1d0ace-077f-407e-8244-fdbb97593052 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:19.077350 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-2b1d0ace-077f-407e-8244-fdbb97593052 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:19.077713 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-2b1d0ace-077f-407e-8244-fdbb97593052 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:19.210577 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-2b1d0ace-077f-407e-8244-fdbb97593052 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b888fd409954909874b5443cfed2838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd65ea59a6d41219ecf99f5a554056a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:38:19.218734 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-2b1d0ace-077f-407e-8244-fdbb97593052 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817" status: 200 len: 1724 microversion: 2.1 time: 0.153985 Sep 27 17:38:19.219279 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 576/1130] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:38:19 2022] GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:38:19.903876 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-8948b064-2c17-42a8-af49-31e706fcb7fd tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:38:19.904596 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-8948b064-2c17-42a8-af49-31e706fcb7fd tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] [instance: 296ad717-cd38-4ead-a922-79fdf7d5d9b7] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:38:19.912877 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8948b064-2c17-42a8-af49-31e706fcb7fd tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:19.913387 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8948b064-2c17-42a8-af49-31e706fcb7fd tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:19.913848 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8948b064-2c17-42a8-af49-31e706fcb7fd tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:19.914570 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8948b064-2c17-42a8-af49-31e706fcb7fd tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:19.915025 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8948b064-2c17-42a8-af49-31e706fcb7fd tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:19.915478 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8948b064-2c17-42a8-af49-31e706fcb7fd tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:20.002723 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-8948b064-2c17-42a8-af49-31e706fcb7fd tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53fb0b1bfcb6449089f3162f88145a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5cb427a38643a9b547e710d1c9caf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:38:20.010904 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-8948b064-2c17-42a8-af49-31e706fcb7fd tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] 10.222.0.55 "GET /compute/v2.1/servers/296ad717-cd38-4ead-a922-79fdf7d5d9b7" status: 200 len: 1265 microversion: 2.1 time: 0.110946 Sep 27 17:38:20.011675 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 555/1131] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:38:19 2022] GET /compute/v2.1/servers/296ad717-cd38-4ead-a922-79fdf7d5d9b7 => generated 1265 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:38:20.242924 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-6fc4e050-c156-4380-a8d8-c6e80c1a9022 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:38:20.243762 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-6fc4e050-c156-4380-a8d8-c6e80c1a9022 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: 9e6cccab-407e-45f8-9eb3-586fa28cd817] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:38:20.250753 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6fc4e050-c156-4380-a8d8-c6e80c1a9022 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:20.251323 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6fc4e050-c156-4380-a8d8-c6e80c1a9022 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:20.251753 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6fc4e050-c156-4380-a8d8-c6e80c1a9022 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:20.252444 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6fc4e050-c156-4380-a8d8-c6e80c1a9022 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:20.252903 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6fc4e050-c156-4380-a8d8-c6e80c1a9022 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:20.253323 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-6fc4e050-c156-4380-a8d8-c6e80c1a9022 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:20.452747 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-6fc4e050-c156-4380-a8d8-c6e80c1a9022 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b888fd409954909874b5443cfed2838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd65ea59a6d41219ecf99f5a554056a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:38:20.460905 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-6fc4e050-c156-4380-a8d8-c6e80c1a9022 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817" status: 200 len: 1724 microversion: 2.1 time: 0.221905 Sep 27 17:38:20.461468 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 577/1132] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:38:20 2022] GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817 => generated 1724 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:38:21.036278 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-ea8e5f7d-87fe-451f-a8eb-ba28d59d7e8c tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:38:21.036890 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-ea8e5f7d-87fe-451f-a8eb-ba28d59d7e8c tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] [instance: 296ad717-cd38-4ead-a922-79fdf7d5d9b7] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:38:21.043401 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ea8e5f7d-87fe-451f-a8eb-ba28d59d7e8c tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:21.043886 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ea8e5f7d-87fe-451f-a8eb-ba28d59d7e8c tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:21.044338 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ea8e5f7d-87fe-451f-a8eb-ba28d59d7e8c tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:21.045018 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ea8e5f7d-87fe-451f-a8eb-ba28d59d7e8c tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:21.045464 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ea8e5f7d-87fe-451f-a8eb-ba28d59d7e8c tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:21.045885 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ea8e5f7d-87fe-451f-a8eb-ba28d59d7e8c tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:21.257126 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-ea8e5f7d-87fe-451f-a8eb-ba28d59d7e8c tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53fb0b1bfcb6449089f3162f88145a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5cb427a38643a9b547e710d1c9caf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:38:21.264655 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-ea8e5f7d-87fe-451f-a8eb-ba28d59d7e8c tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] 10.222.0.55 "GET /compute/v2.1/servers/296ad717-cd38-4ead-a922-79fdf7d5d9b7" status: 200 len: 1313 microversion: 2.1 time: 0.232274 Sep 27 17:38:21.265218 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 556/1133] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:38:21 2022] GET /compute/v2.1/servers/296ad717-cd38-4ead-a922-79fdf7d5d9b7 => generated 1313 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:38:21.478839 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [req-e43433b7-0519-4d05-9230-f7f730095897 req-365141e5-6a12-49bd-8be6-01c0f7b437e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "296ad717-cd38-4ead-a922-79fdf7d5d9b7", "tag": "d3cc6436-a52e-4206-9b28-8df104ef3a48"}]} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:38:21.485873 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-f7b99cac-7ec9-43c3-b7e1-ae53610e632b tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:38:21.486804 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-f7b99cac-7ec9-43c3-b7e1-ae53610e632b tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: 9e6cccab-407e-45f8-9eb3-586fa28cd817] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:38:21.492515 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-e43433b7-0519-4d05-9230-f7f730095897 req-365141e5-6a12-49bd-8be6-01c0f7b437e0 service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:21.493093 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f7b99cac-7ec9-43c3-b7e1-ae53610e632b tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:21.493529 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-e43433b7-0519-4d05-9230-f7f730095897 req-365141e5-6a12-49bd-8be6-01c0f7b437e0 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:21.493659 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f7b99cac-7ec9-43c3-b7e1-ae53610e632b tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:21.493994 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f7b99cac-7ec9-43c3-b7e1-ae53610e632b tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:21.494522 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-e43433b7-0519-4d05-9230-f7f730095897 req-365141e5-6a12-49bd-8be6-01c0f7b437e0 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:21.494731 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f7b99cac-7ec9-43c3-b7e1-ae53610e632b tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:21.495176 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f7b99cac-7ec9-43c3-b7e1-ae53610e632b tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:21.496073 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f7b99cac-7ec9-43c3-b7e1-ae53610e632b tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:21.509298 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.compute.server_external_events [req-e43433b7-0519-4d05-9230-f7f730095897 req-365141e5-6a12-49bd-8be6-01c0f7b437e0 service nova] Creating event network-changed:d3cc6436-a52e-4206-9b28-8df104ef3a48 for instance 296ad717-cd38-4ead-a922-79fdf7d5d9b7 on hv-cinder-84914 Sep 27 17:38:21.517917 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [req-e43433b7-0519-4d05-9230-f7f730095897 req-365141e5-6a12-49bd-8be6-01c0f7b437e0 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044169 Sep 27 17:38:21.518938 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 578/1134] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:38:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:38:21.632877 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-f7b99cac-7ec9-43c3-b7e1-ae53610e632b tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b888fd409954909874b5443cfed2838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd65ea59a6d41219ecf99f5a554056a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:38:21.641714 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-f7b99cac-7ec9-43c3-b7e1-ae53610e632b tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817" status: 200 len: 1724 microversion: 2.1 time: 0.159073 Sep 27 17:38:21.642252 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 557/1135] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:38:21 2022] GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:38:22.289082 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-2f84bd4b-48e4-4467-9a23-964749b13968 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:38:22.289702 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-2f84bd4b-48e4-4467-9a23-964749b13968 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] [instance: 296ad717-cd38-4ead-a922-79fdf7d5d9b7] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:38:22.295707 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-2f84bd4b-48e4-4467-9a23-964749b13968 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:22.296175 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-2f84bd4b-48e4-4467-9a23-964749b13968 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:22.296599 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-2f84bd4b-48e4-4467-9a23-964749b13968 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:22.297908 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-2f84bd4b-48e4-4467-9a23-964749b13968 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:22.298380 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-2f84bd4b-48e4-4467-9a23-964749b13968 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:22.298798 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-2f84bd4b-48e4-4467-9a23-964749b13968 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:22.495149 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-2f84bd4b-48e4-4467-9a23-964749b13968 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53fb0b1bfcb6449089f3162f88145a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5cb427a38643a9b547e710d1c9caf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:38:22.502962 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-2f84bd4b-48e4-4467-9a23-964749b13968 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] 10.222.0.55 "GET /compute/v2.1/servers/296ad717-cd38-4ead-a922-79fdf7d5d9b7" status: 200 len: 1313 microversion: 2.1 time: 0.218104 Sep 27 17:38:22.503595 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 579/1136] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:38:22 2022] GET /compute/v2.1/servers/296ad717-cd38-4ead-a922-79fdf7d5d9b7 => generated 1313 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:38:22.664643 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-8ba37670-9023-4dff-9e71-0fee42bab419 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:38:22.665288 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-8ba37670-9023-4dff-9e71-0fee42bab419 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: 9e6cccab-407e-45f8-9eb3-586fa28cd817] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:38:22.671654 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8ba37670-9023-4dff-9e71-0fee42bab419 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:22.672134 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8ba37670-9023-4dff-9e71-0fee42bab419 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:22.672567 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8ba37670-9023-4dff-9e71-0fee42bab419 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:22.673253 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8ba37670-9023-4dff-9e71-0fee42bab419 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:22.673703 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8ba37670-9023-4dff-9e71-0fee42bab419 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:22.674151 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8ba37670-9023-4dff-9e71-0fee42bab419 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:22.799116 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-8ba37670-9023-4dff-9e71-0fee42bab419 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b888fd409954909874b5443cfed2838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd65ea59a6d41219ecf99f5a554056a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:38:22.810930 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-8ba37670-9023-4dff-9e71-0fee42bab419 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817" status: 200 len: 1724 microversion: 2.1 time: 0.150154 Sep 27 17:38:22.811505 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 558/1137] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:38:22 2022] GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:38:23.525409 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-02552c8b-873a-41e6-a6a3-a0693c9330c1 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:38:23.525985 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-02552c8b-873a-41e6-a6a3-a0693c9330c1 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] [instance: 296ad717-cd38-4ead-a922-79fdf7d5d9b7] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:38:23.532412 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-02552c8b-873a-41e6-a6a3-a0693c9330c1 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:23.532878 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-02552c8b-873a-41e6-a6a3-a0693c9330c1 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:23.533299 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-02552c8b-873a-41e6-a6a3-a0693c9330c1 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:23.533978 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-02552c8b-873a-41e6-a6a3-a0693c9330c1 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:23.534445 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-02552c8b-873a-41e6-a6a3-a0693c9330c1 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:23.534860 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-02552c8b-873a-41e6-a6a3-a0693c9330c1 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:23.659775 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-02552c8b-873a-41e6-a6a3-a0693c9330c1 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53fb0b1bfcb6449089f3162f88145a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5cb427a38643a9b547e710d1c9caf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:38:23.667275 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-02552c8b-873a-41e6-a6a3-a0693c9330c1 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] 10.222.0.55 "GET /compute/v2.1/servers/296ad717-cd38-4ead-a922-79fdf7d5d9b7" status: 200 len: 1313 microversion: 2.1 time: 0.145755 Sep 27 17:38:23.667828 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 580/1138] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:38:23 2022] GET /compute/v2.1/servers/296ad717-cd38-4ead-a922-79fdf7d5d9b7 => generated 1313 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:38:23.833655 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-e4604f92-a1b6-4790-9db4-ea56a698ec8a tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:38:23.834284 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-e4604f92-a1b6-4790-9db4-ea56a698ec8a tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: 9e6cccab-407e-45f8-9eb3-586fa28cd817] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:38:23.840753 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e4604f92-a1b6-4790-9db4-ea56a698ec8a tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:23.841237 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e4604f92-a1b6-4790-9db4-ea56a698ec8a tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:23.841671 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e4604f92-a1b6-4790-9db4-ea56a698ec8a tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:23.842389 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e4604f92-a1b6-4790-9db4-ea56a698ec8a tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:23.842842 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e4604f92-a1b6-4790-9db4-ea56a698ec8a tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:23.843264 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e4604f92-a1b6-4790-9db4-ea56a698ec8a tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:23.971783 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-e4604f92-a1b6-4790-9db4-ea56a698ec8a tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b888fd409954909874b5443cfed2838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd65ea59a6d41219ecf99f5a554056a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:38:23.979812 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-e4604f92-a1b6-4790-9db4-ea56a698ec8a tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817" status: 200 len: 1724 microversion: 2.1 time: 0.150148 Sep 27 17:38:23.980369 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 559/1139] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:38:23 2022] GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:38:24.690846 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-830d713f-7def-4ca5-a07d-60074bd0c5bc tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:38:24.691458 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-830d713f-7def-4ca5-a07d-60074bd0c5bc tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] [instance: 296ad717-cd38-4ead-a922-79fdf7d5d9b7] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:38:24.697926 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-830d713f-7def-4ca5-a07d-60074bd0c5bc tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:24.698437 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-830d713f-7def-4ca5-a07d-60074bd0c5bc tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:24.698876 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-830d713f-7def-4ca5-a07d-60074bd0c5bc tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:24.699564 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-830d713f-7def-4ca5-a07d-60074bd0c5bc tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:24.700018 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-830d713f-7def-4ca5-a07d-60074bd0c5bc tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:24.700446 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-830d713f-7def-4ca5-a07d-60074bd0c5bc tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:24.824638 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-830d713f-7def-4ca5-a07d-60074bd0c5bc tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53fb0b1bfcb6449089f3162f88145a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5cb427a38643a9b547e710d1c9caf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:38:24.832640 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-830d713f-7def-4ca5-a07d-60074bd0c5bc tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] 10.222.0.55 "GET /compute/v2.1/servers/296ad717-cd38-4ead-a922-79fdf7d5d9b7" status: 200 len: 1313 microversion: 2.1 time: 0.145619 Sep 27 17:38:24.833202 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 581/1140] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:38:24 2022] GET /compute/v2.1/servers/296ad717-cd38-4ead-a922-79fdf7d5d9b7 => generated 1313 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:38:25.003977 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-fd90e225-48b6-48a4-b3c7-57ad92f582c1 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:38:25.004517 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-fd90e225-48b6-48a4-b3c7-57ad92f582c1 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: 9e6cccab-407e-45f8-9eb3-586fa28cd817] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:38:25.010849 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fd90e225-48b6-48a4-b3c7-57ad92f582c1 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:25.011333 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fd90e225-48b6-48a4-b3c7-57ad92f582c1 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:25.011772 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fd90e225-48b6-48a4-b3c7-57ad92f582c1 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:25.012508 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fd90e225-48b6-48a4-b3c7-57ad92f582c1 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:25.012964 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fd90e225-48b6-48a4-b3c7-57ad92f582c1 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:25.013390 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fd90e225-48b6-48a4-b3c7-57ad92f582c1 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:25.236765 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-fd90e225-48b6-48a4-b3c7-57ad92f582c1 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b888fd409954909874b5443cfed2838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd65ea59a6d41219ecf99f5a554056a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:38:25.246607 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-fd90e225-48b6-48a4-b3c7-57ad92f582c1 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817" status: 200 len: 1724 microversion: 2.1 time: 0.246483 Sep 27 17:38:25.251185 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 560/1141] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:38:24 2022] GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817 => generated 1724 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:38:25.855645 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-baf15a8c-44c2-4632-afb3-98c2d6a93ee8 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:38:25.856283 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-baf15a8c-44c2-4632-afb3-98c2d6a93ee8 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] [instance: 296ad717-cd38-4ead-a922-79fdf7d5d9b7] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:38:25.863357 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-baf15a8c-44c2-4632-afb3-98c2d6a93ee8 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:25.863847 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-baf15a8c-44c2-4632-afb3-98c2d6a93ee8 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:25.864249 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-baf15a8c-44c2-4632-afb3-98c2d6a93ee8 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:25.864919 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-baf15a8c-44c2-4632-afb3-98c2d6a93ee8 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:25.865360 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-baf15a8c-44c2-4632-afb3-98c2d6a93ee8 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:25.865772 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-baf15a8c-44c2-4632-afb3-98c2d6a93ee8 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:25.991683 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-baf15a8c-44c2-4632-afb3-98c2d6a93ee8 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53fb0b1bfcb6449089f3162f88145a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5cb427a38643a9b547e710d1c9caf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:38:25.999158 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-baf15a8c-44c2-4632-afb3-98c2d6a93ee8 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] 10.222.0.55 "GET /compute/v2.1/servers/296ad717-cd38-4ead-a922-79fdf7d5d9b7" status: 200 len: 1313 microversion: 2.1 time: 0.147357 Sep 27 17:38:25.999712 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 582/1142] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:38:25 2022] GET /compute/v2.1/servers/296ad717-cd38-4ead-a922-79fdf7d5d9b7 => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:38:26.270916 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-20b620db-8a03-4bc2-abee-df9b43bfbeb4 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:38:26.271550 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-20b620db-8a03-4bc2-abee-df9b43bfbeb4 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: 9e6cccab-407e-45f8-9eb3-586fa28cd817] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:38:26.277880 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-20b620db-8a03-4bc2-abee-df9b43bfbeb4 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:26.278443 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-20b620db-8a03-4bc2-abee-df9b43bfbeb4 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:26.278864 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-20b620db-8a03-4bc2-abee-df9b43bfbeb4 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:26.279554 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-20b620db-8a03-4bc2-abee-df9b43bfbeb4 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:26.280009 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-20b620db-8a03-4bc2-abee-df9b43bfbeb4 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:26.280436 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-20b620db-8a03-4bc2-abee-df9b43bfbeb4 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:26.408296 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-20b620db-8a03-4bc2-abee-df9b43bfbeb4 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b888fd409954909874b5443cfed2838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd65ea59a6d41219ecf99f5a554056a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:38:26.416431 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-20b620db-8a03-4bc2-abee-df9b43bfbeb4 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817" status: 200 len: 1724 microversion: 2.1 time: 0.149517 Sep 27 17:38:26.417003 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 561/1143] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:38:26 2022] GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:38:27.022902 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-fc853e46-0703-4605-9527-4a5cac8b13f1 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:38:27.023508 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-fc853e46-0703-4605-9527-4a5cac8b13f1 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] [instance: 296ad717-cd38-4ead-a922-79fdf7d5d9b7] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:38:27.029894 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-fc853e46-0703-4605-9527-4a5cac8b13f1 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:27.030401 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-fc853e46-0703-4605-9527-4a5cac8b13f1 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:27.030840 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-fc853e46-0703-4605-9527-4a5cac8b13f1 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:27.031520 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-fc853e46-0703-4605-9527-4a5cac8b13f1 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:27.031968 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-fc853e46-0703-4605-9527-4a5cac8b13f1 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:27.032387 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-fc853e46-0703-4605-9527-4a5cac8b13f1 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:27.158329 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-fc853e46-0703-4605-9527-4a5cac8b13f1 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53fb0b1bfcb6449089f3162f88145a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5cb427a38643a9b547e710d1c9caf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:38:27.165979 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-fc853e46-0703-4605-9527-4a5cac8b13f1 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] 10.222.0.55 "GET /compute/v2.1/servers/296ad717-cd38-4ead-a922-79fdf7d5d9b7" status: 200 len: 1313 microversion: 2.1 time: 0.146928 Sep 27 17:38:27.166501 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 583/1144] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:38:27 2022] GET /compute/v2.1/servers/296ad717-cd38-4ead-a922-79fdf7d5d9b7 => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:38:27.440296 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-8dc129c4-5152-4427-ba92-6e9845cefb4d tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:38:27.440842 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-8dc129c4-5152-4427-ba92-6e9845cefb4d tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: 9e6cccab-407e-45f8-9eb3-586fa28cd817] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:38:27.447221 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8dc129c4-5152-4427-ba92-6e9845cefb4d tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:27.447698 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8dc129c4-5152-4427-ba92-6e9845cefb4d tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:27.448128 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8dc129c4-5152-4427-ba92-6e9845cefb4d tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:27.448810 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8dc129c4-5152-4427-ba92-6e9845cefb4d tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:27.449258 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8dc129c4-5152-4427-ba92-6e9845cefb4d tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:27.449677 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8dc129c4-5152-4427-ba92-6e9845cefb4d tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:27.579048 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-8dc129c4-5152-4427-ba92-6e9845cefb4d tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b888fd409954909874b5443cfed2838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd65ea59a6d41219ecf99f5a554056a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:38:27.587140 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-8dc129c4-5152-4427-ba92-6e9845cefb4d tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817" status: 200 len: 1724 microversion: 2.1 time: 0.151496 Sep 27 17:38:27.587140 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 562/1145] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:38:27 2022] GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:38:28.190131 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-f78863df-eb50-4702-94a9-b761835ef575 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:38:28.190751 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-f78863df-eb50-4702-94a9-b761835ef575 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] [instance: 296ad717-cd38-4ead-a922-79fdf7d5d9b7] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:38:28.201678 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f78863df-eb50-4702-94a9-b761835ef575 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:28.202193 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f78863df-eb50-4702-94a9-b761835ef575 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:28.202634 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f78863df-eb50-4702-94a9-b761835ef575 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:28.203330 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f78863df-eb50-4702-94a9-b761835ef575 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:28.203789 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f78863df-eb50-4702-94a9-b761835ef575 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:28.204213 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f78863df-eb50-4702-94a9-b761835ef575 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:28.339365 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-f78863df-eb50-4702-94a9-b761835ef575 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53fb0b1bfcb6449089f3162f88145a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5cb427a38643a9b547e710d1c9caf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:38:28.347493 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-f78863df-eb50-4702-94a9-b761835ef575 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] 10.222.0.55 "GET /compute/v2.1/servers/296ad717-cd38-4ead-a922-79fdf7d5d9b7" status: 200 len: 1313 microversion: 2.1 time: 0.161838 Sep 27 17:38:28.348058 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 584/1146] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:38:28 2022] GET /compute/v2.1/servers/296ad717-cd38-4ead-a922-79fdf7d5d9b7 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:38:28.610825 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-c3977d42-4fb8-4f0d-9fc1-8df8b68b99b7 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:38:28.611437 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-c3977d42-4fb8-4f0d-9fc1-8df8b68b99b7 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: 9e6cccab-407e-45f8-9eb3-586fa28cd817] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:38:28.618013 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c3977d42-4fb8-4f0d-9fc1-8df8b68b99b7 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:28.618529 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c3977d42-4fb8-4f0d-9fc1-8df8b68b99b7 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:28.618959 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c3977d42-4fb8-4f0d-9fc1-8df8b68b99b7 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:28.619681 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c3977d42-4fb8-4f0d-9fc1-8df8b68b99b7 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:28.620101 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c3977d42-4fb8-4f0d-9fc1-8df8b68b99b7 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:28.620520 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c3977d42-4fb8-4f0d-9fc1-8df8b68b99b7 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:28.638151 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [req-376a9979-f053-4476-90e2-ccd72490e3bf req-db6253b3-be32-482d-970d-a7206dcacafc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "296ad717-cd38-4ead-a922-79fdf7d5d9b7", "name": "network-vif-plugged", "status": "completed", "tag": "d3cc6436-a52e-4206-9b28-8df104ef3a48"}]} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:38:28.649664 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-376a9979-f053-4476-90e2-ccd72490e3bf req-db6253b3-be32-482d-970d-a7206dcacafc service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:28.650566 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-376a9979-f053-4476-90e2-ccd72490e3bf req-db6253b3-be32-482d-970d-a7206dcacafc service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:28.651292 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-376a9979-f053-4476-90e2-ccd72490e3bf req-db6253b3-be32-482d-970d-a7206dcacafc service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:28.662929 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.compute.server_external_events [req-376a9979-f053-4476-90e2-ccd72490e3bf req-db6253b3-be32-482d-970d-a7206dcacafc service nova] Creating event network-vif-plugged:d3cc6436-a52e-4206-9b28-8df104ef3a48 for instance 296ad717-cd38-4ead-a922-79fdf7d5d9b7 on hv-cinder-84914 Sep 27 17:38:28.668214 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [req-376a9979-f053-4476-90e2-ccd72490e3bf req-db6253b3-be32-482d-970d-a7206dcacafc service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033955 Sep 27 17:38:28.669114 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 585/1147] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:38:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 17:38:28.758553 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-c3977d42-4fb8-4f0d-9fc1-8df8b68b99b7 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b888fd409954909874b5443cfed2838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd65ea59a6d41219ecf99f5a554056a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:38:28.766959 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-c3977d42-4fb8-4f0d-9fc1-8df8b68b99b7 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817" status: 200 len: 1701 microversion: 2.1 time: 0.160507 Sep 27 17:38:28.767533 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 563/1148] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:38:28 2022] GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817 => generated 1701 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:38:28.786903 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_cell0:SELECT=2 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:38:28.787801 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_cell0:SELECT=6 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:38:28.793663 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-f0757c77-c86f-4e58-bf35-0f95513751be tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:38:28.801411 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f0757c77-c86f-4e58-bf35-0f95513751be tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:28.801895 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f0757c77-c86f-4e58-bf35-0f95513751be tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:28.802385 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f0757c77-c86f-4e58-bf35-0f95513751be tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:28.824086 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-f0757c77-c86f-4e58-bf35-0f95513751be tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: 9e6cccab-407e-45f8-9eb3-586fa28cd817] Going to try to start instance {{(pid=120416) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 27 17:38:28.871299 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-f0757c77-c86f-4e58-bf35-0f95513751be tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "POST /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817/action" status: 202 len: 0 microversion: 2.1 time: 0.085362 Sep 27 17:38:28.871891 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 586/1149] 10.222.0.55 () {60 vars in 1278 bytes} [Tue Sep 27 17:38:28 2022] POST /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 17:38:28.880062 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-cb5e3b37-3d27-4072-b272-cbae1d0b0735 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:38:28.880794 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-cb5e3b37-3d27-4072-b272-cbae1d0b0735 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: 9e6cccab-407e-45f8-9eb3-586fa28cd817] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:38:28.882948 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell0:SELECT=2 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:38:28.888336 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cb5e3b37-3d27-4072-b272-cbae1d0b0735 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:28.888891 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cb5e3b37-3d27-4072-b272-cbae1d0b0735 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:28.889744 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cb5e3b37-3d27-4072-b272-cbae1d0b0735 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:28.890194 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cb5e3b37-3d27-4072-b272-cbae1d0b0735 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:28.891174 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cb5e3b37-3d27-4072-b272-cbae1d0b0735 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:28.891588 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cb5e3b37-3d27-4072-b272-cbae1d0b0735 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:29.024801 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-cb5e3b37-3d27-4072-b272-cbae1d0b0735 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b888fd409954909874b5443cfed2838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd65ea59a6d41219ecf99f5a554056a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:38:29.032906 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-cb5e3b37-3d27-4072-b272-cbae1d0b0735 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817" status: 200 len: 1710 microversion: 2.1 time: 0.156880 Sep 27 17:38:29.033465 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 564/1150] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:38:28 2022] GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817 => generated 1710 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:38:29.371819 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-e6de19cc-9c30-4ccc-aa8c-8a228dc5f893 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:38:29.372514 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-e6de19cc-9c30-4ccc-aa8c-8a228dc5f893 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] [instance: 296ad717-cd38-4ead-a922-79fdf7d5d9b7] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:38:29.379892 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e6de19cc-9c30-4ccc-aa8c-8a228dc5f893 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:29.380367 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e6de19cc-9c30-4ccc-aa8c-8a228dc5f893 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:29.380799 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e6de19cc-9c30-4ccc-aa8c-8a228dc5f893 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:29.381481 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e6de19cc-9c30-4ccc-aa8c-8a228dc5f893 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:29.381925 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e6de19cc-9c30-4ccc-aa8c-8a228dc5f893 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:29.382376 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e6de19cc-9c30-4ccc-aa8c-8a228dc5f893 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:29.511051 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-e6de19cc-9c30-4ccc-aa8c-8a228dc5f893 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53fb0b1bfcb6449089f3162f88145a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5cb427a38643a9b547e710d1c9caf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:38:29.518575 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-e6de19cc-9c30-4ccc-aa8c-8a228dc5f893 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] 10.222.0.55 "GET /compute/v2.1/servers/296ad717-cd38-4ead-a922-79fdf7d5d9b7" status: 200 len: 1313 microversion: 2.1 time: 0.150949 Sep 27 17:38:29.519127 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 587/1151] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:38:29 2022] GET /compute/v2.1/servers/296ad717-cd38-4ead-a922-79fdf7d5d9b7 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:38:30.056511 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-9a6178c0-2a3e-4820-958c-1f310024bf1e tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:38:30.057118 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-9a6178c0-2a3e-4820-958c-1f310024bf1e tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: 9e6cccab-407e-45f8-9eb3-586fa28cd817] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:38:30.063512 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9a6178c0-2a3e-4820-958c-1f310024bf1e tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:30.064003 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9a6178c0-2a3e-4820-958c-1f310024bf1e tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:30.064432 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9a6178c0-2a3e-4820-958c-1f310024bf1e tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:30.065121 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9a6178c0-2a3e-4820-958c-1f310024bf1e tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:30.065574 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9a6178c0-2a3e-4820-958c-1f310024bf1e tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:30.066029 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9a6178c0-2a3e-4820-958c-1f310024bf1e tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:30.193064 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-9a6178c0-2a3e-4820-958c-1f310024bf1e tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b888fd409954909874b5443cfed2838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd65ea59a6d41219ecf99f5a554056a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:38:30.201060 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-9a6178c0-2a3e-4820-958c-1f310024bf1e tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817" status: 200 len: 1710 microversion: 2.1 time: 0.148483 Sep 27 17:38:30.201641 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 565/1152] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:38:30 2022] GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817 => generated 1710 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:38:30.541404 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-f4ab1971-2303-48bd-ada4-dd56b6ce9a51 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:38:30.541945 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-f4ab1971-2303-48bd-ada4-dd56b6ce9a51 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] [instance: 296ad717-cd38-4ead-a922-79fdf7d5d9b7] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:38:30.548246 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f4ab1971-2303-48bd-ada4-dd56b6ce9a51 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:30.548716 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f4ab1971-2303-48bd-ada4-dd56b6ce9a51 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:30.549142 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f4ab1971-2303-48bd-ada4-dd56b6ce9a51 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:30.549817 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f4ab1971-2303-48bd-ada4-dd56b6ce9a51 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:30.550286 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f4ab1971-2303-48bd-ada4-dd56b6ce9a51 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:30.550700 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f4ab1971-2303-48bd-ada4-dd56b6ce9a51 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:30.680342 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-f4ab1971-2303-48bd-ada4-dd56b6ce9a51 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53fb0b1bfcb6449089f3162f88145a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5cb427a38643a9b547e710d1c9caf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:38:30.688568 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-f4ab1971-2303-48bd-ada4-dd56b6ce9a51 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] 10.222.0.55 "GET /compute/v2.1/servers/296ad717-cd38-4ead-a922-79fdf7d5d9b7" status: 200 len: 1313 microversion: 2.1 time: 0.151122 Sep 27 17:38:30.689127 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 588/1153] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:38:30 2022] GET /compute/v2.1/servers/296ad717-cd38-4ead-a922-79fdf7d5d9b7 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:38:31.225729 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-f54e202f-7d79-4d0d-ba30-f1d0b4cf438f tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:38:31.226364 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-f54e202f-7d79-4d0d-ba30-f1d0b4cf438f tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: 9e6cccab-407e-45f8-9eb3-586fa28cd817] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:38:31.232698 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f54e202f-7d79-4d0d-ba30-f1d0b4cf438f tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:31.233172 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f54e202f-7d79-4d0d-ba30-f1d0b4cf438f tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:31.233603 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f54e202f-7d79-4d0d-ba30-f1d0b4cf438f tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:31.234358 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f54e202f-7d79-4d0d-ba30-f1d0b4cf438f tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:31.235370 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f54e202f-7d79-4d0d-ba30-f1d0b4cf438f tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:31.235790 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f54e202f-7d79-4d0d-ba30-f1d0b4cf438f tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:31.363410 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-f54e202f-7d79-4d0d-ba30-f1d0b4cf438f tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b888fd409954909874b5443cfed2838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd65ea59a6d41219ecf99f5a554056a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:38:31.371472 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-f54e202f-7d79-4d0d-ba30-f1d0b4cf438f tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817" status: 200 len: 1710 microversion: 2.1 time: 0.149618 Sep 27 17:38:31.372032 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 566/1154] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:38:31 2022] GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817 => generated 1710 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:38:31.711523 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-cb493953-3ac4-4889-99f4-0329dd550fbc tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:38:31.712138 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-cb493953-3ac4-4889-99f4-0329dd550fbc tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] [instance: 296ad717-cd38-4ead-a922-79fdf7d5d9b7] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:38:31.718547 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-cb493953-3ac4-4889-99f4-0329dd550fbc tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:31.719065 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-cb493953-3ac4-4889-99f4-0329dd550fbc tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:31.719593 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-cb493953-3ac4-4889-99f4-0329dd550fbc tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:31.720357 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-cb493953-3ac4-4889-99f4-0329dd550fbc tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:31.720852 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-cb493953-3ac4-4889-99f4-0329dd550fbc tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:31.721269 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-cb493953-3ac4-4889-99f4-0329dd550fbc tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:31.864275 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-cb493953-3ac4-4889-99f4-0329dd550fbc tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53fb0b1bfcb6449089f3162f88145a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5cb427a38643a9b547e710d1c9caf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:38:31.871865 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-cb493953-3ac4-4889-99f4-0329dd550fbc tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] 10.222.0.55 "GET /compute/v2.1/servers/296ad717-cd38-4ead-a922-79fdf7d5d9b7" status: 200 len: 1496 microversion: 2.1 time: 0.164263 Sep 27 17:38:31.872428 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 589/1155] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:38:31 2022] GET /compute/v2.1/servers/296ad717-cd38-4ead-a922-79fdf7d5d9b7 => generated 1496 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:38:32.336221 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-3253d3f1-372f-4aea-9e0a-f458f0e9cf7f tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:38:32.336725 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-3253d3f1-372f-4aea-9e0a-f458f0e9cf7f tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] [instance: 296ad717-cd38-4ead-a922-79fdf7d5d9b7] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:38:32.343309 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3253d3f1-372f-4aea-9e0a-f458f0e9cf7f tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:32.343794 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3253d3f1-372f-4aea-9e0a-f458f0e9cf7f tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:32.344233 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3253d3f1-372f-4aea-9e0a-f458f0e9cf7f tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:32.344919 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3253d3f1-372f-4aea-9e0a-f458f0e9cf7f tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:32.345369 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3253d3f1-372f-4aea-9e0a-f458f0e9cf7f tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:32.345789 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3253d3f1-372f-4aea-9e0a-f458f0e9cf7f tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:32.371774 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-3253d3f1-372f-4aea-9e0a-f458f0e9cf7f tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] [instance: 296ad717-cd38-4ead-a922-79fdf7d5d9b7] Going to try to terminate instance {{(pid=120415) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 17:38:32.386091 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:38:32.395052 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-29159077-0017-4dfa-a975-dcb50bad4de3 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:38:32.395754 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-29159077-0017-4dfa-a975-dcb50bad4de3 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: 9e6cccab-407e-45f8-9eb3-586fa28cd817] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:38:32.401657 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-29159077-0017-4dfa-a975-dcb50bad4de3 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:32.402268 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-29159077-0017-4dfa-a975-dcb50bad4de3 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:32.402711 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-29159077-0017-4dfa-a975-dcb50bad4de3 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:32.403451 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-29159077-0017-4dfa-a975-dcb50bad4de3 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:32.403910 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-29159077-0017-4dfa-a975-dcb50bad4de3 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:32.404337 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-29159077-0017-4dfa-a975-dcb50bad4de3 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:32.423233 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:38:32.455213 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-3253d3f1-372f-4aea-9e0a-f458f0e9cf7f tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] 10.222.0.55 "DELETE /compute/v2.1/servers/296ad717-cd38-4ead-a922-79fdf7d5d9b7" status: 204 len: 0 microversion: 2.1 time: 0.122571 Sep 27 17:38:32.456580 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 567/1156] 10.222.0.55 () {58 vars in 1239 bytes} [Tue Sep 27 17:38:32 2022] DELETE /compute/v2.1/servers/296ad717-cd38-4ead-a922-79fdf7d5d9b7 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 17:38:32.465283 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-2d1ce3ad-5a40-4c95-896c-9aaa29a53438 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:38:32.465995 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-2d1ce3ad-5a40-4c95-896c-9aaa29a53438 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] [instance: 296ad717-cd38-4ead-a922-79fdf7d5d9b7] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:38:32.471795 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2d1ce3ad-5a40-4c95-896c-9aaa29a53438 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:32.472275 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2d1ce3ad-5a40-4c95-896c-9aaa29a53438 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:32.472712 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2d1ce3ad-5a40-4c95-896c-9aaa29a53438 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:32.473398 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2d1ce3ad-5a40-4c95-896c-9aaa29a53438 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:32.473862 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2d1ce3ad-5a40-4c95-896c-9aaa29a53438 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:32.474307 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2d1ce3ad-5a40-4c95-896c-9aaa29a53438 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:32.574997 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-29159077-0017-4dfa-a975-dcb50bad4de3 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b888fd409954909874b5443cfed2838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd65ea59a6d41219ecf99f5a554056a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:38:32.583286 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-29159077-0017-4dfa-a975-dcb50bad4de3 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817" status: 200 len: 1714 microversion: 2.1 time: 0.192105 Sep 27 17:38:32.583850 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 590/1157] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:38:32 2022] GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817 => generated 1714 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:38:32.621467 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-2d1ce3ad-5a40-4c95-896c-9aaa29a53438 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53fb0b1bfcb6449089f3162f88145a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5cb427a38643a9b547e710d1c9caf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:38:32.629735 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-2d1ce3ad-5a40-4c95-896c-9aaa29a53438 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] 10.222.0.55 "GET /compute/v2.1/servers/296ad717-cd38-4ead-a922-79fdf7d5d9b7" status: 200 len: 1502 microversion: 2.1 time: 0.168751 Sep 27 17:38:32.630336 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 568/1158] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:38:32 2022] GET /compute/v2.1/servers/296ad717-cd38-4ead-a922-79fdf7d5d9b7 => generated 1502 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:38:33.652883 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-07dff892-cadb-4b08-8c4d-fc5b7d59704a tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:38:33.653495 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-07dff892-cadb-4b08-8c4d-fc5b7d59704a tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] [instance: 296ad717-cd38-4ead-a922-79fdf7d5d9b7] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:38:33.659928 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-07dff892-cadb-4b08-8c4d-fc5b7d59704a tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:33.660407 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-07dff892-cadb-4b08-8c4d-fc5b7d59704a tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:33.660840 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-07dff892-cadb-4b08-8c4d-fc5b7d59704a tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:33.661527 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-07dff892-cadb-4b08-8c4d-fc5b7d59704a tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:33.661981 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-07dff892-cadb-4b08-8c4d-fc5b7d59704a tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:33.662439 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-07dff892-cadb-4b08-8c4d-fc5b7d59704a tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:33.791841 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-07dff892-cadb-4b08-8c4d-fc5b7d59704a tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53fb0b1bfcb6449089f3162f88145a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5cb427a38643a9b547e710d1c9caf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:38:33.799996 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-07dff892-cadb-4b08-8c4d-fc5b7d59704a tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] 10.222.0.55 "GET /compute/v2.1/servers/296ad717-cd38-4ead-a922-79fdf7d5d9b7" status: 200 len: 1502 microversion: 2.1 time: 0.151046 Sep 27 17:38:33.800555 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 591/1159] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:38:33 2022] GET /compute/v2.1/servers/296ad717-cd38-4ead-a922-79fdf7d5d9b7 => generated 1502 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:38:34.569403 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [req-188af2fd-ebad-43dd-a45a-b666826ffaec req-d74c53a3-5b21-41f9-aba6-283cd21cb171 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "296ad717-cd38-4ead-a922-79fdf7d5d9b7", "name": "network-vif-deleted", "tag": "d3cc6436-a52e-4206-9b28-8df104ef3a48"}]} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:38:34.579610 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-188af2fd-ebad-43dd-a45a-b666826ffaec req-d74c53a3-5b21-41f9-aba6-283cd21cb171 service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:34.580237 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-188af2fd-ebad-43dd-a45a-b666826ffaec req-d74c53a3-5b21-41f9-aba6-283cd21cb171 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:34.580505 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-188af2fd-ebad-43dd-a45a-b666826ffaec req-d74c53a3-5b21-41f9-aba6-283cd21cb171 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:34.591205 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.compute.server_external_events [req-188af2fd-ebad-43dd-a45a-b666826ffaec req-d74c53a3-5b21-41f9-aba6-283cd21cb171 service nova] Creating event network-vif-deleted:d3cc6436-a52e-4206-9b28-8df104ef3a48 for instance 296ad717-cd38-4ead-a922-79fdf7d5d9b7 on hv-cinder-84914 Sep 27 17:38:34.596729 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [req-188af2fd-ebad-43dd-a45a-b666826ffaec req-d74c53a3-5b21-41f9-aba6-283cd21cb171 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156536 Sep 27 17:38:34.597407 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 569/1160] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:38:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:38:34.823769 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-1c4b11c3-3f44-463b-99eb-edf3a81dcd68 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:38:34.824323 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-1c4b11c3-3f44-463b-99eb-edf3a81dcd68 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] [instance: 296ad717-cd38-4ead-a922-79fdf7d5d9b7] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:38:34.831297 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1c4b11c3-3f44-463b-99eb-edf3a81dcd68 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:34.831775 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1c4b11c3-3f44-463b-99eb-edf3a81dcd68 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:34.832207 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1c4b11c3-3f44-463b-99eb-edf3a81dcd68 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:34.832891 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1c4b11c3-3f44-463b-99eb-edf3a81dcd68 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:34.833346 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1c4b11c3-3f44-463b-99eb-edf3a81dcd68 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:34.833768 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1c4b11c3-3f44-463b-99eb-edf3a81dcd68 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:34.864580 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1c4b11c3-3f44-463b-99eb-edf3a81dcd68 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:34.865055 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1c4b11c3-3f44-463b-99eb-edf3a81dcd68 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:34.865489 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1c4b11c3-3f44-463b-99eb-edf3a81dcd68 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:34.865930 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.objects.instance [None req-1c4b11c3-3f44-463b-99eb-edf3a81dcd68 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lazy-loading 'fault' on Instance uuid 296ad717-cd38-4ead-a922-79fdf7d5d9b7 {{(pid=120416) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 17:38:34.907106 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-1c4b11c3-3f44-463b-99eb-edf3a81dcd68 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53fb0b1bfcb6449089f3162f88145a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5cb427a38643a9b547e710d1c9caf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:38:34.914784 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-1c4b11c3-3f44-463b-99eb-edf3a81dcd68 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] 10.222.0.55 "GET /compute/v2.1/servers/296ad717-cd38-4ead-a922-79fdf7d5d9b7" status: 200 len: 1303 microversion: 2.1 time: 0.095006 Sep 27 17:38:34.915345 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 592/1161] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:38:34 2022] GET /compute/v2.1/servers/296ad717-cd38-4ead-a922-79fdf7d5d9b7 => generated 1303 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:38:35.939806 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-ea40b567-88c5-4a0f-ad1f-a526ffd31ee9 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:38:35.940503 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-ea40b567-88c5-4a0f-ad1f-a526ffd31ee9 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] [instance: 296ad717-cd38-4ead-a922-79fdf7d5d9b7] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:38:35.946808 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ea40b567-88c5-4a0f-ad1f-a526ffd31ee9 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:35.947614 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ea40b567-88c5-4a0f-ad1f-a526ffd31ee9 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:35.948136 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ea40b567-88c5-4a0f-ad1f-a526ffd31ee9 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:35.949183 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ea40b567-88c5-4a0f-ad1f-a526ffd31ee9 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:35.949766 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ea40b567-88c5-4a0f-ad1f-a526ffd31ee9 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:35.950398 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ea40b567-88c5-4a0f-ad1f-a526ffd31ee9 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:35.965917 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.wsgi [None req-ea40b567-88c5-4a0f-ad1f-a526ffd31ee9 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] HTTP exception thrown: Instance 296ad717-cd38-4ead-a922-79fdf7d5d9b7 could not be found. Sep 27 17:38:35.967575 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-ea40b567-88c5-4a0f-ad1f-a526ffd31ee9 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Request method failure captured: Sep 27 17:38:35.967575 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: request: GET /compute/v2.1/servers/296ad717-cd38-4ead-a922-79fdf7d5d9b7 HTTP/1.1 Sep 27 17:38:35.967575 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Accept: application/json Sep 27 17:38:35.967575 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Accept-Encoding: identity Sep 27 17:38:35.967575 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Connection: close Sep 27 17:38:35.967575 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Content-Length: 0 Sep 27 17:38:35.967575 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Content-Type: application/json Sep 27 17:38:35.967575 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Host: 10.222.0.55 Sep 27 17:38:35.967575 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Openstack-System-Scope: None Sep 27 17:38:35.967575 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: User-Agent: python-urllib3/1.26.12 Sep 27 17:38:35.967575 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Auth-Token: gAAAAABjMzUIY7XuLQLxbqudR8cOPlR4nSd_shgUsGB0K7qc-UWdrt0xfxynxWhkoAjaILWSGxs82SSBQmeDPUETUu7v-4DL17Lx-kj9DE4KL9booJ31nnOkY6orH4pck03Q3jL5eq3yNruwn_GWDYavyZh8U39HEhPIjJ35Fxx-n6pLBJWdxbs Sep 27 17:38:35.967575 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Domain-Id: None Sep 27 17:38:35.967575 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Domain-Name: None Sep 27 17:38:35.967575 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Identity-Status: Confirmed Sep 27 17:38:35.967575 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Is-Admin-Project: True Sep 27 17:38:35.967575 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Domain-Id: default Sep 27 17:38:35.967575 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Domain-Name: Default Sep 27 17:38:35.967575 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Id: 7a5cb427a38643a9b547e710d1c9caf5 Sep 27 17:38:35.967575 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Name: tempest-VolumesActionsTest-421484076 Sep 27 17:38:35.967575 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Role: reader,member Sep 27 17:38:35.967575 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Roles: reader,member Sep 27 17:38:35.970056 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/7a5cb427a38643a9b547e710d1c9caf5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_7a5cb427a38643a9b547e710d1c9caf5", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/7a5cb427a38643a9b547e710d1c9caf5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/7a5cb427a38643a9b547e710d1c9caf5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 27 17:38:35.970056 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Tenant: tempest-VolumesActionsTest-421484076 Sep 27 17:38:35.970056 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Tenant-Id: 7a5cb427a38643a9b547e710d1c9caf5 Sep 27 17:38:35.970056 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Tenant-Name: tempest-VolumesActionsTest-421484076 Sep 27 17:38:35.970056 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User: tempest-VolumesActionsTest-421484076-project Sep 27 17:38:35.970056 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Domain-Id: default Sep 27 17:38:35.970056 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Domain-Name: Default Sep 27 17:38:35.970056 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Id: 53fb0b1bfcb6449089f3162f88145a14 Sep 27 17:38:35.970056 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Name: tempest-VolumesActionsTest-421484076-project Sep 27 17:38:35.970056 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: method: > Sep 27 17:38:35.970056 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: exception: Instance 296ad717-cd38-4ead-a922-79fdf7d5d9b7 could not be found. Sep 27 17:38:35.970056 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: action_args: {'id': '296ad717-cd38-4ead-a922-79fdf7d5d9b7'} Sep 27 17:38:35.971635 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 17:38:35.971635 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:38:35.971635 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 17:38:35.971635 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 17:38:35.971635 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 17:38:35.971635 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 17:38:35.971635 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 17:38:35.971635 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 17:38:35.971635 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 17:38:35.971635 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 17:38:35.971635 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 296ad717-cd38-4ead-a922-79fdf7d5d9b7 could not be found. Sep 27 17:38:35.971635 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:38:35.971635 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:38:35.971635 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:38:35.971635 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:38:35.971635 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:38:35.971635 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:38:35.971635 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 17:38:35.971635 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 17:38:35.971635 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 17:38:35.973359 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 17:38:35.973359 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 17:38:35.973359 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 17:38:35.973359 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 17:38:35.973359 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 17:38:35.973359 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 17:38:35.973359 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 17:38:35.973359 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 296ad717-cd38-4ead-a922-79fdf7d5d9b7 could not be found. Sep 27 17:38:35.973359 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:38:35.973359 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:38:35.973359 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:38:35.973359 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:38:35.973359 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:38:35.973359 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:38:35.973359 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 17:38:35.973359 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 17:38:35.973359 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 296ad717-cd38-4ead-a922-79fdf7d5d9b7 could not be found. Sep 27 17:38:35.973359 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:38:35.974924 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-ea40b567-88c5-4a0f-ad1f-a526ffd31ee9 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Returning 404 to user: Instance 296ad717-cd38-4ead-a922-79fdf7d5d9b7 could not be found. {{(pid=120415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 17:38:35.974924 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-ea40b567-88c5-4a0f-ad1f-a526ffd31ee9 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] 10.222.0.55 "GET /compute/v2.1/servers/296ad717-cd38-4ead-a922-79fdf7d5d9b7" status: 404 len: 111 microversion: 2.1 time: 0.033956 Sep 27 17:38:35.974924 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 570/1162] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:38:35 2022] GET /compute/v2.1/servers/296ad717-cd38-4ead-a922-79fdf7d5d9b7 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 17:38:36.019845 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-1cfab0bc-1e2f-4d5d-aa42-b3a570c7cdc7 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1000826819", "imageRef": "9355bd92-0a49-42cd-b079-ff9f0d54b91b", "flavorRef": "452", "networks": [{"uuid": "14c6aa25-6905-4b0e-9a62-d48f783a0add"}]}} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:38:36.071431 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.network.neutron [None req-1cfab0bc-1e2f-4d5d-aa42-b3a570c7cdc7 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] validate_networks() for [('14c6aa25-6905-4b0e-9a62-d48f783a0add', None, None, None, None, None)] {{(pid=120416) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 17:38:36.675331 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.virt.hardware [None req-1cfab0bc-1e2f-4d5d-aa42-b3a570c7cdc7 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Flavor limits 0:0:0 {{(pid=120416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 17:38:36.675747 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.virt.hardware [None req-1cfab0bc-1e2f-4d5d-aa42-b3a570c7cdc7 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Image limits 0:0:0 {{(pid=120416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 17:38:36.676216 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.virt.hardware [None req-1cfab0bc-1e2f-4d5d-aa42-b3a570c7cdc7 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Flavor pref 0:0:0 {{(pid=120416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 17:38:36.676614 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.virt.hardware [None req-1cfab0bc-1e2f-4d5d-aa42-b3a570c7cdc7 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Image pref 0:0:0 {{(pid=120416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 17:38:36.677014 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.virt.hardware [None req-1cfab0bc-1e2f-4d5d-aa42-b3a570c7cdc7 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120416) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 17:38:36.685590 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1cfab0bc-1e2f-4d5d-aa42-b3a570c7cdc7 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:36.686053 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1cfab0bc-1e2f-4d5d-aa42-b3a570c7cdc7 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:36.686501 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1cfab0bc-1e2f-4d5d-aa42-b3a570c7cdc7 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:36.687206 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1cfab0bc-1e2f-4d5d-aa42-b3a570c7cdc7 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:36.688135 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1cfab0bc-1e2f-4d5d-aa42-b3a570c7cdc7 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:36.688546 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1cfab0bc-1e2f-4d5d-aa42-b3a570c7cdc7 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:36.704979 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.quota [None req-1cfab0bc-1e2f-4d5d-aa42-b3a570c7cdc7 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Getting quotas for project 7a5cb427a38643a9b547e710d1c9caf5. Resources: {'cores', 'ram', 'instances'} {{(pid=120416) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 17:38:36.708798 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.quota [None req-1cfab0bc-1e2f-4d5d-aa42-b3a570c7cdc7 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Getting quotas for user 53fb0b1bfcb6449089f3162f88145a14 and project 7a5cb427a38643a9b547e710d1c9caf5. Resources: {'cores', 'ram', 'instances'} {{(pid=120416) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 17:38:36.719239 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-1cfab0bc-1e2f-4d5d-aa42-b3a570c7cdc7 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Going to run 1 instances... {{(pid=120416) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 17:38:36.721452 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-1cfab0bc-1e2f-4d5d-aa42-b3a570c7cdc7 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] [instance: 02249463-4990-45b3-bcce-1ef5ead52916] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9355bd92-0a49-42cd-b079-ff9f0d54b91b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120416) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 17:38:36.766885 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-1cfab0bc-1e2f-4d5d-aa42-b3a570c7cdc7 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.750956 Sep 27 17:38:36.767519 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 593/1163] 10.222.0.55 () {60 vars in 1147 bytes} [Tue Sep 27 17:38:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 752 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 17:38:36.778654 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-0817a3d1-6181-4881-bb4f-079af1a28e50 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:38:36.779381 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-0817a3d1-6181-4881-bb4f-079af1a28e50 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] [instance: 02249463-4990-45b3-bcce-1ef5ead52916] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:38:36.837268 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-0817a3d1-6181-4881-bb4f-079af1a28e50 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53fb0b1bfcb6449089f3162f88145a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5cb427a38643a9b547e710d1c9caf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:38:36.844427 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-0817a3d1-6181-4881-bb4f-079af1a28e50 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] 10.222.0.55 "GET /compute/v2.1/servers/02249463-4990-45b3-bcce-1ef5ead52916" status: 200 len: 1214 microversion: 2.1 time: 0.069680 Sep 27 17:38:36.845001 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 571/1164] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:38:36 2022] GET /compute/v2.1/servers/02249463-4990-45b3-bcce-1ef5ead52916 => generated 1214 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:38:37.868489 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-7d6450a9-5ed7-4af1-9244-8077cb612367 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:38:37.869072 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-7d6450a9-5ed7-4af1-9244-8077cb612367 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] [instance: 02249463-4990-45b3-bcce-1ef5ead52916] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:38:37.874988 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7d6450a9-5ed7-4af1-9244-8077cb612367 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:37.875457 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7d6450a9-5ed7-4af1-9244-8077cb612367 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:37.875880 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7d6450a9-5ed7-4af1-9244-8077cb612367 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:37.876547 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7d6450a9-5ed7-4af1-9244-8077cb612367 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:37.877153 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7d6450a9-5ed7-4af1-9244-8077cb612367 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:37.877570 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7d6450a9-5ed7-4af1-9244-8077cb612367 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:37.942718 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-7d6450a9-5ed7-4af1-9244-8077cb612367 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53fb0b1bfcb6449089f3162f88145a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5cb427a38643a9b547e710d1c9caf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:38:37.950412 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-7d6450a9-5ed7-4af1-9244-8077cb612367 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] 10.222.0.55 "GET /compute/v2.1/servers/02249463-4990-45b3-bcce-1ef5ead52916" status: 200 len: 1274 microversion: 2.1 time: 0.086205 Sep 27 17:38:37.950974 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 594/1165] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:38:37 2022] GET /compute/v2.1/servers/02249463-4990-45b3-bcce-1ef5ead52916 => generated 1274 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:38:38.974382 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-dd084575-6e4c-41dd-843a-e525e52a7729 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:38:38.975002 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-dd084575-6e4c-41dd-843a-e525e52a7729 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] [instance: 02249463-4990-45b3-bcce-1ef5ead52916] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:38:38.982182 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-dd084575-6e4c-41dd-843a-e525e52a7729 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:38.982668 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-dd084575-6e4c-41dd-843a-e525e52a7729 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:38.983102 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-dd084575-6e4c-41dd-843a-e525e52a7729 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:38.983792 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-dd084575-6e4c-41dd-843a-e525e52a7729 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:38.984829 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-dd084575-6e4c-41dd-843a-e525e52a7729 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:38.985247 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-dd084575-6e4c-41dd-843a-e525e52a7729 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:39.112773 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-dd084575-6e4c-41dd-843a-e525e52a7729 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53fb0b1bfcb6449089f3162f88145a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5cb427a38643a9b547e710d1c9caf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:38:39.120308 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-dd084575-6e4c-41dd-843a-e525e52a7729 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] 10.222.0.55 "GET /compute/v2.1/servers/02249463-4990-45b3-bcce-1ef5ead52916" status: 200 len: 1314 microversion: 2.1 time: 0.149860 Sep 27 17:38:39.120876 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 572/1166] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:38:38 2022] GET /compute/v2.1/servers/02249463-4990-45b3-bcce-1ef5ead52916 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:38:39.375918 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [req-b2131dbb-4113-443c-bc15-6dbfda743e01 req-3ff42ba6-11cc-4724-b3bd-0687a68cec1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02249463-4990-45b3-bcce-1ef5ead52916", "tag": "b5fa8549-d7b1-42ee-8634-e4050e0edee8"}]} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:38:39.388260 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-b2131dbb-4113-443c-bc15-6dbfda743e01 req-3ff42ba6-11cc-4724-b3bd-0687a68cec1d service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:39.388743 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-b2131dbb-4113-443c-bc15-6dbfda743e01 req-3ff42ba6-11cc-4724-b3bd-0687a68cec1d service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:39.389173 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-b2131dbb-4113-443c-bc15-6dbfda743e01 req-3ff42ba6-11cc-4724-b3bd-0687a68cec1d service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:39.400438 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.compute.server_external_events [req-b2131dbb-4113-443c-bc15-6dbfda743e01 req-3ff42ba6-11cc-4724-b3bd-0687a68cec1d service nova] Creating event network-changed:b5fa8549-d7b1-42ee-8634-e4050e0edee8 for instance 02249463-4990-45b3-bcce-1ef5ead52916 on hv-cinder-84914 Sep 27 17:38:39.407577 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [req-b2131dbb-4113-443c-bc15-6dbfda743e01 req-3ff42ba6-11cc-4724-b3bd-0687a68cec1d service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035863 Sep 27 17:38:39.408762 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 595/1167] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:38:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 17:38:40.143952 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-429411ec-3820-480a-ab59-f64c9e930056 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:38:40.144596 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-429411ec-3820-480a-ab59-f64c9e930056 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] [instance: 02249463-4990-45b3-bcce-1ef5ead52916] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:38:40.147330 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:38:40.152647 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-429411ec-3820-480a-ab59-f64c9e930056 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:40.153130 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-429411ec-3820-480a-ab59-f64c9e930056 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:40.153568 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-429411ec-3820-480a-ab59-f64c9e930056 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:40.154287 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-429411ec-3820-480a-ab59-f64c9e930056 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:40.154744 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-429411ec-3820-480a-ab59-f64c9e930056 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:40.155171 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-429411ec-3820-480a-ab59-f64c9e930056 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:40.283607 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-429411ec-3820-480a-ab59-f64c9e930056 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53fb0b1bfcb6449089f3162f88145a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5cb427a38643a9b547e710d1c9caf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:38:40.291212 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-429411ec-3820-480a-ab59-f64c9e930056 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] 10.222.0.55 "GET /compute/v2.1/servers/02249463-4990-45b3-bcce-1ef5ead52916" status: 200 len: 1314 microversion: 2.1 time: 0.151145 Sep 27 17:38:40.295629 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 573/1168] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:38:40 2022] GET /compute/v2.1/servers/02249463-4990-45b3-bcce-1ef5ead52916 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:38:41.316407 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-40e86c38-463c-40e5-98fd-47ac08384f8b tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:38:41.317020 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-40e86c38-463c-40e5-98fd-47ac08384f8b tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] [instance: 02249463-4990-45b3-bcce-1ef5ead52916] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:38:41.323570 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-40e86c38-463c-40e5-98fd-47ac08384f8b tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:41.324042 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-40e86c38-463c-40e5-98fd-47ac08384f8b tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:41.324468 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-40e86c38-463c-40e5-98fd-47ac08384f8b tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:41.325146 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-40e86c38-463c-40e5-98fd-47ac08384f8b tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:41.325586 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-40e86c38-463c-40e5-98fd-47ac08384f8b tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:41.326003 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-40e86c38-463c-40e5-98fd-47ac08384f8b tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:41.450454 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-40e86c38-463c-40e5-98fd-47ac08384f8b tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53fb0b1bfcb6449089f3162f88145a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5cb427a38643a9b547e710d1c9caf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:38:41.457979 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-40e86c38-463c-40e5-98fd-47ac08384f8b tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] 10.222.0.55 "GET /compute/v2.1/servers/02249463-4990-45b3-bcce-1ef5ead52916" status: 200 len: 1314 microversion: 2.1 time: 0.146412 Sep 27 17:38:41.458569 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 596/1169] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:38:41 2022] GET /compute/v2.1/servers/02249463-4990-45b3-bcce-1ef5ead52916 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:38:42.480667 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-c94c3143-0b5a-404c-9d1c-bf10a4269945 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:38:42.481279 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-c94c3143-0b5a-404c-9d1c-bf10a4269945 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] [instance: 02249463-4990-45b3-bcce-1ef5ead52916] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:38:42.487989 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c94c3143-0b5a-404c-9d1c-bf10a4269945 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:42.488471 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c94c3143-0b5a-404c-9d1c-bf10a4269945 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:42.488901 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c94c3143-0b5a-404c-9d1c-bf10a4269945 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:42.489620 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c94c3143-0b5a-404c-9d1c-bf10a4269945 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:42.490263 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c94c3143-0b5a-404c-9d1c-bf10a4269945 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:42.490727 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c94c3143-0b5a-404c-9d1c-bf10a4269945 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:42.618698 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-c94c3143-0b5a-404c-9d1c-bf10a4269945 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53fb0b1bfcb6449089f3162f88145a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5cb427a38643a9b547e710d1c9caf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:38:42.626807 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-c94c3143-0b5a-404c-9d1c-bf10a4269945 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] 10.222.0.55 "GET /compute/v2.1/servers/02249463-4990-45b3-bcce-1ef5ead52916" status: 200 len: 1314 microversion: 2.1 time: 0.149980 Sep 27 17:38:42.627367 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 574/1170] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:38:42 2022] GET /compute/v2.1/servers/02249463-4990-45b3-bcce-1ef5ead52916 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:38:43.650415 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-bcd35d1f-6bb5-4800-a6dc-6b8f4ba990d6 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:38:43.651028 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-bcd35d1f-6bb5-4800-a6dc-6b8f4ba990d6 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] [instance: 02249463-4990-45b3-bcce-1ef5ead52916] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:38:43.657986 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-bcd35d1f-6bb5-4800-a6dc-6b8f4ba990d6 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:43.658498 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-bcd35d1f-6bb5-4800-a6dc-6b8f4ba990d6 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:43.658932 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-bcd35d1f-6bb5-4800-a6dc-6b8f4ba990d6 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:43.659617 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-bcd35d1f-6bb5-4800-a6dc-6b8f4ba990d6 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:43.660072 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-bcd35d1f-6bb5-4800-a6dc-6b8f4ba990d6 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:43.660492 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-bcd35d1f-6bb5-4800-a6dc-6b8f4ba990d6 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:43.787983 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-bcd35d1f-6bb5-4800-a6dc-6b8f4ba990d6 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53fb0b1bfcb6449089f3162f88145a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5cb427a38643a9b547e710d1c9caf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:38:43.795556 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-bcd35d1f-6bb5-4800-a6dc-6b8f4ba990d6 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] 10.222.0.55 "GET /compute/v2.1/servers/02249463-4990-45b3-bcce-1ef5ead52916" status: 200 len: 1314 microversion: 2.1 time: 0.149073 Sep 27 17:38:43.796107 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 597/1171] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:38:43 2022] GET /compute/v2.1/servers/02249463-4990-45b3-bcce-1ef5ead52916 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:38:44.817720 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-5c586011-2d47-434f-97e4-d0e13772125a tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:38:44.818352 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-5c586011-2d47-434f-97e4-d0e13772125a tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] [instance: 02249463-4990-45b3-bcce-1ef5ead52916] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:38:44.824791 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5c586011-2d47-434f-97e4-d0e13772125a tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:44.825271 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5c586011-2d47-434f-97e4-d0e13772125a tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:44.825704 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5c586011-2d47-434f-97e4-d0e13772125a tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:44.826422 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5c586011-2d47-434f-97e4-d0e13772125a tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:44.826873 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5c586011-2d47-434f-97e4-d0e13772125a tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:44.827641 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5c586011-2d47-434f-97e4-d0e13772125a tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:44.951217 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-5c586011-2d47-434f-97e4-d0e13772125a tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53fb0b1bfcb6449089f3162f88145a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5cb427a38643a9b547e710d1c9caf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:38:44.958840 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-5c586011-2d47-434f-97e4-d0e13772125a tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] 10.222.0.55 "GET /compute/v2.1/servers/02249463-4990-45b3-bcce-1ef5ead52916" status: 200 len: 1314 microversion: 2.1 time: 0.145049 Sep 27 17:38:44.959411 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 575/1172] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:38:44 2022] GET /compute/v2.1/servers/02249463-4990-45b3-bcce-1ef5ead52916 => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:38:45.982418 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-a8167cec-b0bf-4506-b32b-1dbf2bd64220 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:38:45.983017 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-a8167cec-b0bf-4506-b32b-1dbf2bd64220 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] [instance: 02249463-4990-45b3-bcce-1ef5ead52916] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:38:45.989828 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a8167cec-b0bf-4506-b32b-1dbf2bd64220 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:45.990340 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a8167cec-b0bf-4506-b32b-1dbf2bd64220 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:45.990770 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a8167cec-b0bf-4506-b32b-1dbf2bd64220 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:45.991447 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a8167cec-b0bf-4506-b32b-1dbf2bd64220 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:45.991894 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a8167cec-b0bf-4506-b32b-1dbf2bd64220 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:45.992310 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a8167cec-b0bf-4506-b32b-1dbf2bd64220 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:46.117913 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-a8167cec-b0bf-4506-b32b-1dbf2bd64220 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53fb0b1bfcb6449089f3162f88145a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5cb427a38643a9b547e710d1c9caf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:38:46.125409 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-a8167cec-b0bf-4506-b32b-1dbf2bd64220 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] 10.222.0.55 "GET /compute/v2.1/servers/02249463-4990-45b3-bcce-1ef5ead52916" status: 200 len: 1314 microversion: 2.1 time: 0.146921 Sep 27 17:38:46.125973 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 598/1173] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:38:45 2022] GET /compute/v2.1/servers/02249463-4990-45b3-bcce-1ef5ead52916 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:38:46.716151 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [req-1aea6a71-f459-4d7b-809b-8c02d03eb853 req-419e6662-4ec5-4316-9928-b6e3b1d5a9d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02249463-4990-45b3-bcce-1ef5ead52916", "name": "network-vif-plugged", "status": "completed", "tag": "b5fa8549-d7b1-42ee-8634-e4050e0edee8"}]} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:38:46.731977 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-1aea6a71-f459-4d7b-809b-8c02d03eb853 req-419e6662-4ec5-4316-9928-b6e3b1d5a9d4 service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:46.732469 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-1aea6a71-f459-4d7b-809b-8c02d03eb853 req-419e6662-4ec5-4316-9928-b6e3b1d5a9d4 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:46.732910 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-1aea6a71-f459-4d7b-809b-8c02d03eb853 req-419e6662-4ec5-4316-9928-b6e3b1d5a9d4 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:46.744285 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.compute.server_external_events [req-1aea6a71-f459-4d7b-809b-8c02d03eb853 req-419e6662-4ec5-4316-9928-b6e3b1d5a9d4 service nova] Creating event network-vif-plugged:b5fa8549-d7b1-42ee-8634-e4050e0edee8 for instance 02249463-4990-45b3-bcce-1ef5ead52916 on hv-cinder-84914 Sep 27 17:38:46.749870 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [req-1aea6a71-f459-4d7b-809b-8c02d03eb853 req-419e6662-4ec5-4316-9928-b6e3b1d5a9d4 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037174 Sep 27 17:38:46.750490 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 576/1174] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:38:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:38:47.149176 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-8fb3f46f-4b82-4fd0-a33d-b417fa70d296 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:38:47.149761 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-8fb3f46f-4b82-4fd0-a33d-b417fa70d296 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] [instance: 02249463-4990-45b3-bcce-1ef5ead52916] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:38:47.151697 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_cell0:SELECT=2 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:38:47.152347 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_cell0:SELECT=6 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:38:47.159189 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8fb3f46f-4b82-4fd0-a33d-b417fa70d296 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:47.159666 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8fb3f46f-4b82-4fd0-a33d-b417fa70d296 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:47.160097 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8fb3f46f-4b82-4fd0-a33d-b417fa70d296 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:47.160779 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8fb3f46f-4b82-4fd0-a33d-b417fa70d296 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:47.161237 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8fb3f46f-4b82-4fd0-a33d-b417fa70d296 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:47.161666 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8fb3f46f-4b82-4fd0-a33d-b417fa70d296 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:47.287509 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-8fb3f46f-4b82-4fd0-a33d-b417fa70d296 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53fb0b1bfcb6449089f3162f88145a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5cb427a38643a9b547e710d1c9caf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:38:47.295036 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-8fb3f46f-4b82-4fd0-a33d-b417fa70d296 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] 10.222.0.55 "GET /compute/v2.1/servers/02249463-4990-45b3-bcce-1ef5ead52916" status: 200 len: 1314 microversion: 2.1 time: 0.149798 Sep 27 17:38:47.295594 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 599/1175] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:38:47 2022] GET /compute/v2.1/servers/02249463-4990-45b3-bcce-1ef5ead52916 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:38:48.318711 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-d1917c79-acd9-43e0-b58d-e0dee380b12e tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:38:48.319449 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-d1917c79-acd9-43e0-b58d-e0dee380b12e tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] [instance: 02249463-4990-45b3-bcce-1ef5ead52916] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:38:48.321428 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell0:SELECT=2 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:38:48.327704 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d1917c79-acd9-43e0-b58d-e0dee380b12e tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:48.328209 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d1917c79-acd9-43e0-b58d-e0dee380b12e tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:48.328635 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d1917c79-acd9-43e0-b58d-e0dee380b12e tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:48.329804 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d1917c79-acd9-43e0-b58d-e0dee380b12e tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:48.330285 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d1917c79-acd9-43e0-b58d-e0dee380b12e tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:48.330704 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d1917c79-acd9-43e0-b58d-e0dee380b12e tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:48.460872 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-d1917c79-acd9-43e0-b58d-e0dee380b12e tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53fb0b1bfcb6449089f3162f88145a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5cb427a38643a9b547e710d1c9caf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:38:48.469160 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-d1917c79-acd9-43e0-b58d-e0dee380b12e tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] 10.222.0.55 "GET /compute/v2.1/servers/02249463-4990-45b3-bcce-1ef5ead52916" status: 200 len: 1314 microversion: 2.1 time: 0.154634 Sep 27 17:38:48.470015 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 577/1176] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:38:48 2022] GET /compute/v2.1/servers/02249463-4990-45b3-bcce-1ef5ead52916 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:38:49.492384 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-1028c8b6-aa81-497a-9f05-ca0e63e0e54d tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:38:49.492995 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-1028c8b6-aa81-497a-9f05-ca0e63e0e54d tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] [instance: 02249463-4990-45b3-bcce-1ef5ead52916] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:38:49.495312 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=6 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:38:49.500587 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1028c8b6-aa81-497a-9f05-ca0e63e0e54d tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:49.501068 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1028c8b6-aa81-497a-9f05-ca0e63e0e54d tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:49.501550 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1028c8b6-aa81-497a-9f05-ca0e63e0e54d tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:49.502265 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1028c8b6-aa81-497a-9f05-ca0e63e0e54d tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:49.502715 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1028c8b6-aa81-497a-9f05-ca0e63e0e54d tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:49.503136 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1028c8b6-aa81-497a-9f05-ca0e63e0e54d tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:49.628546 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-1028c8b6-aa81-497a-9f05-ca0e63e0e54d tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53fb0b1bfcb6449089f3162f88145a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5cb427a38643a9b547e710d1c9caf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:38:49.636293 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-1028c8b6-aa81-497a-9f05-ca0e63e0e54d tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] 10.222.0.55 "GET /compute/v2.1/servers/02249463-4990-45b3-bcce-1ef5ead52916" status: 200 len: 1498 microversion: 2.1 time: 0.147794 Sep 27 17:38:49.636861 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 600/1177] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:38:49 2022] GET /compute/v2.1/servers/02249463-4990-45b3-bcce-1ef5ead52916 => generated 1498 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:38:50.155434 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-e28b7f9b-8c16-4785-9c7f-f514dad5453a tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:38:50.155974 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-e28b7f9b-8c16-4785-9c7f-f514dad5453a tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] [instance: 02249463-4990-45b3-bcce-1ef5ead52916] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:38:50.162446 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e28b7f9b-8c16-4785-9c7f-f514dad5453a tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:50.162929 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e28b7f9b-8c16-4785-9c7f-f514dad5453a tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:50.163366 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e28b7f9b-8c16-4785-9c7f-f514dad5453a tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:50.164107 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e28b7f9b-8c16-4785-9c7f-f514dad5453a tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:50.164920 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e28b7f9b-8c16-4785-9c7f-f514dad5453a tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:50.165456 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e28b7f9b-8c16-4785-9c7f-f514dad5453a tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:50.192256 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-e28b7f9b-8c16-4785-9c7f-f514dad5453a tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] [instance: 02249463-4990-45b3-bcce-1ef5ead52916] Going to try to terminate instance {{(pid=120415) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 17:38:50.267460 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-e28b7f9b-8c16-4785-9c7f-f514dad5453a tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] 10.222.0.55 "DELETE /compute/v2.1/servers/02249463-4990-45b3-bcce-1ef5ead52916" status: 204 len: 0 microversion: 2.1 time: 0.115084 Sep 27 17:38:50.268045 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 578/1178] 10.222.0.55 () {58 vars in 1239 bytes} [Tue Sep 27 17:38:50 2022] DELETE /compute/v2.1/servers/02249463-4990-45b3-bcce-1ef5ead52916 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 17:38:50.276551 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-5000f2a3-5faf-45b1-96d0-35acc022e9e9 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:38:50.277166 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-5000f2a3-5faf-45b1-96d0-35acc022e9e9 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] [instance: 02249463-4990-45b3-bcce-1ef5ead52916] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:38:50.283058 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5000f2a3-5faf-45b1-96d0-35acc022e9e9 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:50.283536 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5000f2a3-5faf-45b1-96d0-35acc022e9e9 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:50.283976 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5000f2a3-5faf-45b1-96d0-35acc022e9e9 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:50.284664 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5000f2a3-5faf-45b1-96d0-35acc022e9e9 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:50.285118 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5000f2a3-5faf-45b1-96d0-35acc022e9e9 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:50.285538 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5000f2a3-5faf-45b1-96d0-35acc022e9e9 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:50.412517 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-5000f2a3-5faf-45b1-96d0-35acc022e9e9 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53fb0b1bfcb6449089f3162f88145a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5cb427a38643a9b547e710d1c9caf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:38:50.420105 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-5000f2a3-5faf-45b1-96d0-35acc022e9e9 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] 10.222.0.55 "GET /compute/v2.1/servers/02249463-4990-45b3-bcce-1ef5ead52916" status: 200 len: 1504 microversion: 2.1 time: 0.147533 Sep 27 17:38:50.420683 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 601/1179] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:38:50 2022] GET /compute/v2.1/servers/02249463-4990-45b3-bcce-1ef5ead52916 => generated 1504 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:38:51.444820 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-83c12c8b-0a28-45c9-a877-1e5134bb8a45 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:38:51.445512 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-83c12c8b-0a28-45c9-a877-1e5134bb8a45 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] [instance: 02249463-4990-45b3-bcce-1ef5ead52916] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:38:51.452008 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-83c12c8b-0a28-45c9-a877-1e5134bb8a45 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:51.452490 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-83c12c8b-0a28-45c9-a877-1e5134bb8a45 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:51.452932 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-83c12c8b-0a28-45c9-a877-1e5134bb8a45 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:51.453620 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-83c12c8b-0a28-45c9-a877-1e5134bb8a45 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:51.454089 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-83c12c8b-0a28-45c9-a877-1e5134bb8a45 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:51.455086 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-83c12c8b-0a28-45c9-a877-1e5134bb8a45 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:51.586258 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-83c12c8b-0a28-45c9-a877-1e5134bb8a45 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53fb0b1bfcb6449089f3162f88145a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5cb427a38643a9b547e710d1c9caf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:38:51.593990 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-83c12c8b-0a28-45c9-a877-1e5134bb8a45 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] 10.222.0.55 "GET /compute/v2.1/servers/02249463-4990-45b3-bcce-1ef5ead52916" status: 200 len: 1504 microversion: 2.1 time: 0.153307 Sep 27 17:38:51.594469 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 579/1180] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:38:51 2022] GET /compute/v2.1/servers/02249463-4990-45b3-bcce-1ef5ead52916 => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:38:52.336346 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [req-56d68649-26f0-4a0f-91b2-729e687536f6 req-87711937-b06d-4152-9eb3-00ba9558da4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02249463-4990-45b3-bcce-1ef5ead52916", "name": "network-vif-deleted", "tag": "b5fa8549-d7b1-42ee-8634-e4050e0edee8"}]} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:38:52.349405 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-56d68649-26f0-4a0f-91b2-729e687536f6 req-87711937-b06d-4152-9eb3-00ba9558da4a service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:52.350043 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-56d68649-26f0-4a0f-91b2-729e687536f6 req-87711937-b06d-4152-9eb3-00ba9558da4a service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:52.350508 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-56d68649-26f0-4a0f-91b2-729e687536f6 req-87711937-b06d-4152-9eb3-00ba9558da4a service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:52.363209 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.compute.server_external_events [req-56d68649-26f0-4a0f-91b2-729e687536f6 req-87711937-b06d-4152-9eb3-00ba9558da4a service nova] Creating event network-vif-deleted:b5fa8549-d7b1-42ee-8634-e4050e0edee8 for instance 02249463-4990-45b3-bcce-1ef5ead52916 on hv-cinder-84914 Sep 27 17:38:52.368204 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [req-56d68649-26f0-4a0f-91b2-729e687536f6 req-87711937-b06d-4152-9eb3-00ba9558da4a service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035769 Sep 27 17:38:52.368856 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 602/1181] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:38:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:38:52.618389 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-fe292690-4c27-444b-9ff8-b1951584aac5 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:38:52.618997 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-fe292690-4c27-444b-9ff8-b1951584aac5 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] [instance: 02249463-4990-45b3-bcce-1ef5ead52916] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:38:52.625317 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fe292690-4c27-444b-9ff8-b1951584aac5 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:52.625795 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fe292690-4c27-444b-9ff8-b1951584aac5 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:52.626266 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fe292690-4c27-444b-9ff8-b1951584aac5 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:52.626966 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fe292690-4c27-444b-9ff8-b1951584aac5 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:52.627408 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fe292690-4c27-444b-9ff8-b1951584aac5 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:52.627826 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fe292690-4c27-444b-9ff8-b1951584aac5 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:52.658743 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fe292690-4c27-444b-9ff8-b1951584aac5 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:52.659217 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fe292690-4c27-444b-9ff8-b1951584aac5 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:52.659648 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fe292690-4c27-444b-9ff8-b1951584aac5 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:52.660086 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.objects.instance [None req-fe292690-4c27-444b-9ff8-b1951584aac5 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lazy-loading 'fault' on Instance uuid 02249463-4990-45b3-bcce-1ef5ead52916 {{(pid=120415) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 17:38:52.699093 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-fe292690-4c27-444b-9ff8-b1951584aac5 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53fb0b1bfcb6449089f3162f88145a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a5cb427a38643a9b547e710d1c9caf5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:38:52.707190 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-fe292690-4c27-444b-9ff8-b1951584aac5 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] 10.222.0.55 "GET /compute/v2.1/servers/02249463-4990-45b3-bcce-1ef5ead52916" status: 200 len: 1304 microversion: 2.1 time: 0.092759 Sep 27 17:38:52.707754 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 580/1182] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:38:52 2022] GET /compute/v2.1/servers/02249463-4990-45b3-bcce-1ef5ead52916 => generated 1304 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:38:53.732336 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-5beb124f-1200-4576-b9a6-b4d81d15ee58 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:38:53.733063 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-5beb124f-1200-4576-b9a6-b4d81d15ee58 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] [instance: 02249463-4990-45b3-bcce-1ef5ead52916] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:38:53.740090 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5beb124f-1200-4576-b9a6-b4d81d15ee58 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:53.740569 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5beb124f-1200-4576-b9a6-b4d81d15ee58 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:53.741006 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5beb124f-1200-4576-b9a6-b4d81d15ee58 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:53.741689 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5beb124f-1200-4576-b9a6-b4d81d15ee58 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:38:53.742176 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5beb124f-1200-4576-b9a6-b4d81d15ee58 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:38:53.742602 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5beb124f-1200-4576-b9a6-b4d81d15ee58 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:38:53.755465 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.wsgi [None req-5beb124f-1200-4576-b9a6-b4d81d15ee58 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] HTTP exception thrown: Instance 02249463-4990-45b3-bcce-1ef5ead52916 could not be found. Sep 27 17:38:53.757079 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-5beb124f-1200-4576-b9a6-b4d81d15ee58 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Request method failure captured: Sep 27 17:38:53.757079 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: request: GET /compute/v2.1/servers/02249463-4990-45b3-bcce-1ef5ead52916 HTTP/1.1 Sep 27 17:38:53.757079 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Accept: application/json Sep 27 17:38:53.757079 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Accept-Encoding: identity Sep 27 17:38:53.757079 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Connection: close Sep 27 17:38:53.757079 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Content-Length: 0 Sep 27 17:38:53.757079 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Content-Type: application/json Sep 27 17:38:53.757079 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Host: 10.222.0.55 Sep 27 17:38:53.757079 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Openstack-System-Scope: None Sep 27 17:38:53.757079 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: User-Agent: python-urllib3/1.26.12 Sep 27 17:38:53.757079 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Auth-Token: gAAAAABjMzUIY7XuLQLxbqudR8cOPlR4nSd_shgUsGB0K7qc-UWdrt0xfxynxWhkoAjaILWSGxs82SSBQmeDPUETUu7v-4DL17Lx-kj9DE4KL9booJ31nnOkY6orH4pck03Q3jL5eq3yNruwn_GWDYavyZh8U39HEhPIjJ35Fxx-n6pLBJWdxbs Sep 27 17:38:53.757079 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Domain-Id: None Sep 27 17:38:53.757079 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Domain-Name: None Sep 27 17:38:53.757079 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Identity-Status: Confirmed Sep 27 17:38:53.757079 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Is-Admin-Project: True Sep 27 17:38:53.757079 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Domain-Id: default Sep 27 17:38:53.757079 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Domain-Name: Default Sep 27 17:38:53.757079 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Id: 7a5cb427a38643a9b547e710d1c9caf5 Sep 27 17:38:53.757079 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Name: tempest-VolumesActionsTest-421484076 Sep 27 17:38:53.757079 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Role: reader,member Sep 27 17:38:53.757079 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Roles: reader,member Sep 27 17:38:53.758920 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/7a5cb427a38643a9b547e710d1c9caf5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_7a5cb427a38643a9b547e710d1c9caf5", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/7a5cb427a38643a9b547e710d1c9caf5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/7a5cb427a38643a9b547e710d1c9caf5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 27 17:38:53.758920 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Tenant: tempest-VolumesActionsTest-421484076 Sep 27 17:38:53.758920 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Tenant-Id: 7a5cb427a38643a9b547e710d1c9caf5 Sep 27 17:38:53.758920 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Tenant-Name: tempest-VolumesActionsTest-421484076 Sep 27 17:38:53.758920 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User: tempest-VolumesActionsTest-421484076-project Sep 27 17:38:53.758920 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Domain-Id: default Sep 27 17:38:53.758920 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Domain-Name: Default Sep 27 17:38:53.758920 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Id: 53fb0b1bfcb6449089f3162f88145a14 Sep 27 17:38:53.758920 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Name: tempest-VolumesActionsTest-421484076-project Sep 27 17:38:53.758920 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: method: > Sep 27 17:38:53.758920 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: exception: Instance 02249463-4990-45b3-bcce-1ef5ead52916 could not be found. Sep 27 17:38:53.758920 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: action_args: {'id': '02249463-4990-45b3-bcce-1ef5ead52916'} Sep 27 17:38:53.760081 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 17:38:53.760081 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:38:53.760081 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 17:38:53.760081 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 17:38:53.760081 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 17:38:53.760081 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 17:38:53.760081 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 17:38:53.760081 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 17:38:53.760081 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 17:38:53.760081 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 17:38:53.760081 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02249463-4990-45b3-bcce-1ef5ead52916 could not be found. Sep 27 17:38:53.760081 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:38:53.760081 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:38:53.760081 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:38:53.760081 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:38:53.760081 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:38:53.760081 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:38:53.760081 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 17:38:53.760081 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 17:38:53.760081 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 17:38:53.761694 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 17:38:53.761694 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 17:38:53.761694 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 17:38:53.761694 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 17:38:53.761694 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 17:38:53.761694 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 17:38:53.761694 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 17:38:53.761694 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02249463-4990-45b3-bcce-1ef5ead52916 could not be found. Sep 27 17:38:53.761694 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:38:53.761694 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:38:53.761694 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:38:53.761694 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:38:53.761694 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:38:53.761694 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:38:53.761694 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 17:38:53.761694 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 17:38:53.761694 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02249463-4990-45b3-bcce-1ef5ead52916 could not be found. Sep 27 17:38:53.761694 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:38:53.763295 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-5beb124f-1200-4576-b9a6-b4d81d15ee58 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] Returning 404 to user: Instance 02249463-4990-45b3-bcce-1ef5ead52916 could not be found. {{(pid=120416) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 17:38:53.763295 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-5beb124f-1200-4576-b9a6-b4d81d15ee58 tempest-VolumesActionsTest-421484076 tempest-VolumesActionsTest-421484076-project] 10.222.0.55 "GET /compute/v2.1/servers/02249463-4990-45b3-bcce-1ef5ead52916" status: 404 len: 111 microversion: 2.1 time: 0.030905 Sep 27 17:38:53.763295 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 603/1183] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:38:53 2022] GET /compute/v2.1/servers/02249463-4990-45b3-bcce-1ef5ead52916 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 17:39:05.950311 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-ab987aed-06eb-40b0-a063-2da54120d425 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:39:05.950806 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-ab987aed-06eb-40b0-a063-2da54120d425 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] [instance: 027d6837-5551-4ceb-8905-d16c9a7a382d] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:39:05.959937 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [req-ce5f081f-93ef-4f93-b4e2-fd7aee6597f3 req-1440d42d-2c36-4310-9968-12e93375c0a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "027d6837-5551-4ceb-8905-d16c9a7a382d", "tag": "fc6dbea1-68ea-46ef-8b57-1403451f9deb"}]} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:39:05.961884 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:39:05.962828 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:39:05.964879 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ab987aed-06eb-40b0-a063-2da54120d425 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:39:05.965644 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ab987aed-06eb-40b0-a063-2da54120d425 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:39:05.966854 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ab987aed-06eb-40b0-a063-2da54120d425 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:39:05.968005 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_api:SELECT=7 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:39:05.968867 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_cell1:SELECT=66 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:39:05.969187 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ab987aed-06eb-40b0-a063-2da54120d425 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:39:05.969862 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 27 17:39:05.969999 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Tue Sep 27 17:39:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.55) !!! Sep 27 17:39:05.973374 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ab987aed-06eb-40b0-a063-2da54120d425 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:39:05.974319 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ab987aed-06eb-40b0-a063-2da54120d425 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:39:05.978438 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-ce5f081f-93ef-4f93-b4e2-fd7aee6597f3 req-1440d42d-2c36-4310-9968-12e93375c0a8 service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:39:05.978930 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-ce5f081f-93ef-4f93-b4e2-fd7aee6597f3 req-1440d42d-2c36-4310-9968-12e93375c0a8 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:39:05.979457 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-ce5f081f-93ef-4f93-b4e2-fd7aee6597f3 req-1440d42d-2c36-4310-9968-12e93375c0a8 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:39:06.006740 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.compute.server_external_events [req-ce5f081f-93ef-4f93-b4e2-fd7aee6597f3 req-1440d42d-2c36-4310-9968-12e93375c0a8 service nova] Creating event network-changed:fc6dbea1-68ea-46ef-8b57-1403451f9deb for instance 027d6837-5551-4ceb-8905-d16c9a7a382d on hv-cinder-84914 Sep 27 17:39:06.013530 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [req-ce5f081f-93ef-4f93-b4e2-fd7aee6597f3 req-1440d42d-2c36-4310-9968-12e93375c0a8 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058151 Sep 27 17:39:06.014990 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-ab987aed-06eb-40b0-a063-2da54120d425 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] [instance: 027d6837-5551-4ceb-8905-d16c9a7a382d] Going to try to terminate instance {{(pid=120415) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 17:39:06.018290 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 604/1184] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:39:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:39:06.153153 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-ab987aed-06eb-40b0-a063-2da54120d425 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] 10.222.0.55 "DELETE /compute/v2.1/servers/027d6837-5551-4ceb-8905-d16c9a7a382d" status: 204 len: 0 microversion: 2.1 time: 0.206483 Sep 27 17:39:06.156300 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 581/1185] 10.222.0.55 () {58 vars in 1239 bytes} [Tue Sep 27 17:39:05 2022] DELETE /compute/v2.1/servers/027d6837-5551-4ceb-8905-d16c9a7a382d => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 17:39:06.165333 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-bb3e02f6-1d7f-48f3-bb8a-ed0de6263f62 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:39:06.166195 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-bb3e02f6-1d7f-48f3-bb8a-ed0de6263f62 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] [instance: 027d6837-5551-4ceb-8905-d16c9a7a382d] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:39:06.174208 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-bb3e02f6-1d7f-48f3-bb8a-ed0de6263f62 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:39:06.174870 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-bb3e02f6-1d7f-48f3-bb8a-ed0de6263f62 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:39:06.175422 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-bb3e02f6-1d7f-48f3-bb8a-ed0de6263f62 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:39:06.176246 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-bb3e02f6-1d7f-48f3-bb8a-ed0de6263f62 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:39:06.176823 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-bb3e02f6-1d7f-48f3-bb8a-ed0de6263f62 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:39:06.177930 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-bb3e02f6-1d7f-48f3-bb8a-ed0de6263f62 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:39:06.394694 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-bb3e02f6-1d7f-48f3-bb8a-ed0de6263f62 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac1528c35fb464db00b5d18396b8eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4db1a85e2504cb9956a6461b5072aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:39:06.411182 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-bb3e02f6-1d7f-48f3-bb8a-ed0de6263f62 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] 10.222.0.55 "GET /compute/v2.1/servers/027d6837-5551-4ceb-8905-d16c9a7a382d" status: 200 len: 1579 microversion: 2.1 time: 0.250405 Sep 27 17:39:06.412023 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 605/1186] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:39:06 2022] GET /compute/v2.1/servers/027d6837-5551-4ceb-8905-d16c9a7a382d => generated 1579 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:39:07.435589 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-bc2709da-fbc0-4d1d-8cb8-5ffd92eb9b19 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:39:07.436287 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-bc2709da-fbc0-4d1d-8cb8-5ffd92eb9b19 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] [instance: 027d6837-5551-4ceb-8905-d16c9a7a382d] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:39:07.444191 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-bc2709da-fbc0-4d1d-8cb8-5ffd92eb9b19 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:39:07.444689 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-bc2709da-fbc0-4d1d-8cb8-5ffd92eb9b19 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:39:07.445256 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-bc2709da-fbc0-4d1d-8cb8-5ffd92eb9b19 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:39:07.445965 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-bc2709da-fbc0-4d1d-8cb8-5ffd92eb9b19 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:39:07.446448 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-bc2709da-fbc0-4d1d-8cb8-5ffd92eb9b19 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:39:07.447035 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-bc2709da-fbc0-4d1d-8cb8-5ffd92eb9b19 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:39:07.686452 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-bc2709da-fbc0-4d1d-8cb8-5ffd92eb9b19 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac1528c35fb464db00b5d18396b8eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4db1a85e2504cb9956a6461b5072aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:39:07.700850 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-bc2709da-fbc0-4d1d-8cb8-5ffd92eb9b19 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] 10.222.0.55 "GET /compute/v2.1/servers/027d6837-5551-4ceb-8905-d16c9a7a382d" status: 200 len: 1579 microversion: 2.1 time: 0.269415 Sep 27 17:39:07.701729 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 582/1187] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:39:07 2022] GET /compute/v2.1/servers/027d6837-5551-4ceb-8905-d16c9a7a382d => generated 1579 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:39:08.724784 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-e25effb1-d728-4237-aee4-84c018d0af5e tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:39:08.725391 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-e25effb1-d728-4237-aee4-84c018d0af5e tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] [instance: 027d6837-5551-4ceb-8905-d16c9a7a382d] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:39:08.734599 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e25effb1-d728-4237-aee4-84c018d0af5e tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:39:08.735055 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e25effb1-d728-4237-aee4-84c018d0af5e tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:39:08.735493 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e25effb1-d728-4237-aee4-84c018d0af5e tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:39:08.736773 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e25effb1-d728-4237-aee4-84c018d0af5e tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:39:08.737216 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e25effb1-d728-4237-aee4-84c018d0af5e tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:39:08.737924 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-e25effb1-d728-4237-aee4-84c018d0af5e tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:39:08.808041 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [req-8d076795-0f48-418d-a17a-1ccf855707a3 req-06e910c8-165d-4817-b0f2-f05260fb4709 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "027d6837-5551-4ceb-8905-d16c9a7a382d", "name": "network-vif-deleted", "tag": "fc6dbea1-68ea-46ef-8b57-1403451f9deb"}]} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:39:08.824596 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-8d076795-0f48-418d-a17a-1ccf855707a3 req-06e910c8-165d-4817-b0f2-f05260fb4709 service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:39:08.824596 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-8d076795-0f48-418d-a17a-1ccf855707a3 req-06e910c8-165d-4817-b0f2-f05260fb4709 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:39:08.825736 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-8d076795-0f48-418d-a17a-1ccf855707a3 req-06e910c8-165d-4817-b0f2-f05260fb4709 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:39:08.839628 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-e25effb1-d728-4237-aee4-84c018d0af5e tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac1528c35fb464db00b5d18396b8eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4db1a85e2504cb9956a6461b5072aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:39:08.839846 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.compute.server_external_events [req-8d076795-0f48-418d-a17a-1ccf855707a3 req-06e910c8-165d-4817-b0f2-f05260fb4709 service nova] Creating event network-vif-deleted:fc6dbea1-68ea-46ef-8b57-1403451f9deb for instance 027d6837-5551-4ceb-8905-d16c9a7a382d on hv-cinder-84914 Sep 27 17:39:08.847556 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [req-8d076795-0f48-418d-a17a-1ccf855707a3 req-06e910c8-165d-4817-b0f2-f05260fb4709 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047081 Sep 27 17:39:08.848569 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 583/1188] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:39:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 17:39:08.848928 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-e25effb1-d728-4237-aee4-84c018d0af5e tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] 10.222.0.55 "GET /compute/v2.1/servers/027d6837-5551-4ceb-8905-d16c9a7a382d" status: 200 len: 1393 microversion: 2.1 time: 0.128690 Sep 27 17:39:08.852221 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 606/1189] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:39:08 2022] GET /compute/v2.1/servers/027d6837-5551-4ceb-8905-d16c9a7a382d => generated 1393 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:39:09.878881 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-3f96284e-1428-471d-8ca8-c54922cbf69c tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:39:09.882743 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-3f96284e-1428-471d-8ca8-c54922cbf69c tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] [instance: 027d6837-5551-4ceb-8905-d16c9a7a382d] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:39:09.899160 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3f96284e-1428-471d-8ca8-c54922cbf69c tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:39:09.899651 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3f96284e-1428-471d-8ca8-c54922cbf69c tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:39:09.900082 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3f96284e-1428-471d-8ca8-c54922cbf69c tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:39:09.900781 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3f96284e-1428-471d-8ca8-c54922cbf69c tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:39:09.901231 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3f96284e-1428-471d-8ca8-c54922cbf69c tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:39:09.901651 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3f96284e-1428-471d-8ca8-c54922cbf69c tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:39:09.942417 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3f96284e-1428-471d-8ca8-c54922cbf69c tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:39:09.943044 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3f96284e-1428-471d-8ca8-c54922cbf69c tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:39:09.943732 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3f96284e-1428-471d-8ca8-c54922cbf69c tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:39:09.944530 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.objects.instance [None req-3f96284e-1428-471d-8ca8-c54922cbf69c tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lazy-loading 'fault' on Instance uuid 027d6837-5551-4ceb-8905-d16c9a7a382d {{(pid=120415) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 17:39:09.990345 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-3f96284e-1428-471d-8ca8-c54922cbf69c tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac1528c35fb464db00b5d18396b8eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4db1a85e2504cb9956a6461b5072aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:39:09.997650 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-3f96284e-1428-471d-8ca8-c54922cbf69c tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] 10.222.0.55 "GET /compute/v2.1/servers/027d6837-5551-4ceb-8905-d16c9a7a382d" status: 200 len: 1185 microversion: 2.1 time: 0.125038 Sep 27 17:39:09.999879 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 584/1190] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:39:09 2022] GET /compute/v2.1/servers/027d6837-5551-4ceb-8905-d16c9a7a382d => generated 1185 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:39:11.020940 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-f62e9331-456c-48ba-959c-d1b2c9d1896c tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:39:11.021542 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-f62e9331-456c-48ba-959c-d1b2c9d1896c tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] [instance: 027d6837-5551-4ceb-8905-d16c9a7a382d] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:39:11.028353 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f62e9331-456c-48ba-959c-d1b2c9d1896c tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:39:11.029237 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f62e9331-456c-48ba-959c-d1b2c9d1896c tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:39:11.029682 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f62e9331-456c-48ba-959c-d1b2c9d1896c tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:39:11.030648 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f62e9331-456c-48ba-959c-d1b2c9d1896c tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:39:11.031106 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f62e9331-456c-48ba-959c-d1b2c9d1896c tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:39:11.031702 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-f62e9331-456c-48ba-959c-d1b2c9d1896c tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:39:11.047096 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.wsgi [None req-f62e9331-456c-48ba-959c-d1b2c9d1896c tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] HTTP exception thrown: Instance 027d6837-5551-4ceb-8905-d16c9a7a382d could not be found. Sep 27 17:39:11.049478 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-f62e9331-456c-48ba-959c-d1b2c9d1896c tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Request method failure captured: Sep 27 17:39:11.049478 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: request: GET /compute/v2.1/servers/027d6837-5551-4ceb-8905-d16c9a7a382d HTTP/1.1 Sep 27 17:39:11.049478 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Accept: application/json Sep 27 17:39:11.049478 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Accept-Encoding: identity Sep 27 17:39:11.049478 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Connection: close Sep 27 17:39:11.049478 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Content-Length: 0 Sep 27 17:39:11.049478 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Content-Type: application/json Sep 27 17:39:11.049478 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Host: 10.222.0.55 Sep 27 17:39:11.049478 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Openstack-System-Scope: None Sep 27 17:39:11.049478 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: User-Agent: python-urllib3/1.26.12 Sep 27 17:39:11.049478 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Auth-Token: gAAAAABjMzMb3IJGuOnHL18ffMswjtbpCDabbePv468u2D3CBo2yd4aaE0nsIUEeif3P_ToERDJltgboimC5v9cGICb3GIeISi07JexrWXVTTpMOff8V0tgqT43LbsTQL3UrYAIWBQ3IKRgy8NaHp16upuRTj9reXc_gbYZG2KzKP8xnbiIKHtk Sep 27 17:39:11.049478 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Domain-Id: None Sep 27 17:39:11.049478 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Domain-Name: None Sep 27 17:39:11.049478 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Identity-Status: Confirmed Sep 27 17:39:11.049478 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Is-Admin-Project: True Sep 27 17:39:11.049478 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Domain-Id: default Sep 27 17:39:11.049478 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Domain-Name: Default Sep 27 17:39:11.049478 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Id: f4db1a85e2504cb9956a6461b5072aa3 Sep 27 17:39:11.049478 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Name: tempest-TestVolumeBootPattern-2014823828 Sep 27 17:39:11.049478 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Role: reader,member Sep 27 17:39:11.049478 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Roles: reader,member Sep 27 17:39:11.051350 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f4db1a85e2504cb9956a6461b5072aa3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_f4db1a85e2504cb9956a6461b5072aa3", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f4db1a85e2504cb9956a6461b5072aa3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/f4db1a85e2504cb9956a6461b5072aa3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 27 17:39:11.051350 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Tenant: tempest-TestVolumeBootPattern-2014823828 Sep 27 17:39:11.051350 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Tenant-Id: f4db1a85e2504cb9956a6461b5072aa3 Sep 27 17:39:11.051350 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Tenant-Name: tempest-TestVolumeBootPattern-2014823828 Sep 27 17:39:11.051350 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User: tempest-TestVolumeBootPattern-2014823828-project Sep 27 17:39:11.051350 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Domain-Id: default Sep 27 17:39:11.051350 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Domain-Name: Default Sep 27 17:39:11.051350 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Id: cac1528c35fb464db00b5d18396b8eac Sep 27 17:39:11.051350 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Name: tempest-TestVolumeBootPattern-2014823828-project Sep 27 17:39:11.051350 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: method: > Sep 27 17:39:11.051350 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: exception: Instance 027d6837-5551-4ceb-8905-d16c9a7a382d could not be found. Sep 27 17:39:11.051350 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: action_args: {'id': '027d6837-5551-4ceb-8905-d16c9a7a382d'} Sep 27 17:39:11.052200 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 17:39:11.052200 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:39:11.052200 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 17:39:11.052200 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 17:39:11.052200 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 17:39:11.052200 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 17:39:11.052200 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 17:39:11.052200 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 17:39:11.052200 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 17:39:11.052200 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 17:39:11.052200 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 027d6837-5551-4ceb-8905-d16c9a7a382d could not be found. Sep 27 17:39:11.052200 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:39:11.052200 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:39:11.052200 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:39:11.052200 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:39:11.052200 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:39:11.052200 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:39:11.052200 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 17:39:11.052200 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 17:39:11.052200 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 17:39:11.053542 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 17:39:11.053542 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 17:39:11.053542 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 17:39:11.053542 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 17:39:11.053542 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 17:39:11.053542 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 17:39:11.053542 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 17:39:11.053542 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 027d6837-5551-4ceb-8905-d16c9a7a382d could not be found. Sep 27 17:39:11.053542 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:39:11.053542 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:39:11.053542 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:39:11.053542 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:39:11.053542 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:39:11.053542 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:39:11.053542 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 17:39:11.053542 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 17:39:11.053542 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 027d6837-5551-4ceb-8905-d16c9a7a382d could not be found. Sep 27 17:39:11.053542 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:39:11.054785 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-f62e9331-456c-48ba-959c-d1b2c9d1896c tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Returning 404 to user: Instance 027d6837-5551-4ceb-8905-d16c9a7a382d could not be found. {{(pid=120416) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 17:39:11.054785 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-f62e9331-456c-48ba-959c-d1b2c9d1896c tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] 10.222.0.55 "GET /compute/v2.1/servers/027d6837-5551-4ceb-8905-d16c9a7a382d" status: 404 len: 111 microversion: 2.1 time: 0.033851 Sep 27 17:39:11.054785 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 607/1191] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:39:11 2022] GET /compute/v2.1/servers/027d6837-5551-4ceb-8905-d16c9a7a382d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 17:39:14.311366 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [req-3527127c-a5e0-4062-b443-61d54924d027 req-91936189-c715-48f8-8bb1-8ed8793f2b77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa18e03f-5e59-482d-a5ad-e14cf3bc3f35", "tag": "5fc9c471-e36c-4eea-8fb2-162d705567b5"}]} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:39:14.320904 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-2d2ed41a-4fac-4eb3-9c3f-484577d3efe2 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:39:14.322199 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-2d2ed41a-4fac-4eb3-9c3f-484577d3efe2 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] [instance: aa18e03f-5e59-482d-a5ad-e14cf3bc3f35] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:39:14.330638 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2d2ed41a-4fac-4eb3-9c3f-484577d3efe2 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:39:14.331129 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2d2ed41a-4fac-4eb3-9c3f-484577d3efe2 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:39:14.331668 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-3527127c-a5e0-4062-b443-61d54924d027 req-91936189-c715-48f8-8bb1-8ed8793f2b77 service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:39:14.332662 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2d2ed41a-4fac-4eb3-9c3f-484577d3efe2 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:39:14.333253 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-3527127c-a5e0-4062-b443-61d54924d027 req-91936189-c715-48f8-8bb1-8ed8793f2b77 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:39:14.333693 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-3527127c-a5e0-4062-b443-61d54924d027 req-91936189-c715-48f8-8bb1-8ed8793f2b77 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:39:14.333915 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2d2ed41a-4fac-4eb3-9c3f-484577d3efe2 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:39:14.334559 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2d2ed41a-4fac-4eb3-9c3f-484577d3efe2 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:39:14.335147 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2d2ed41a-4fac-4eb3-9c3f-484577d3efe2 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:39:14.357568 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.compute.server_external_events [req-3527127c-a5e0-4062-b443-61d54924d027 req-91936189-c715-48f8-8bb1-8ed8793f2b77 service nova] Creating event network-changed:5fc9c471-e36c-4eea-8fb2-162d705567b5 for instance aa18e03f-5e59-482d-a5ad-e14cf3bc3f35 on hv-cinder-84914 Sep 27 17:39:14.364821 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [req-3527127c-a5e0-4062-b443-61d54924d027 req-91936189-c715-48f8-8bb1-8ed8793f2b77 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056725 Sep 27 17:39:14.365527 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-2d2ed41a-4fac-4eb3-9c3f-484577d3efe2 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] [instance: aa18e03f-5e59-482d-a5ad-e14cf3bc3f35] Going to try to terminate instance {{(pid=120415) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 17:39:14.367320 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 608/1192] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:39:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 17:39:14.497897 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-2d2ed41a-4fac-4eb3-9c3f-484577d3efe2 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] 10.222.0.55 "DELETE /compute/v2.1/servers/aa18e03f-5e59-482d-a5ad-e14cf3bc3f35" status: 204 len: 0 microversion: 2.1 time: 0.196394 Sep 27 17:39:14.499584 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 585/1193] 10.222.0.55 () {58 vars in 1239 bytes} [Tue Sep 27 17:39:14 2022] DELETE /compute/v2.1/servers/aa18e03f-5e59-482d-a5ad-e14cf3bc3f35 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 17:39:14.508812 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-94bd1822-6390-4884-8cbd-b70efa416210 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:39:14.511174 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-94bd1822-6390-4884-8cbd-b70efa416210 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] [instance: aa18e03f-5e59-482d-a5ad-e14cf3bc3f35] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:39:14.520700 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-94bd1822-6390-4884-8cbd-b70efa416210 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:39:14.523074 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-94bd1822-6390-4884-8cbd-b70efa416210 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:39:14.523847 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-94bd1822-6390-4884-8cbd-b70efa416210 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:39:14.524835 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-94bd1822-6390-4884-8cbd-b70efa416210 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:39:14.525594 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-94bd1822-6390-4884-8cbd-b70efa416210 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:39:14.526340 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-94bd1822-6390-4884-8cbd-b70efa416210 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:39:14.816383 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-94bd1822-6390-4884-8cbd-b70efa416210 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac1528c35fb464db00b5d18396b8eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4db1a85e2504cb9956a6461b5072aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:39:14.827877 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-94bd1822-6390-4884-8cbd-b70efa416210 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] 10.222.0.55 "GET /compute/v2.1/servers/aa18e03f-5e59-482d-a5ad-e14cf3bc3f35" status: 200 len: 1576 microversion: 2.1 time: 0.323735 Sep 27 17:39:14.829180 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 609/1194] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:39:14 2022] GET /compute/v2.1/servers/aa18e03f-5e59-482d-a5ad-e14cf3bc3f35 => generated 1576 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:39:15.852789 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-cc958536-f588-49c7-a1b0-75ff342aa7fe tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:39:15.853483 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-cc958536-f588-49c7-a1b0-75ff342aa7fe tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] [instance: aa18e03f-5e59-482d-a5ad-e14cf3bc3f35] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:39:15.859754 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cc958536-f588-49c7-a1b0-75ff342aa7fe tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:39:15.860240 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cc958536-f588-49c7-a1b0-75ff342aa7fe tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:39:15.860709 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cc958536-f588-49c7-a1b0-75ff342aa7fe tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:39:15.861400 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cc958536-f588-49c7-a1b0-75ff342aa7fe tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:39:15.861844 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cc958536-f588-49c7-a1b0-75ff342aa7fe tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:39:15.862733 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cc958536-f588-49c7-a1b0-75ff342aa7fe tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:39:16.062439 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-cc958536-f588-49c7-a1b0-75ff342aa7fe tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cac1528c35fb464db00b5d18396b8eac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4db1a85e2504cb9956a6461b5072aa3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:39:16.072085 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-cc958536-f588-49c7-a1b0-75ff342aa7fe tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] 10.222.0.55 "GET /compute/v2.1/servers/aa18e03f-5e59-482d-a5ad-e14cf3bc3f35" status: 200 len: 1458 microversion: 2.1 time: 0.223440 Sep 27 17:39:16.086605 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 586/1195] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:39:15 2022] GET /compute/v2.1/servers/aa18e03f-5e59-482d-a5ad-e14cf3bc3f35 => generated 1458 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:39:16.381459 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [req-2b25d65e-4d42-4a14-8922-5b9184143670 req-4c59f099-3829-4cb2-bb23-5971273ec475 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa18e03f-5e59-482d-a5ad-e14cf3bc3f35", "name": "network-vif-deleted", "tag": "5fc9c471-e36c-4eea-8fb2-162d705567b5"}]} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:39:16.391447 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-2b25d65e-4d42-4a14-8922-5b9184143670 req-4c59f099-3829-4cb2-bb23-5971273ec475 service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:39:16.391913 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-2b25d65e-4d42-4a14-8922-5b9184143670 req-4c59f099-3829-4cb2-bb23-5971273ec475 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:39:16.392510 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-2b25d65e-4d42-4a14-8922-5b9184143670 req-4c59f099-3829-4cb2-bb23-5971273ec475 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:39:16.404807 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.compute.server_external_events [req-2b25d65e-4d42-4a14-8922-5b9184143670 req-4c59f099-3829-4cb2-bb23-5971273ec475 service nova] Creating event network-vif-deleted:5fc9c471-e36c-4eea-8fb2-162d705567b5 for instance aa18e03f-5e59-482d-a5ad-e14cf3bc3f35 on hv-cinder-84914 Sep 27 17:39:16.409779 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [req-2b25d65e-4d42-4a14-8922-5b9184143670 req-4c59f099-3829-4cb2-bb23-5971273ec475 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032699 Sep 27 17:39:16.411000 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 610/1196] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:39:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:39:17.096723 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-0cfffa50-7917-4dec-836e-faec1244d1bf tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:39:17.097342 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-0cfffa50-7917-4dec-836e-faec1244d1bf tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] [instance: aa18e03f-5e59-482d-a5ad-e14cf3bc3f35] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:39:17.104143 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0cfffa50-7917-4dec-836e-faec1244d1bf tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:39:17.104743 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0cfffa50-7917-4dec-836e-faec1244d1bf tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:39:17.105237 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0cfffa50-7917-4dec-836e-faec1244d1bf tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:39:17.105952 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0cfffa50-7917-4dec-836e-faec1244d1bf tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:39:17.106446 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0cfffa50-7917-4dec-836e-faec1244d1bf tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:39:17.106874 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0cfffa50-7917-4dec-836e-faec1244d1bf tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:39:17.120759 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.wsgi [None req-0cfffa50-7917-4dec-836e-faec1244d1bf tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] HTTP exception thrown: Instance aa18e03f-5e59-482d-a5ad-e14cf3bc3f35 could not be found. Sep 27 17:39:17.122429 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-0cfffa50-7917-4dec-836e-faec1244d1bf tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Request method failure captured: Sep 27 17:39:17.122429 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: request: GET /compute/v2.1/servers/aa18e03f-5e59-482d-a5ad-e14cf3bc3f35 HTTP/1.1 Sep 27 17:39:17.122429 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Accept: application/json Sep 27 17:39:17.122429 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Accept-Encoding: identity Sep 27 17:39:17.122429 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Connection: close Sep 27 17:39:17.122429 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Content-Length: 0 Sep 27 17:39:17.122429 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Content-Type: application/json Sep 27 17:39:17.122429 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Host: 10.222.0.55 Sep 27 17:39:17.122429 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Openstack-System-Scope: None Sep 27 17:39:17.122429 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: User-Agent: python-urllib3/1.26.12 Sep 27 17:39:17.122429 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Auth-Token: gAAAAABjMzMb3IJGuOnHL18ffMswjtbpCDabbePv468u2D3CBo2yd4aaE0nsIUEeif3P_ToERDJltgboimC5v9cGICb3GIeISi07JexrWXVTTpMOff8V0tgqT43LbsTQL3UrYAIWBQ3IKRgy8NaHp16upuRTj9reXc_gbYZG2KzKP8xnbiIKHtk Sep 27 17:39:17.122429 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Domain-Id: None Sep 27 17:39:17.122429 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Domain-Name: None Sep 27 17:39:17.122429 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Identity-Status: Confirmed Sep 27 17:39:17.122429 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Is-Admin-Project: True Sep 27 17:39:17.122429 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Domain-Id: default Sep 27 17:39:17.122429 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Domain-Name: Default Sep 27 17:39:17.122429 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Id: f4db1a85e2504cb9956a6461b5072aa3 Sep 27 17:39:17.122429 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Name: tempest-TestVolumeBootPattern-2014823828 Sep 27 17:39:17.122429 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Role: reader,member Sep 27 17:39:17.122429 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Roles: reader,member Sep 27 17:39:17.124238 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f4db1a85e2504cb9956a6461b5072aa3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_f4db1a85e2504cb9956a6461b5072aa3", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f4db1a85e2504cb9956a6461b5072aa3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/f4db1a85e2504cb9956a6461b5072aa3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 27 17:39:17.124238 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Tenant: tempest-TestVolumeBootPattern-2014823828 Sep 27 17:39:17.124238 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Tenant-Id: f4db1a85e2504cb9956a6461b5072aa3 Sep 27 17:39:17.124238 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Tenant-Name: tempest-TestVolumeBootPattern-2014823828 Sep 27 17:39:17.124238 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User: tempest-TestVolumeBootPattern-2014823828-project Sep 27 17:39:17.124238 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Domain-Id: default Sep 27 17:39:17.124238 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Domain-Name: Default Sep 27 17:39:17.124238 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Id: cac1528c35fb464db00b5d18396b8eac Sep 27 17:39:17.124238 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Name: tempest-TestVolumeBootPattern-2014823828-project Sep 27 17:39:17.124238 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: method: > Sep 27 17:39:17.124238 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: exception: Instance aa18e03f-5e59-482d-a5ad-e14cf3bc3f35 could not be found. Sep 27 17:39:17.124238 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: action_args: {'id': 'aa18e03f-5e59-482d-a5ad-e14cf3bc3f35'} Sep 27 17:39:17.125350 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 17:39:17.125350 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:39:17.125350 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 17:39:17.125350 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 17:39:17.125350 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 17:39:17.125350 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 17:39:17.125350 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 17:39:17.125350 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 17:39:17.125350 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 17:39:17.125350 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 17:39:17.125350 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa18e03f-5e59-482d-a5ad-e14cf3bc3f35 could not be found. Sep 27 17:39:17.125350 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:39:17.125350 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:39:17.125350 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:39:17.125350 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:39:17.125350 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:39:17.125350 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:39:17.125350 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 17:39:17.125350 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 17:39:17.125350 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 17:39:17.127215 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 17:39:17.127215 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 17:39:17.127215 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 17:39:17.127215 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 17:39:17.127215 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 17:39:17.127215 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 17:39:17.127215 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 17:39:17.127215 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa18e03f-5e59-482d-a5ad-e14cf3bc3f35 could not be found. Sep 27 17:39:17.127215 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:39:17.127215 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:39:17.127215 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:39:17.127215 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:39:17.127215 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:39:17.127215 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:39:17.127215 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 17:39:17.127215 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 17:39:17.127215 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa18e03f-5e59-482d-a5ad-e14cf3bc3f35 could not be found. Sep 27 17:39:17.127215 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:39:17.128958 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-0cfffa50-7917-4dec-836e-faec1244d1bf tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Returning 404 to user: Instance aa18e03f-5e59-482d-a5ad-e14cf3bc3f35 could not be found. {{(pid=120415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 17:39:17.128958 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-0cfffa50-7917-4dec-836e-faec1244d1bf tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] 10.222.0.55 "GET /compute/v2.1/servers/aa18e03f-5e59-482d-a5ad-e14cf3bc3f35" status: 404 len: 111 microversion: 2.1 time: 0.031489 Sep 27 17:39:17.128958 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 587/1197] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:39:17 2022] GET /compute/v2.1/servers/aa18e03f-5e59-482d-a5ad-e14cf3bc3f35 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 17:39:17.558915 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-1de8e8bd-66b9-423a-88be-4e7d7397c1a1 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:39:17.559496 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-1de8e8bd-66b9-423a-88be-4e7d7397c1a1 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] [instance: 40e2eab1-2d75-4ad4-9e7b-da70094ed345] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:39:17.566665 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1de8e8bd-66b9-423a-88be-4e7d7397c1a1 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:39:17.567144 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1de8e8bd-66b9-423a-88be-4e7d7397c1a1 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:39:17.567578 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1de8e8bd-66b9-423a-88be-4e7d7397c1a1 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:39:17.568262 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1de8e8bd-66b9-423a-88be-4e7d7397c1a1 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:39:17.568716 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1de8e8bd-66b9-423a-88be-4e7d7397c1a1 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:39:17.569132 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1de8e8bd-66b9-423a-88be-4e7d7397c1a1 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:39:17.582452 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.wsgi [None req-1de8e8bd-66b9-423a-88be-4e7d7397c1a1 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] HTTP exception thrown: Instance 40e2eab1-2d75-4ad4-9e7b-da70094ed345 could not be found. Sep 27 17:39:17.584112 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-1de8e8bd-66b9-423a-88be-4e7d7397c1a1 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Request method failure captured: Sep 27 17:39:17.584112 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: request: DELETE /compute/v2.1/servers/40e2eab1-2d75-4ad4-9e7b-da70094ed345 HTTP/1.1 Sep 27 17:39:17.584112 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Accept: application/json Sep 27 17:39:17.584112 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Accept-Encoding: identity Sep 27 17:39:17.584112 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Connection: close Sep 27 17:39:17.584112 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Content-Length: 0 Sep 27 17:39:17.584112 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Content-Type: application/json Sep 27 17:39:17.584112 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Host: 10.222.0.55 Sep 27 17:39:17.584112 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Openstack-System-Scope: None Sep 27 17:39:17.584112 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: User-Agent: python-urllib3/1.26.12 Sep 27 17:39:17.584112 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Auth-Token: gAAAAABjMzMb3IJGuOnHL18ffMswjtbpCDabbePv468u2D3CBo2yd4aaE0nsIUEeif3P_ToERDJltgboimC5v9cGICb3GIeISi07JexrWXVTTpMOff8V0tgqT43LbsTQL3UrYAIWBQ3IKRgy8NaHp16upuRTj9reXc_gbYZG2KzKP8xnbiIKHtk Sep 27 17:39:17.584112 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Domain-Id: None Sep 27 17:39:17.584112 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Domain-Name: None Sep 27 17:39:17.584112 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Identity-Status: Confirmed Sep 27 17:39:17.584112 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Is-Admin-Project: True Sep 27 17:39:17.584112 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Domain-Id: default Sep 27 17:39:17.584112 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Domain-Name: Default Sep 27 17:39:17.584112 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Id: f4db1a85e2504cb9956a6461b5072aa3 Sep 27 17:39:17.584112 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Name: tempest-TestVolumeBootPattern-2014823828 Sep 27 17:39:17.584112 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Role: reader,member Sep 27 17:39:17.584112 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Roles: reader,member Sep 27 17:39:17.585925 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f4db1a85e2504cb9956a6461b5072aa3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_f4db1a85e2504cb9956a6461b5072aa3", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f4db1a85e2504cb9956a6461b5072aa3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/f4db1a85e2504cb9956a6461b5072aa3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 27 17:39:17.585925 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Tenant: tempest-TestVolumeBootPattern-2014823828 Sep 27 17:39:17.585925 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Tenant-Id: f4db1a85e2504cb9956a6461b5072aa3 Sep 27 17:39:17.585925 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Tenant-Name: tempest-TestVolumeBootPattern-2014823828 Sep 27 17:39:17.585925 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User: tempest-TestVolumeBootPattern-2014823828-project Sep 27 17:39:17.585925 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Domain-Id: default Sep 27 17:39:17.585925 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Domain-Name: Default Sep 27 17:39:17.585925 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Id: cac1528c35fb464db00b5d18396b8eac Sep 27 17:39:17.585925 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Name: tempest-TestVolumeBootPattern-2014823828-project Sep 27 17:39:17.585925 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: method: > Sep 27 17:39:17.585925 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: exception: Instance 40e2eab1-2d75-4ad4-9e7b-da70094ed345 could not be found. Sep 27 17:39:17.585925 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: action_args: {'id': '40e2eab1-2d75-4ad4-9e7b-da70094ed345'} Sep 27 17:39:17.586865 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 17:39:17.586865 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:39:17.586865 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 17:39:17.586865 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 17:39:17.586865 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 17:39:17.586865 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 17:39:17.586865 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 17:39:17.586865 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 17:39:17.586865 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 17:39:17.586865 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 17:39:17.586865 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40e2eab1-2d75-4ad4-9e7b-da70094ed345 could not be found. Sep 27 17:39:17.586865 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:39:17.586865 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:39:17.586865 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:39:17.586865 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:39:17.586865 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:39:17.586865 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:39:17.586865 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 17:39:17.586865 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 17:39:17.586865 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 17:39:17.588313 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 17:39:17.588313 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 27 17:39:17.588313 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 27 17:39:17.588313 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 27 17:39:17.588313 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 27 17:39:17.588313 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 17:39:17.588313 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 17:39:17.588313 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 17:39:17.588313 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 17:39:17.588313 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40e2eab1-2d75-4ad4-9e7b-da70094ed345 could not be found. Sep 27 17:39:17.588313 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:39:17.588313 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:39:17.588313 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:39:17.588313 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:39:17.588313 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:39:17.588313 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:39:17.588313 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 17:39:17.588313 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 17:39:17.588313 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40e2eab1-2d75-4ad4-9e7b-da70094ed345 could not be found. Sep 27 17:39:17.588313 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:39:17.589857 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-1de8e8bd-66b9-423a-88be-4e7d7397c1a1 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Returning 404 to user: Instance 40e2eab1-2d75-4ad4-9e7b-da70094ed345 could not be found. {{(pid=120416) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 17:39:17.589857 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-1de8e8bd-66b9-423a-88be-4e7d7397c1a1 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] 10.222.0.55 "DELETE /compute/v2.1/servers/40e2eab1-2d75-4ad4-9e7b-da70094ed345" status: 404 len: 111 microversion: 2.1 time: 0.030832 Sep 27 17:39:17.589857 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 611/1198] 10.222.0.55 () {58 vars in 1239 bytes} [Tue Sep 27 17:39:17 2022] DELETE /compute/v2.1/servers/40e2eab1-2d75-4ad4-9e7b-da70094ed345 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 17:39:17.594111 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-931b0d10-5c89-4f91-bf62-ea10504dc5a5 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:39:17.594719 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-931b0d10-5c89-4f91-bf62-ea10504dc5a5 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] [instance: 40e2eab1-2d75-4ad4-9e7b-da70094ed345] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:39:17.601095 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-931b0d10-5c89-4f91-bf62-ea10504dc5a5 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:39:17.601579 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-931b0d10-5c89-4f91-bf62-ea10504dc5a5 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:39:17.602010 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-931b0d10-5c89-4f91-bf62-ea10504dc5a5 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:39:17.602723 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-931b0d10-5c89-4f91-bf62-ea10504dc5a5 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:39:17.603178 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-931b0d10-5c89-4f91-bf62-ea10504dc5a5 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:39:17.603601 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-931b0d10-5c89-4f91-bf62-ea10504dc5a5 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:39:17.617537 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.wsgi [None req-931b0d10-5c89-4f91-bf62-ea10504dc5a5 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] HTTP exception thrown: Instance 40e2eab1-2d75-4ad4-9e7b-da70094ed345 could not be found. Sep 27 17:39:17.619060 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-931b0d10-5c89-4f91-bf62-ea10504dc5a5 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Request method failure captured: Sep 27 17:39:17.619060 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: request: GET /compute/v2.1/servers/40e2eab1-2d75-4ad4-9e7b-da70094ed345 HTTP/1.1 Sep 27 17:39:17.619060 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Accept: application/json Sep 27 17:39:17.619060 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Accept-Encoding: identity Sep 27 17:39:17.619060 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Connection: close Sep 27 17:39:17.619060 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Content-Length: 0 Sep 27 17:39:17.619060 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Content-Type: application/json Sep 27 17:39:17.619060 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Host: 10.222.0.55 Sep 27 17:39:17.619060 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Openstack-System-Scope: None Sep 27 17:39:17.619060 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: User-Agent: python-urllib3/1.26.12 Sep 27 17:39:17.619060 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Auth-Token: gAAAAABjMzMb3IJGuOnHL18ffMswjtbpCDabbePv468u2D3CBo2yd4aaE0nsIUEeif3P_ToERDJltgboimC5v9cGICb3GIeISi07JexrWXVTTpMOff8V0tgqT43LbsTQL3UrYAIWBQ3IKRgy8NaHp16upuRTj9reXc_gbYZG2KzKP8xnbiIKHtk Sep 27 17:39:17.619060 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Domain-Id: None Sep 27 17:39:17.619060 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Domain-Name: None Sep 27 17:39:17.619060 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Identity-Status: Confirmed Sep 27 17:39:17.619060 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Is-Admin-Project: True Sep 27 17:39:17.619060 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Domain-Id: default Sep 27 17:39:17.619060 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Domain-Name: Default Sep 27 17:39:17.619060 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Id: f4db1a85e2504cb9956a6461b5072aa3 Sep 27 17:39:17.619060 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Name: tempest-TestVolumeBootPattern-2014823828 Sep 27 17:39:17.619060 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Role: reader,member Sep 27 17:39:17.619060 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Roles: reader,member Sep 27 17:39:17.620803 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f4db1a85e2504cb9956a6461b5072aa3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_f4db1a85e2504cb9956a6461b5072aa3", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f4db1a85e2504cb9956a6461b5072aa3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/f4db1a85e2504cb9956a6461b5072aa3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 27 17:39:17.620803 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Tenant: tempest-TestVolumeBootPattern-2014823828 Sep 27 17:39:17.620803 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Tenant-Id: f4db1a85e2504cb9956a6461b5072aa3 Sep 27 17:39:17.620803 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Tenant-Name: tempest-TestVolumeBootPattern-2014823828 Sep 27 17:39:17.620803 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User: tempest-TestVolumeBootPattern-2014823828-project Sep 27 17:39:17.620803 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Domain-Id: default Sep 27 17:39:17.620803 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Domain-Name: Default Sep 27 17:39:17.620803 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Id: cac1528c35fb464db00b5d18396b8eac Sep 27 17:39:17.620803 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Name: tempest-TestVolumeBootPattern-2014823828-project Sep 27 17:39:17.620803 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: method: > Sep 27 17:39:17.620803 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: exception: Instance 40e2eab1-2d75-4ad4-9e7b-da70094ed345 could not be found. Sep 27 17:39:17.620803 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: action_args: {'id': '40e2eab1-2d75-4ad4-9e7b-da70094ed345'} Sep 27 17:39:17.621810 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 17:39:17.621810 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:39:17.621810 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 17:39:17.621810 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 17:39:17.621810 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 17:39:17.621810 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 17:39:17.621810 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 17:39:17.621810 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 17:39:17.621810 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 17:39:17.621810 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 17:39:17.621810 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40e2eab1-2d75-4ad4-9e7b-da70094ed345 could not be found. Sep 27 17:39:17.621810 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:39:17.621810 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:39:17.621810 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:39:17.621810 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:39:17.621810 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:39:17.621810 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:39:17.621810 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 17:39:17.621810 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 17:39:17.621810 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 17:39:17.623444 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 17:39:17.623444 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 17:39:17.623444 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 17:39:17.623444 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 17:39:17.623444 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 17:39:17.623444 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 17:39:17.623444 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 17:39:17.623444 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40e2eab1-2d75-4ad4-9e7b-da70094ed345 could not be found. Sep 27 17:39:17.623444 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:39:17.623444 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:39:17.623444 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:39:17.623444 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:39:17.623444 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:39:17.623444 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:39:17.623444 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 17:39:17.623444 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 17:39:17.623444 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40e2eab1-2d75-4ad4-9e7b-da70094ed345 could not be found. Sep 27 17:39:17.623444 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:39:17.624928 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-931b0d10-5c89-4f91-bf62-ea10504dc5a5 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Returning 404 to user: Instance 40e2eab1-2d75-4ad4-9e7b-da70094ed345 could not be found. {{(pid=120415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 17:39:17.624928 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-931b0d10-5c89-4f91-bf62-ea10504dc5a5 tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] 10.222.0.55 "GET /compute/v2.1/servers/40e2eab1-2d75-4ad4-9e7b-da70094ed345" status: 404 len: 111 microversion: 2.1 time: 0.030176 Sep 27 17:39:17.624928 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 588/1199] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:39:17 2022] GET /compute/v2.1/servers/40e2eab1-2d75-4ad4-9e7b-da70094ed345 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 17:39:18.933061 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-a5fa8c3b-6425-4730-a83a-517e272dca6e tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] Calling method '.version_select at 0x7fe7281e94c0>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:39:18.961956 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-a5fa8c3b-6425-4730-a83a-517e272dca6e tempest-TestVolumeBootPattern-2014823828 tempest-TestVolumeBootPattern-2014823828-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2033463902" status: 202 len: 0 microversion: 2.1 time: 0.032631 Sep 27 17:39:18.967037 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 612/1200] 10.222.0.55 () {58 vars in 1263 bytes} [Tue Sep 27 17:39:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2033463902 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 17:39:39.450426 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-0380fd95-2cfa-4636-842a-66472ed6c86f tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:39:39.450951 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-0380fd95-2cfa-4636-842a-66472ed6c86f tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: 9e6cccab-407e-45f8-9eb3-586fa28cd817] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:39:39.453135 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=2 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:39:39.453776 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:39:39.460949 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0380fd95-2cfa-4636-842a-66472ed6c86f tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:39:39.461433 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0380fd95-2cfa-4636-842a-66472ed6c86f tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:39:39.461869 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0380fd95-2cfa-4636-842a-66472ed6c86f tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:39:39.462586 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0380fd95-2cfa-4636-842a-66472ed6c86f tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:39:39.463027 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0380fd95-2cfa-4636-842a-66472ed6c86f tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:39:39.463445 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0380fd95-2cfa-4636-842a-66472ed6c86f tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:39:39.548268 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.objects.instance [None req-0380fd95-2cfa-4636-842a-66472ed6c86f tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lazy-loading 'services' on Instance uuid 9e6cccab-407e-45f8-9eb3-586fa28cd817 {{(pid=120415) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 17:39:39.621905 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-0380fd95-2cfa-4636-842a-66472ed6c86f tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "DELETE /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817/os-volume_attachments/d4b3b5f2-7600-4e8c-9a01-3a197ea3a062" status: 202 len: 0 microversion: 2.1 time: 0.175449 Sep 27 17:39:39.622524 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 589/1201] 10.222.0.55 () {58 vars in 1416 bytes} [Tue Sep 27 17:39:39 2022] DELETE /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817/os-volume_attachments/d4b3b5f2-7600-4e8c-9a01-3a197ea3a062 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 17:39:40.745742 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-32e80a3a-7046-4bbf-960b-a9ea00fb856d tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:39:40.748636 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_cell1:SELECT=28 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:39:40.749288 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:39:40.757246 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-32e80a3a-7046-4bbf-960b-a9ea00fb856d tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:39:40.757731 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-32e80a3a-7046-4bbf-960b-a9ea00fb856d tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:39:40.758203 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-32e80a3a-7046-4bbf-960b-a9ea00fb856d tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:39:40.779927 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-32e80a3a-7046-4bbf-960b-a9ea00fb856d tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: 9e6cccab-407e-45f8-9eb3-586fa28cd817] Going to try to stop instance {{(pid=120416) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 27 17:39:40.822617 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-32e80a3a-7046-4bbf-960b-a9ea00fb856d tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "POST /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817/action" status: 202 len: 0 microversion: 2.1 time: 0.080765 Sep 27 17:39:40.823207 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 613/1202] 10.222.0.55 () {60 vars in 1278 bytes} [Tue Sep 27 17:39:40 2022] POST /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 17:39:40.831826 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-30fe6318-67d3-4d49-8fc7-419017c37295 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:39:40.832513 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-30fe6318-67d3-4d49-8fc7-419017c37295 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: 9e6cccab-407e-45f8-9eb3-586fa28cd817] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:39:40.839803 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-30fe6318-67d3-4d49-8fc7-419017c37295 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:39:40.840550 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-30fe6318-67d3-4d49-8fc7-419017c37295 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:39:40.840986 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-30fe6318-67d3-4d49-8fc7-419017c37295 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:39:40.841697 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-30fe6318-67d3-4d49-8fc7-419017c37295 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:39:40.842163 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-30fe6318-67d3-4d49-8fc7-419017c37295 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:39:40.842588 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-30fe6318-67d3-4d49-8fc7-419017c37295 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:39:40.983448 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-30fe6318-67d3-4d49-8fc7-419017c37295 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b888fd409954909874b5443cfed2838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd65ea59a6d41219ecf99f5a554056a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:39:40.992035 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-30fe6318-67d3-4d49-8fc7-419017c37295 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817" status: 200 len: 1678 microversion: 2.1 time: 0.164392 Sep 27 17:39:40.992624 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 590/1203] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:39:40 2022] GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817 => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:39:42.016194 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-155b171b-056a-419d-8f42-4ec812863350 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:39:42.016879 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-155b171b-056a-419d-8f42-4ec812863350 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: 9e6cccab-407e-45f8-9eb3-586fa28cd817] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:39:42.023066 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-155b171b-056a-419d-8f42-4ec812863350 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:39:42.023536 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-155b171b-056a-419d-8f42-4ec812863350 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:39:42.023961 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-155b171b-056a-419d-8f42-4ec812863350 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:39:42.024631 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-155b171b-056a-419d-8f42-4ec812863350 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:39:42.025074 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-155b171b-056a-419d-8f42-4ec812863350 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:39:42.025487 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-155b171b-056a-419d-8f42-4ec812863350 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:39:42.152292 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-155b171b-056a-419d-8f42-4ec812863350 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b888fd409954909874b5443cfed2838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd65ea59a6d41219ecf99f5a554056a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:39:42.160421 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-155b171b-056a-419d-8f42-4ec812863350 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817" status: 200 len: 1678 microversion: 2.1 time: 0.148797 Sep 27 17:39:42.161081 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 614/1204] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:39:42 2022] GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817 => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:39:43.185926 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-a15594e7-aae6-4863-9bf2-52938a36cc3c tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:39:43.186567 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-a15594e7-aae6-4863-9bf2-52938a36cc3c tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: 9e6cccab-407e-45f8-9eb3-586fa28cd817] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:39:43.193482 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a15594e7-aae6-4863-9bf2-52938a36cc3c tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:39:43.193964 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a15594e7-aae6-4863-9bf2-52938a36cc3c tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:39:43.194427 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a15594e7-aae6-4863-9bf2-52938a36cc3c tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:39:43.195116 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a15594e7-aae6-4863-9bf2-52938a36cc3c tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:39:43.195570 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a15594e7-aae6-4863-9bf2-52938a36cc3c tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:39:43.195994 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a15594e7-aae6-4863-9bf2-52938a36cc3c tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:39:43.325506 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-a15594e7-aae6-4863-9bf2-52938a36cc3c tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b888fd409954909874b5443cfed2838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd65ea59a6d41219ecf99f5a554056a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:39:43.333869 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-a15594e7-aae6-4863-9bf2-52938a36cc3c tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817" status: 200 len: 1678 microversion: 2.1 time: 0.151908 Sep 27 17:39:43.334464 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 591/1205] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:39:43 2022] GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:39:44.357102 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-7bdeac28-30c6-4a31-9a18-660baecb527d tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:39:44.357715 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-7bdeac28-30c6-4a31-9a18-660baecb527d tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: 9e6cccab-407e-45f8-9eb3-586fa28cd817] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:39:44.364322 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7bdeac28-30c6-4a31-9a18-660baecb527d tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:39:44.364801 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7bdeac28-30c6-4a31-9a18-660baecb527d tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:39:44.365241 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7bdeac28-30c6-4a31-9a18-660baecb527d tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:39:44.365929 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7bdeac28-30c6-4a31-9a18-660baecb527d tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:39:44.366420 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7bdeac28-30c6-4a31-9a18-660baecb527d tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:39:44.366843 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7bdeac28-30c6-4a31-9a18-660baecb527d tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:39:44.491787 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-7bdeac28-30c6-4a31-9a18-660baecb527d tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b888fd409954909874b5443cfed2838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd65ea59a6d41219ecf99f5a554056a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:39:44.499481 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-7bdeac28-30c6-4a31-9a18-660baecb527d tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817" status: 200 len: 1678 microversion: 2.1 time: 0.146345 Sep 27 17:39:44.500040 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 615/1206] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:39:44 2022] GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817 => generated 1678 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:39:45.522648 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-24ff2c44-1009-4b0c-8d1b-fb8f20bad18e tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:39:45.523169 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-24ff2c44-1009-4b0c-8d1b-fb8f20bad18e tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: 9e6cccab-407e-45f8-9eb3-586fa28cd817] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:39:45.529562 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-24ff2c44-1009-4b0c-8d1b-fb8f20bad18e tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:39:45.530041 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-24ff2c44-1009-4b0c-8d1b-fb8f20bad18e tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:39:45.530509 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-24ff2c44-1009-4b0c-8d1b-fb8f20bad18e tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:39:45.531197 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-24ff2c44-1009-4b0c-8d1b-fb8f20bad18e tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:39:45.531653 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-24ff2c44-1009-4b0c-8d1b-fb8f20bad18e tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:39:45.532076 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-24ff2c44-1009-4b0c-8d1b-fb8f20bad18e tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:39:45.666353 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-24ff2c44-1009-4b0c-8d1b-fb8f20bad18e tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b888fd409954909874b5443cfed2838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd65ea59a6d41219ecf99f5a554056a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:39:45.673976 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-24ff2c44-1009-4b0c-8d1b-fb8f20bad18e tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817" status: 200 len: 1678 microversion: 2.1 time: 0.155980 Sep 27 17:39:45.674570 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 592/1207] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:39:45 2022] GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:39:46.697705 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-07814f58-02d9-466b-9d56-6808748a47b4 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:39:46.698337 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-07814f58-02d9-466b-9d56-6808748a47b4 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: 9e6cccab-407e-45f8-9eb3-586fa28cd817] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:39:46.704371 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-07814f58-02d9-466b-9d56-6808748a47b4 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:39:46.704849 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-07814f58-02d9-466b-9d56-6808748a47b4 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:39:46.705286 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-07814f58-02d9-466b-9d56-6808748a47b4 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:39:46.705968 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-07814f58-02d9-466b-9d56-6808748a47b4 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:39:46.706455 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-07814f58-02d9-466b-9d56-6808748a47b4 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:39:46.706882 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-07814f58-02d9-466b-9d56-6808748a47b4 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:39:46.836505 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-07814f58-02d9-466b-9d56-6808748a47b4 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b888fd409954909874b5443cfed2838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd65ea59a6d41219ecf99f5a554056a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:39:46.844292 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-07814f58-02d9-466b-9d56-6808748a47b4 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817" status: 200 len: 1678 microversion: 2.1 time: 0.150413 Sep 27 17:39:46.844863 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 616/1208] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:39:46 2022] GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817 => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:39:47.868238 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-f25add70-0e0c-4965-880f-5be48e68090b tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:39:47.868845 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-f25add70-0e0c-4965-880f-5be48e68090b tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: 9e6cccab-407e-45f8-9eb3-586fa28cd817] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:39:47.875188 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f25add70-0e0c-4965-880f-5be48e68090b tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:39:47.875668 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f25add70-0e0c-4965-880f-5be48e68090b tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:39:47.876100 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f25add70-0e0c-4965-880f-5be48e68090b tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:39:47.876782 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f25add70-0e0c-4965-880f-5be48e68090b tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:39:47.877234 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f25add70-0e0c-4965-880f-5be48e68090b tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:39:47.877655 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f25add70-0e0c-4965-880f-5be48e68090b tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:39:48.001952 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-f25add70-0e0c-4965-880f-5be48e68090b tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b888fd409954909874b5443cfed2838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd65ea59a6d41219ecf99f5a554056a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:39:48.010050 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-f25add70-0e0c-4965-880f-5be48e68090b tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817" status: 200 len: 1678 microversion: 2.1 time: 0.145694 Sep 27 17:39:48.010638 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 593/1209] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:39:47 2022] GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817 => generated 1678 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:39:49.033847 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-3faa7ca5-a3ad-442f-b9ab-b74762a8ff07 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:39:49.034972 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-3faa7ca5-a3ad-442f-b9ab-b74762a8ff07 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: 9e6cccab-407e-45f8-9eb3-586fa28cd817] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:39:49.041198 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3faa7ca5-a3ad-442f-b9ab-b74762a8ff07 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:39:49.041668 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3faa7ca5-a3ad-442f-b9ab-b74762a8ff07 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:39:49.042114 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3faa7ca5-a3ad-442f-b9ab-b74762a8ff07 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:39:49.042790 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3faa7ca5-a3ad-442f-b9ab-b74762a8ff07 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:39:49.043235 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3faa7ca5-a3ad-442f-b9ab-b74762a8ff07 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:39:49.043651 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3faa7ca5-a3ad-442f-b9ab-b74762a8ff07 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:39:49.173774 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-3faa7ca5-a3ad-442f-b9ab-b74762a8ff07 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b888fd409954909874b5443cfed2838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd65ea59a6d41219ecf99f5a554056a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:39:49.181331 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-3faa7ca5-a3ad-442f-b9ab-b74762a8ff07 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817" status: 200 len: 1678 microversion: 2.1 time: 0.151526 Sep 27 17:39:49.181887 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 617/1210] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:39:49 2022] GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:39:50.204756 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-2e778f5f-29d8-403e-b264-7da3f959e5fd tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:39:50.205397 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-2e778f5f-29d8-403e-b264-7da3f959e5fd tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: 9e6cccab-407e-45f8-9eb3-586fa28cd817] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:39:50.208442 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 27 17:39:50.208588 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Tue Sep 27 17:39:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817 (ip 10.222.0.55) !!! Sep 27 17:39:50.214568 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2e778f5f-29d8-403e-b264-7da3f959e5fd tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:39:50.215043 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2e778f5f-29d8-403e-b264-7da3f959e5fd tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:39:50.215479 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2e778f5f-29d8-403e-b264-7da3f959e5fd tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:39:50.216171 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2e778f5f-29d8-403e-b264-7da3f959e5fd tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:39:50.216627 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2e778f5f-29d8-403e-b264-7da3f959e5fd tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:39:50.217051 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2e778f5f-29d8-403e-b264-7da3f959e5fd tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:39:50.351811 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-2e778f5f-29d8-403e-b264-7da3f959e5fd tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b888fd409954909874b5443cfed2838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd65ea59a6d41219ecf99f5a554056a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:39:50.359600 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-2e778f5f-29d8-403e-b264-7da3f959e5fd tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817" status: 200 len: 1678 microversion: 2.1 time: 0.158767 Sep 27 17:39:50.360163 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 594/1211] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:39:50 2022] GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:39:51.384545 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-bcec76f4-5c39-482a-ba4c-4eb55a32e383 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:39:51.385149 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-bcec76f4-5c39-482a-ba4c-4eb55a32e383 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: 9e6cccab-407e-45f8-9eb3-586fa28cd817] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:39:51.391635 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-bcec76f4-5c39-482a-ba4c-4eb55a32e383 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:39:51.392108 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-bcec76f4-5c39-482a-ba4c-4eb55a32e383 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:39:51.392537 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-bcec76f4-5c39-482a-ba4c-4eb55a32e383 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:39:51.393222 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-bcec76f4-5c39-482a-ba4c-4eb55a32e383 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:39:51.393670 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-bcec76f4-5c39-482a-ba4c-4eb55a32e383 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:39:51.394107 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-bcec76f4-5c39-482a-ba4c-4eb55a32e383 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:39:51.521709 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-bcec76f4-5c39-482a-ba4c-4eb55a32e383 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b888fd409954909874b5443cfed2838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd65ea59a6d41219ecf99f5a554056a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:39:51.529341 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-bcec76f4-5c39-482a-ba4c-4eb55a32e383 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817" status: 200 len: 1678 microversion: 2.1 time: 0.148642 Sep 27 17:39:51.529910 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 618/1212] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:39:51 2022] GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817 => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:39:52.552619 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-5bc64a59-dece-4a74-a4ab-1aefc3886bf9 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:39:52.553209 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-5bc64a59-dece-4a74-a4ab-1aefc3886bf9 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: 9e6cccab-407e-45f8-9eb3-586fa28cd817] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:39:52.560869 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5bc64a59-dece-4a74-a4ab-1aefc3886bf9 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:39:52.561366 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5bc64a59-dece-4a74-a4ab-1aefc3886bf9 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:39:52.561806 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5bc64a59-dece-4a74-a4ab-1aefc3886bf9 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:39:52.562546 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5bc64a59-dece-4a74-a4ab-1aefc3886bf9 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:39:52.563000 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5bc64a59-dece-4a74-a4ab-1aefc3886bf9 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:39:52.563429 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5bc64a59-dece-4a74-a4ab-1aefc3886bf9 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:39:52.695999 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-5bc64a59-dece-4a74-a4ab-1aefc3886bf9 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b888fd409954909874b5443cfed2838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd65ea59a6d41219ecf99f5a554056a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:39:52.703650 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-5bc64a59-dece-4a74-a4ab-1aefc3886bf9 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817" status: 200 len: 1678 microversion: 2.1 time: 0.154963 Sep 27 17:39:52.704230 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 595/1213] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:39:52 2022] GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:39:53.727914 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-245a4dc3-2848-4f74-9ea5-0ba937d7ccf2 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:39:53.728499 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-245a4dc3-2848-4f74-9ea5-0ba937d7ccf2 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: 9e6cccab-407e-45f8-9eb3-586fa28cd817] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:39:53.734836 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-245a4dc3-2848-4f74-9ea5-0ba937d7ccf2 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:39:53.735307 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-245a4dc3-2848-4f74-9ea5-0ba937d7ccf2 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:39:53.735733 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-245a4dc3-2848-4f74-9ea5-0ba937d7ccf2 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:39:53.736407 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-245a4dc3-2848-4f74-9ea5-0ba937d7ccf2 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:39:53.736851 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-245a4dc3-2848-4f74-9ea5-0ba937d7ccf2 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:39:53.737268 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-245a4dc3-2848-4f74-9ea5-0ba937d7ccf2 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:39:53.861457 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-245a4dc3-2848-4f74-9ea5-0ba937d7ccf2 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b888fd409954909874b5443cfed2838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd65ea59a6d41219ecf99f5a554056a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:39:53.869299 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-245a4dc3-2848-4f74-9ea5-0ba937d7ccf2 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817" status: 200 len: 1678 microversion: 2.1 time: 0.145232 Sep 27 17:39:53.869866 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 619/1214] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:39:53 2022] GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817 => generated 1678 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:39:54.892562 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-302303cb-a487-4cdc-9d6e-ee4dcfb9a7cc tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:39:54.893116 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-302303cb-a487-4cdc-9d6e-ee4dcfb9a7cc tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: 9e6cccab-407e-45f8-9eb3-586fa28cd817] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:39:54.899669 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-302303cb-a487-4cdc-9d6e-ee4dcfb9a7cc tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:39:54.900148 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-302303cb-a487-4cdc-9d6e-ee4dcfb9a7cc tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:39:54.900584 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-302303cb-a487-4cdc-9d6e-ee4dcfb9a7cc tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:39:54.901271 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-302303cb-a487-4cdc-9d6e-ee4dcfb9a7cc tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:39:54.901724 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-302303cb-a487-4cdc-9d6e-ee4dcfb9a7cc tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:39:54.902177 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-302303cb-a487-4cdc-9d6e-ee4dcfb9a7cc tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:39:55.293185 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-302303cb-a487-4cdc-9d6e-ee4dcfb9a7cc tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b888fd409954909874b5443cfed2838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd65ea59a6d41219ecf99f5a554056a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:39:55.300931 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-302303cb-a487-4cdc-9d6e-ee4dcfb9a7cc tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817" status: 200 len: 1678 microversion: 2.1 time: 0.412370 Sep 27 17:39:55.301506 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 596/1215] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:39:54 2022] GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817 => generated 1678 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:39:56.323769 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-5a1670f1-5c29-4b49-a754-4a48037dd944 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:39:56.324546 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-5a1670f1-5c29-4b49-a754-4a48037dd944 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: 9e6cccab-407e-45f8-9eb3-586fa28cd817] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:39:56.330900 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5a1670f1-5c29-4b49-a754-4a48037dd944 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:39:56.331372 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5a1670f1-5c29-4b49-a754-4a48037dd944 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:39:56.331798 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5a1670f1-5c29-4b49-a754-4a48037dd944 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:39:56.332467 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5a1670f1-5c29-4b49-a754-4a48037dd944 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:39:56.332912 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5a1670f1-5c29-4b49-a754-4a48037dd944 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:39:56.333327 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5a1670f1-5c29-4b49-a754-4a48037dd944 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:39:56.456235 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-5a1670f1-5c29-4b49-a754-4a48037dd944 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b888fd409954909874b5443cfed2838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd65ea59a6d41219ecf99f5a554056a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:39:56.463810 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-5a1670f1-5c29-4b49-a754-4a48037dd944 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817" status: 200 len: 1655 microversion: 2.1 time: 0.143939 Sep 27 17:39:56.464378 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 620/1216] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:39:56 2022] GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817 => generated 1655 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:39:56.486680 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-a568e05e-a731-4cce-993e-f62086c82dc4 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:39:56.493337 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a568e05e-a731-4cce-993e-f62086c82dc4 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:39:56.493818 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a568e05e-a731-4cce-993e-f62086c82dc4 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:39:56.494323 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a568e05e-a731-4cce-993e-f62086c82dc4 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:39:56.555102 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-a568e05e-a731-4cce-993e-f62086c82dc4 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: 9e6cccab-407e-45f8-9eb3-586fa28cd817] Going to try to start instance {{(pid=120415) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 27 17:39:56.595774 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-a568e05e-a731-4cce-993e-f62086c82dc4 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "POST /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817/action" status: 202 len: 0 microversion: 2.1 time: 0.112977 Sep 27 17:39:56.596364 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 597/1217] 10.222.0.55 () {60 vars in 1278 bytes} [Tue Sep 27 17:39:56 2022] POST /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 17:39:56.605231 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-1db4e5b7-cb1a-4e89-b36a-59bdfb479c22 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:39:56.605841 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-1db4e5b7-cb1a-4e89-b36a-59bdfb479c22 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: 9e6cccab-407e-45f8-9eb3-586fa28cd817] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:39:56.611711 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1db4e5b7-cb1a-4e89-b36a-59bdfb479c22 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:39:56.612186 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1db4e5b7-cb1a-4e89-b36a-59bdfb479c22 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:39:56.612638 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1db4e5b7-cb1a-4e89-b36a-59bdfb479c22 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:39:56.613575 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1db4e5b7-cb1a-4e89-b36a-59bdfb479c22 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:39:56.614020 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1db4e5b7-cb1a-4e89-b36a-59bdfb479c22 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:39:56.614472 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-1db4e5b7-cb1a-4e89-b36a-59bdfb479c22 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:39:56.749743 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-1db4e5b7-cb1a-4e89-b36a-59bdfb479c22 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b888fd409954909874b5443cfed2838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd65ea59a6d41219ecf99f5a554056a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:39:56.757412 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-1db4e5b7-cb1a-4e89-b36a-59bdfb479c22 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817" status: 200 len: 1664 microversion: 2.1 time: 0.156024 Sep 27 17:39:56.757985 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 621/1218] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:39:56 2022] GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817 => generated 1664 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:39:57.781749 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-70a9ed38-12a6-4358-85c3-57b414d98143 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:39:57.782493 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-70a9ed38-12a6-4358-85c3-57b414d98143 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: 9e6cccab-407e-45f8-9eb3-586fa28cd817] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:39:57.789099 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-70a9ed38-12a6-4358-85c3-57b414d98143 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:39:57.789584 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-70a9ed38-12a6-4358-85c3-57b414d98143 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:39:57.790015 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-70a9ed38-12a6-4358-85c3-57b414d98143 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:39:57.790734 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-70a9ed38-12a6-4358-85c3-57b414d98143 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:39:57.791188 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-70a9ed38-12a6-4358-85c3-57b414d98143 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:39:57.791610 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-70a9ed38-12a6-4358-85c3-57b414d98143 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:39:57.923576 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-70a9ed38-12a6-4358-85c3-57b414d98143 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b888fd409954909874b5443cfed2838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd65ea59a6d41219ecf99f5a554056a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:39:57.932124 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-70a9ed38-12a6-4358-85c3-57b414d98143 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817" status: 200 len: 1664 microversion: 2.1 time: 0.155094 Sep 27 17:39:57.932690 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 598/1219] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:39:57 2022] GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817 => generated 1664 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:39:58.959655 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-a4e4eb27-a995-4f56-be2b-250793cf7819 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:39:58.960264 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-a4e4eb27-a995-4f56-be2b-250793cf7819 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: 9e6cccab-407e-45f8-9eb3-586fa28cd817] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:39:58.966680 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a4e4eb27-a995-4f56-be2b-250793cf7819 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:39:58.967153 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a4e4eb27-a995-4f56-be2b-250793cf7819 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:39:58.967579 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a4e4eb27-a995-4f56-be2b-250793cf7819 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:39:58.968253 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a4e4eb27-a995-4f56-be2b-250793cf7819 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:39:58.968695 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a4e4eb27-a995-4f56-be2b-250793cf7819 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:39:58.969106 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-a4e4eb27-a995-4f56-be2b-250793cf7819 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:39:59.098763 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-a4e4eb27-a995-4f56-be2b-250793cf7819 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b888fd409954909874b5443cfed2838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd65ea59a6d41219ecf99f5a554056a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:39:59.106293 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-a4e4eb27-a995-4f56-be2b-250793cf7819 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817" status: 200 len: 1668 microversion: 2.1 time: 0.150524 Sep 27 17:39:59.106908 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 622/1220] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:39:58 2022] GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817 => generated 1668 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:41:02.433592 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_api:SELECT=20 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:41:02.434603 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell1:SELECT=67,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:41:02.439187 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-535e174d-2c4c-40c7-a6a3-2aaeca9f2042 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:41:02.441582 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-535e174d-2c4c-40c7-a6a3-2aaeca9f2042 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: 9e6cccab-407e-45f8-9eb3-586fa28cd817] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:41:02.448795 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-535e174d-2c4c-40c7-a6a3-2aaeca9f2042 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:41:02.449272 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-535e174d-2c4c-40c7-a6a3-2aaeca9f2042 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:41:02.449735 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-535e174d-2c4c-40c7-a6a3-2aaeca9f2042 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:41:02.450448 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-535e174d-2c4c-40c7-a6a3-2aaeca9f2042 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:41:02.450898 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-535e174d-2c4c-40c7-a6a3-2aaeca9f2042 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:41:02.451320 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-535e174d-2c4c-40c7-a6a3-2aaeca9f2042 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:41:02.481141 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-535e174d-2c4c-40c7-a6a3-2aaeca9f2042 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049520 Sep 27 17:41:02.481684 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 599/1221] 10.222.0.55 () {58 vars in 1302 bytes} [Tue Sep 27 17:41:02 2022] GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 17:41:02.542799 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_api:SELECT=20 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:41:02.543536 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:41:02.548336 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-0894a25a-0c65-43b2-aab2-c65ae8dd350d tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:41:02.548887 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-0894a25a-0c65-43b2-aab2-c65ae8dd350d tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: 9e6cccab-407e-45f8-9eb3-586fa28cd817] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:41:02.557079 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-0894a25a-0c65-43b2-aab2-c65ae8dd350d tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:41:02.557561 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-0894a25a-0c65-43b2-aab2-c65ae8dd350d tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:41:02.557991 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-0894a25a-0c65-43b2-aab2-c65ae8dd350d tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:41:02.558703 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-0894a25a-0c65-43b2-aab2-c65ae8dd350d tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:41:02.559156 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-0894a25a-0c65-43b2-aab2-c65ae8dd350d tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:41:02.559583 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-0894a25a-0c65-43b2-aab2-c65ae8dd350d tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:41:02.730677 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-0894a25a-0c65-43b2-aab2-c65ae8dd350d tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: 9e6cccab-407e-45f8-9eb3-586fa28cd817] Going to try to terminate instance {{(pid=120416) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 17:41:02.803727 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-0894a25a-0c65-43b2-aab2-c65ae8dd350d tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "DELETE /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817" status: 204 len: 0 microversion: 2.1 time: 0.262443 Sep 27 17:41:02.804421 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 623/1222] 10.222.0.55 () {58 vars in 1239 bytes} [Tue Sep 27 17:41:02 2022] DELETE /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 17:41:02.812979 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-aa767495-a290-483d-80b6-2a39a6d5cfdd tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:41:02.813578 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-aa767495-a290-483d-80b6-2a39a6d5cfdd tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: 9e6cccab-407e-45f8-9eb3-586fa28cd817] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:41:02.819548 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-aa767495-a290-483d-80b6-2a39a6d5cfdd tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:41:02.820026 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-aa767495-a290-483d-80b6-2a39a6d5cfdd tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:41:02.820453 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-aa767495-a290-483d-80b6-2a39a6d5cfdd tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:41:02.821141 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-aa767495-a290-483d-80b6-2a39a6d5cfdd tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:41:02.821591 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-aa767495-a290-483d-80b6-2a39a6d5cfdd tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:41:02.822012 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-aa767495-a290-483d-80b6-2a39a6d5cfdd tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:41:02.952191 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-aa767495-a290-483d-80b6-2a39a6d5cfdd tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b888fd409954909874b5443cfed2838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd65ea59a6d41219ecf99f5a554056a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:41:02.960783 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-aa767495-a290-483d-80b6-2a39a6d5cfdd tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817" status: 200 len: 1674 microversion: 2.1 time: 0.151654 Sep 27 17:41:02.961697 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 600/1223] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:41:02 2022] GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817 => generated 1674 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:41:03.984806 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-5433cb6e-6d6d-4c27-91ba-725b35ea31e8 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:41:03.985500 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-5433cb6e-6d6d-4c27-91ba-725b35ea31e8 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: 9e6cccab-407e-45f8-9eb3-586fa28cd817] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:41:03.993036 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5433cb6e-6d6d-4c27-91ba-725b35ea31e8 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:41:03.993517 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5433cb6e-6d6d-4c27-91ba-725b35ea31e8 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:41:03.993953 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5433cb6e-6d6d-4c27-91ba-725b35ea31e8 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:41:03.994670 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5433cb6e-6d6d-4c27-91ba-725b35ea31e8 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:41:03.995129 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5433cb6e-6d6d-4c27-91ba-725b35ea31e8 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:41:03.995555 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-5433cb6e-6d6d-4c27-91ba-725b35ea31e8 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:41:04.123825 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-5433cb6e-6d6d-4c27-91ba-725b35ea31e8 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b888fd409954909874b5443cfed2838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd65ea59a6d41219ecf99f5a554056a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:41:04.131465 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-5433cb6e-6d6d-4c27-91ba-725b35ea31e8 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817" status: 200 len: 1674 microversion: 2.1 time: 0.150878 Sep 27 17:41:04.132011 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 624/1224] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:41:03 2022] GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817 => generated 1674 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:41:05.155119 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-5b5da0fa-ea4e-410c-9d3f-9351664c9a74 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:41:05.155733 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-5b5da0fa-ea4e-410c-9d3f-9351664c9a74 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: 9e6cccab-407e-45f8-9eb3-586fa28cd817] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:41:05.162436 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5b5da0fa-ea4e-410c-9d3f-9351664c9a74 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:41:05.162923 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5b5da0fa-ea4e-410c-9d3f-9351664c9a74 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:41:05.163368 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5b5da0fa-ea4e-410c-9d3f-9351664c9a74 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:41:05.164160 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5b5da0fa-ea4e-410c-9d3f-9351664c9a74 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:41:05.164624 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5b5da0fa-ea4e-410c-9d3f-9351664c9a74 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:41:05.165050 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5b5da0fa-ea4e-410c-9d3f-9351664c9a74 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:41:05.370231 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-5b5da0fa-ea4e-410c-9d3f-9351664c9a74 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b888fd409954909874b5443cfed2838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd65ea59a6d41219ecf99f5a554056a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:41:05.377973 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-5b5da0fa-ea4e-410c-9d3f-9351664c9a74 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817" status: 200 len: 1674 microversion: 2.1 time: 0.226714 Sep 27 17:41:05.378565 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 601/1225] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:41:05 2022] GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817 => generated 1674 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:41:05.935751 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [req-0e86b94e-6584-4cbd-b522-0e833ac8a35c req-c33ae12d-778d-4c9f-9344-55aaf9739985 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e6cccab-407e-45f8-9eb3-586fa28cd817", "name": "network-vif-deleted", "tag": "af24e484-4901-4878-9eb2-665f90e32d28"}]} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:41:05.950945 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-0e86b94e-6584-4cbd-b522-0e833ac8a35c req-c33ae12d-778d-4c9f-9344-55aaf9739985 service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:41:05.951796 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-0e86b94e-6584-4cbd-b522-0e833ac8a35c req-c33ae12d-778d-4c9f-9344-55aaf9739985 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:41:05.952435 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-0e86b94e-6584-4cbd-b522-0e833ac8a35c req-c33ae12d-778d-4c9f-9344-55aaf9739985 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:41:05.968347 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.compute.server_external_events [req-0e86b94e-6584-4cbd-b522-0e833ac8a35c req-c33ae12d-778d-4c9f-9344-55aaf9739985 service nova] Creating event network-vif-deleted:af24e484-4901-4878-9eb2-665f90e32d28 for instance 9e6cccab-407e-45f8-9eb3-586fa28cd817 on hv-cinder-84914 Sep 27 17:41:05.974340 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [req-0e86b94e-6584-4cbd-b522-0e833ac8a35c req-c33ae12d-778d-4c9f-9344-55aaf9739985 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.177382 Sep 27 17:41:05.975408 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 625/1226] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:41:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:41:06.401848 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-a929c863-993c-47b5-95ba-c2c4c4c4a946 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:41:06.402956 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-a929c863-993c-47b5-95ba-c2c4c4c4a946 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: 9e6cccab-407e-45f8-9eb3-586fa28cd817] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:41:06.409680 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a929c863-993c-47b5-95ba-c2c4c4c4a946 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:41:06.410224 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a929c863-993c-47b5-95ba-c2c4c4c4a946 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:41:06.410627 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a929c863-993c-47b5-95ba-c2c4c4c4a946 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:41:06.411321 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a929c863-993c-47b5-95ba-c2c4c4c4a946 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:41:06.411767 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a929c863-993c-47b5-95ba-c2c4c4c4a946 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:41:06.412186 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a929c863-993c-47b5-95ba-c2c4c4c4a946 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:41:06.443982 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a929c863-993c-47b5-95ba-c2c4c4c4a946 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:41:06.444471 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a929c863-993c-47b5-95ba-c2c4c4c4a946 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:41:06.444959 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a929c863-993c-47b5-95ba-c2c4c4c4a946 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:41:06.445406 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.objects.instance [None req-a929c863-993c-47b5-95ba-c2c4c4c4a946 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lazy-loading 'fault' on Instance uuid 9e6cccab-407e-45f8-9eb3-586fa28cd817 {{(pid=120415) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 17:41:06.492033 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-a929c863-993c-47b5-95ba-c2c4c4c4a946 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b888fd409954909874b5443cfed2838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd65ea59a6d41219ecf99f5a554056a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:41:06.499450 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-a929c863-993c-47b5-95ba-c2c4c4c4a946 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817" status: 200 len: 1328 microversion: 2.1 time: 0.101509 Sep 27 17:41:06.500038 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 602/1227] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:41:06 2022] GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817 => generated 1328 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:41:07.523494 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-7dc87a21-5f90-4799-9fc7-3d1ec6627467 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:41:07.524118 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-7dc87a21-5f90-4799-9fc7-3d1ec6627467 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: 9e6cccab-407e-45f8-9eb3-586fa28cd817] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:41:07.530186 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7dc87a21-5f90-4799-9fc7-3d1ec6627467 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:41:07.530654 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7dc87a21-5f90-4799-9fc7-3d1ec6627467 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:41:07.531080 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7dc87a21-5f90-4799-9fc7-3d1ec6627467 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:41:07.531750 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7dc87a21-5f90-4799-9fc7-3d1ec6627467 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:41:07.532195 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7dc87a21-5f90-4799-9fc7-3d1ec6627467 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:41:07.532610 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7dc87a21-5f90-4799-9fc7-3d1ec6627467 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:41:07.545831 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.wsgi [None req-7dc87a21-5f90-4799-9fc7-3d1ec6627467 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] HTTP exception thrown: Instance 9e6cccab-407e-45f8-9eb3-586fa28cd817 could not be found. Sep 27 17:41:07.547427 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-7dc87a21-5f90-4799-9fc7-3d1ec6627467 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Request method failure captured: Sep 27 17:41:07.547427 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: request: GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817 HTTP/1.1 Sep 27 17:41:07.547427 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Accept: application/json Sep 27 17:41:07.547427 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Accept-Encoding: identity Sep 27 17:41:07.547427 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Connection: close Sep 27 17:41:07.547427 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Content-Length: 0 Sep 27 17:41:07.547427 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Content-Type: application/json Sep 27 17:41:07.547427 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Host: 10.222.0.55 Sep 27 17:41:07.547427 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Openstack-System-Scope: None Sep 27 17:41:07.547427 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: User-Agent: python-urllib3/1.26.12 Sep 27 17:41:07.547427 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Auth-Token: gAAAAABjMzSeQwcZWqcXgmVYQr9OX1fPdOc8LbvT3p3K_GqHGottEGJ3nE8beTzy5V-J53XdmBrLDoHkctevJ-1ZBC7x6TKRhW9vXIwHQV0_lIGi1eRrSix5Lye7_z--hwKR5pRn-xPXlr-ufpjtuWvHqpikbBxLLeu_q8dleU5RcNcQUEAU8yo Sep 27 17:41:07.547427 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Domain-Id: None Sep 27 17:41:07.547427 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Domain-Name: None Sep 27 17:41:07.547427 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Identity-Status: Confirmed Sep 27 17:41:07.547427 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Is-Admin-Project: True Sep 27 17:41:07.547427 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Domain-Id: default Sep 27 17:41:07.547427 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Domain-Name: Default Sep 27 17:41:07.547427 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Id: 0bd65ea59a6d41219ecf99f5a554056a Sep 27 17:41:07.547427 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Name: tempest-AttachVolumeTestJSON-1701714554 Sep 27 17:41:07.547427 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Role: reader,member Sep 27 17:41:07.547427 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Roles: reader,member Sep 27 17:41:07.549893 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/0bd65ea59a6d41219ecf99f5a554056a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_0bd65ea59a6d41219ecf99f5a554056a", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/0bd65ea59a6d41219ecf99f5a554056a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/0bd65ea59a6d41219ecf99f5a554056a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 27 17:41:07.549893 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Tenant: tempest-AttachVolumeTestJSON-1701714554 Sep 27 17:41:07.549893 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Tenant-Id: 0bd65ea59a6d41219ecf99f5a554056a Sep 27 17:41:07.549893 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1701714554 Sep 27 17:41:07.549893 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User: tempest-AttachVolumeTestJSON-1701714554-project Sep 27 17:41:07.549893 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Domain-Id: default Sep 27 17:41:07.549893 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Domain-Name: Default Sep 27 17:41:07.549893 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Id: 1b888fd409954909874b5443cfed2838 Sep 27 17:41:07.549893 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Name: tempest-AttachVolumeTestJSON-1701714554-project Sep 27 17:41:07.549893 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: method: > Sep 27 17:41:07.549893 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: exception: Instance 9e6cccab-407e-45f8-9eb3-586fa28cd817 could not be found. Sep 27 17:41:07.549893 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: action_args: {'id': '9e6cccab-407e-45f8-9eb3-586fa28cd817'} Sep 27 17:41:07.551212 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 17:41:07.551212 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:41:07.551212 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 17:41:07.551212 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 17:41:07.551212 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 17:41:07.551212 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 17:41:07.551212 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 17:41:07.551212 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 17:41:07.551212 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 17:41:07.551212 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 17:41:07.551212 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e6cccab-407e-45f8-9eb3-586fa28cd817 could not be found. Sep 27 17:41:07.551212 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:41:07.551212 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:41:07.551212 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:41:07.551212 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:41:07.551212 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:41:07.551212 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:41:07.551212 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 17:41:07.551212 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 17:41:07.551212 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 17:41:07.553140 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 17:41:07.553140 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 17:41:07.553140 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 17:41:07.553140 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 17:41:07.553140 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 17:41:07.553140 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 17:41:07.553140 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 17:41:07.553140 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e6cccab-407e-45f8-9eb3-586fa28cd817 could not be found. Sep 27 17:41:07.553140 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:41:07.553140 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:41:07.553140 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:41:07.553140 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:41:07.553140 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:41:07.553140 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:41:07.553140 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 17:41:07.553140 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 17:41:07.553140 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e6cccab-407e-45f8-9eb3-586fa28cd817 could not be found. Sep 27 17:41:07.553140 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:41:07.554468 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-7dc87a21-5f90-4799-9fc7-3d1ec6627467 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Returning 404 to user: Instance 9e6cccab-407e-45f8-9eb3-586fa28cd817 could not be found. {{(pid=120416) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 17:41:07.554468 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-7dc87a21-5f90-4799-9fc7-3d1ec6627467 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817" status: 404 len: 111 microversion: 2.1 time: 0.029971 Sep 27 17:41:07.554468 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 626/1228] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:41:07 2022] GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 17:41:07.558186 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-203d81af-46bb-4149-9c98-91d521d52450 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Calling method '.version_select at 0x7fe72492a8b0>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:41:07.577542 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-203d81af-46bb-4149-9c98-91d521d52450 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1948400134" status: 202 len: 0 microversion: 2.1 time: 0.023122 Sep 27 17:41:07.578247 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 603/1229] 10.222.0.55 () {58 vars in 1221 bytes} [Tue Sep 27 17:41:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1948400134 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 17:41:08.200148 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-59662446-743a-47af-954f-89bda6a5d054 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Action: 'create', calling method: .version_select at 0x7fe7281ef820>, body: {"keypair": {"name": "tempest-keypair-1612067768", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLQBWhMs5vm15I3lFp293thZLWmSxNazmS6Xy470F2km3z0NpiPD56nFja+0JfrHug6HpSEvh4o6poHN5s1WIz/jn5LeC6tR1sJrepVs0+VQvIZZnccsfAMoXaMkOBpW7g=="}} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:41:08.216061 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.quota [None req-59662446-743a-47af-954f-89bda6a5d054 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Getting quotas for project 0bd65ea59a6d41219ecf99f5a554056a. Resources: {'key_pairs'} {{(pid=120416) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 17:41:08.219833 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.quota [None req-59662446-743a-47af-954f-89bda6a5d054 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Getting quotas for user 1b888fd409954909874b5443cfed2838 and project 0bd65ea59a6d41219ecf99f5a554056a. Resources: {'key_pairs'} {{(pid=120416) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 17:41:08.245235 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-59662446-743a-47af-954f-89bda6a5d054 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049024 Sep 27 17:41:08.245858 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 627/1230] 10.222.0.55 () {60 vars in 1159 bytes} [Tue Sep 27 17:41:08 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:41:09.465583 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-80085657-18ba-4843-8cff-47f182d3d45a tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1702925484", "imageRef": "9355bd92-0a49-42cd-b079-ff9f0d54b91b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "49c3b1bc-0887-4bf4-a331-6a649d0d76a8"}], "security_groups": [{"name": "tempest-securitygroup--1439587381"}], "key_name": "tempest-keypair-1612067768", "user_data": "}} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:41:09.565777 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.network.neutron [None req-80085657-18ba-4843-8cff-47f182d3d45a tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] validate_networks() for [('49c3b1bc-0887-4bf4-a331-6a649d0d76a8', None, None, None, None, None)] {{(pid=120415) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 17:41:09.976310 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-80085657-18ba-4843-8cff-47f182d3d45a tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Flavor limits 0:0:0 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 17:41:09.976734 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-80085657-18ba-4843-8cff-47f182d3d45a tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Image limits 0:0:0 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 17:41:09.977213 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-80085657-18ba-4843-8cff-47f182d3d45a tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Flavor pref 0:0:0 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 17:41:09.977624 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-80085657-18ba-4843-8cff-47f182d3d45a tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Image pref 0:0:0 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 17:41:09.978219 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-80085657-18ba-4843-8cff-47f182d3d45a tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 17:41:09.986896 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-80085657-18ba-4843-8cff-47f182d3d45a tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:41:09.987386 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-80085657-18ba-4843-8cff-47f182d3d45a tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:41:09.987824 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-80085657-18ba-4843-8cff-47f182d3d45a tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:41:09.988581 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-80085657-18ba-4843-8cff-47f182d3d45a tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:41:09.989038 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-80085657-18ba-4843-8cff-47f182d3d45a tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:41:09.989725 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-80085657-18ba-4843-8cff-47f182d3d45a tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:41:10.018533 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.quota [None req-80085657-18ba-4843-8cff-47f182d3d45a tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Getting quotas for project 0bd65ea59a6d41219ecf99f5a554056a. Resources: {'cores', 'ram', 'instances'} {{(pid=120415) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 17:41:10.022480 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.quota [None req-80085657-18ba-4843-8cff-47f182d3d45a tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Getting quotas for user 1b888fd409954909874b5443cfed2838 and project 0bd65ea59a6d41219ecf99f5a554056a. Resources: {'cores', 'ram', 'instances'} {{(pid=120415) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 17:41:10.033711 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-80085657-18ba-4843-8cff-47f182d3d45a tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Going to run 1 instances... {{(pid=120415) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 17:41:10.036100 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-80085657-18ba-4843-8cff-47f182d3d45a tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: ac4aee12-09e3-4073-aa67-c109242e5f8e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9355bd92-0a49-42cd-b079-ff9f0d54b91b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120415) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 17:41:10.084395 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-80085657-18ba-4843-8cff-47f182d3d45a tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.623661 Sep 27 17:41:10.085046 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 604/1231] 10.222.0.55 () {60 vars in 1147 bytes} [Tue Sep 27 17:41:09 2022] POST /compute/v2.1/servers => generated 402 bytes in 625 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 17:41:10.097098 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-43075850-f96b-481e-b125-8ffc7271bc7f tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:41:10.097838 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-43075850-f96b-481e-b125-8ffc7271bc7f tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: ac4aee12-09e3-4073-aa67-c109242e5f8e] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:41:10.154480 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-43075850-f96b-481e-b125-8ffc7271bc7f tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b888fd409954909874b5443cfed2838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd65ea59a6d41219ecf99f5a554056a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:41:10.161467 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-43075850-f96b-481e-b125-8ffc7271bc7f tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "GET /compute/v2.1/servers/ac4aee12-09e3-4073-aa67-c109242e5f8e" status: 200 len: 1238 microversion: 2.1 time: 0.068935 Sep 27 17:41:10.162030 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 628/1232] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:41:10 2022] GET /compute/v2.1/servers/ac4aee12-09e3-4073-aa67-c109242e5f8e => generated 1238 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:41:11.185691 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-01e10127-2362-4c5e-9533-1750c57a52f9 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:41:11.186261 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-01e10127-2362-4c5e-9533-1750c57a52f9 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: ac4aee12-09e3-4073-aa67-c109242e5f8e] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:41:11.193951 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-01e10127-2362-4c5e-9533-1750c57a52f9 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:41:11.194468 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-01e10127-2362-4c5e-9533-1750c57a52f9 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:41:11.194907 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-01e10127-2362-4c5e-9533-1750c57a52f9 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:41:11.195605 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-01e10127-2362-4c5e-9533-1750c57a52f9 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:41:11.196059 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-01e10127-2362-4c5e-9533-1750c57a52f9 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:41:11.196481 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-01e10127-2362-4c5e-9533-1750c57a52f9 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:41:11.298991 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-01e10127-2362-4c5e-9533-1750c57a52f9 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b888fd409954909874b5443cfed2838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd65ea59a6d41219ecf99f5a554056a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:41:11.307563 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-01e10127-2362-4c5e-9533-1750c57a52f9 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "GET /compute/v2.1/servers/ac4aee12-09e3-4073-aa67-c109242e5f8e" status: 200 len: 1298 microversion: 2.1 time: 0.126588 Sep 27 17:41:11.308759 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 605/1233] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:41:11 2022] GET /compute/v2.1/servers/ac4aee12-09e3-4073-aa67-c109242e5f8e => generated 1298 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:41:12.332229 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-3847649d-c4dd-4d6c-901b-8367385e28b1 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:41:12.332884 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-3847649d-c4dd-4d6c-901b-8367385e28b1 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: ac4aee12-09e3-4073-aa67-c109242e5f8e] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:41:12.339277 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3847649d-c4dd-4d6c-901b-8367385e28b1 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:41:12.339749 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3847649d-c4dd-4d6c-901b-8367385e28b1 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:41:12.340180 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3847649d-c4dd-4d6c-901b-8367385e28b1 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:41:12.340877 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3847649d-c4dd-4d6c-901b-8367385e28b1 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:41:12.341326 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3847649d-c4dd-4d6c-901b-8367385e28b1 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:41:12.341928 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-3847649d-c4dd-4d6c-901b-8367385e28b1 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:41:12.554710 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-3847649d-c4dd-4d6c-901b-8367385e28b1 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b888fd409954909874b5443cfed2838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd65ea59a6d41219ecf99f5a554056a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:41:12.562475 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-3847649d-c4dd-4d6c-901b-8367385e28b1 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "GET /compute/v2.1/servers/ac4aee12-09e3-4073-aa67-c109242e5f8e" status: 200 len: 1364 microversion: 2.1 time: 0.234837 Sep 27 17:41:12.563303 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 629/1234] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:41:12 2022] GET /compute/v2.1/servers/ac4aee12-09e3-4073-aa67-c109242e5f8e => generated 1364 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:41:12.778414 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [req-8c3d855d-71bd-48db-b0cc-37d6e606bd92 req-547e23d5-1a3c-4145-ac1c-c5e73afea2fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac4aee12-09e3-4073-aa67-c109242e5f8e", "tag": "a7b5c807-8a9f-4a64-98f2-6239b368508a"}]} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:41:12.790296 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-8c3d855d-71bd-48db-b0cc-37d6e606bd92 req-547e23d5-1a3c-4145-ac1c-c5e73afea2fd service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:41:12.790782 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-8c3d855d-71bd-48db-b0cc-37d6e606bd92 req-547e23d5-1a3c-4145-ac1c-c5e73afea2fd service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:41:12.791237 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-8c3d855d-71bd-48db-b0cc-37d6e606bd92 req-547e23d5-1a3c-4145-ac1c-c5e73afea2fd service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:41:12.803117 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.compute.server_external_events [req-8c3d855d-71bd-48db-b0cc-37d6e606bd92 req-547e23d5-1a3c-4145-ac1c-c5e73afea2fd service nova] Creating event network-changed:a7b5c807-8a9f-4a64-98f2-6239b368508a for instance ac4aee12-09e3-4073-aa67-c109242e5f8e on hv-cinder-84914 Sep 27 17:41:12.807964 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [req-8c3d855d-71bd-48db-b0cc-37d6e606bd92 req-547e23d5-1a3c-4145-ac1c-c5e73afea2fd service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033376 Sep 27 17:41:12.808557 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 606/1235] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:41:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:41:13.586563 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-021f38d5-7f4f-40f5-bc85-e395522d6079 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:41:13.587165 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-021f38d5-7f4f-40f5-bc85-e395522d6079 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: ac4aee12-09e3-4073-aa67-c109242e5f8e] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:41:13.593530 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-021f38d5-7f4f-40f5-bc85-e395522d6079 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:41:13.594000 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-021f38d5-7f4f-40f5-bc85-e395522d6079 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:41:13.594469 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-021f38d5-7f4f-40f5-bc85-e395522d6079 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:41:13.595144 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-021f38d5-7f4f-40f5-bc85-e395522d6079 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:41:13.595587 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-021f38d5-7f4f-40f5-bc85-e395522d6079 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:41:13.596004 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-021f38d5-7f4f-40f5-bc85-e395522d6079 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:41:13.720172 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-021f38d5-7f4f-40f5-bc85-e395522d6079 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b888fd409954909874b5443cfed2838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd65ea59a6d41219ecf99f5a554056a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:41:13.727695 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-021f38d5-7f4f-40f5-bc85-e395522d6079 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "GET /compute/v2.1/servers/ac4aee12-09e3-4073-aa67-c109242e5f8e" status: 200 len: 1364 microversion: 2.1 time: 0.144958 Sep 27 17:41:13.728248 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 630/1236] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:41:13 2022] GET /compute/v2.1/servers/ac4aee12-09e3-4073-aa67-c109242e5f8e => generated 1364 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:41:14.751692 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-4ee95ab2-52e9-42a2-b89b-7b2e14822dfb tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:41:14.752393 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-4ee95ab2-52e9-42a2-b89b-7b2e14822dfb tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: ac4aee12-09e3-4073-aa67-c109242e5f8e] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:41:14.758508 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4ee95ab2-52e9-42a2-b89b-7b2e14822dfb tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:41:14.758989 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4ee95ab2-52e9-42a2-b89b-7b2e14822dfb tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:41:14.759425 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4ee95ab2-52e9-42a2-b89b-7b2e14822dfb tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:41:14.760112 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4ee95ab2-52e9-42a2-b89b-7b2e14822dfb tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:41:14.760568 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4ee95ab2-52e9-42a2-b89b-7b2e14822dfb tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:41:14.760989 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4ee95ab2-52e9-42a2-b89b-7b2e14822dfb tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:41:14.890021 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-4ee95ab2-52e9-42a2-b89b-7b2e14822dfb tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b888fd409954909874b5443cfed2838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd65ea59a6d41219ecf99f5a554056a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:41:14.898043 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-4ee95ab2-52e9-42a2-b89b-7b2e14822dfb tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "GET /compute/v2.1/servers/ac4aee12-09e3-4073-aa67-c109242e5f8e" status: 200 len: 1364 microversion: 2.1 time: 0.151091 Sep 27 17:41:14.898631 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 607/1237] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:41:14 2022] GET /compute/v2.1/servers/ac4aee12-09e3-4073-aa67-c109242e5f8e => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:41:15.920620 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-83ad14e0-ca45-494f-b93a-a69d0e5ca6be tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:41:15.921232 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-83ad14e0-ca45-494f-b93a-a69d0e5ca6be tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: ac4aee12-09e3-4073-aa67-c109242e5f8e] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:41:15.927819 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-83ad14e0-ca45-494f-b93a-a69d0e5ca6be tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:41:15.928303 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-83ad14e0-ca45-494f-b93a-a69d0e5ca6be tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:41:15.928740 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-83ad14e0-ca45-494f-b93a-a69d0e5ca6be tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:41:15.929431 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-83ad14e0-ca45-494f-b93a-a69d0e5ca6be tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:41:15.929885 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-83ad14e0-ca45-494f-b93a-a69d0e5ca6be tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:41:15.930339 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-83ad14e0-ca45-494f-b93a-a69d0e5ca6be tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:41:16.055728 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-83ad14e0-ca45-494f-b93a-a69d0e5ca6be tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b888fd409954909874b5443cfed2838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd65ea59a6d41219ecf99f5a554056a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:41:16.063213 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-83ad14e0-ca45-494f-b93a-a69d0e5ca6be tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "GET /compute/v2.1/servers/ac4aee12-09e3-4073-aa67-c109242e5f8e" status: 200 len: 1364 microversion: 2.1 time: 0.146645 Sep 27 17:41:16.063776 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 631/1238] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:41:15 2022] GET /compute/v2.1/servers/ac4aee12-09e3-4073-aa67-c109242e5f8e => generated 1364 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:41:17.086181 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-7024b37d-a076-4a00-9f77-a561fdef76af tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:41:17.086732 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-7024b37d-a076-4a00-9f77-a561fdef76af tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: ac4aee12-09e3-4073-aa67-c109242e5f8e] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:41:17.093287 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7024b37d-a076-4a00-9f77-a561fdef76af tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:41:17.093768 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7024b37d-a076-4a00-9f77-a561fdef76af tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:41:17.094238 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7024b37d-a076-4a00-9f77-a561fdef76af tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:41:17.094918 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7024b37d-a076-4a00-9f77-a561fdef76af tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:41:17.095391 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7024b37d-a076-4a00-9f77-a561fdef76af tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:41:17.095820 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7024b37d-a076-4a00-9f77-a561fdef76af tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:41:17.224151 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-7024b37d-a076-4a00-9f77-a561fdef76af tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b888fd409954909874b5443cfed2838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd65ea59a6d41219ecf99f5a554056a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:41:17.231754 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-7024b37d-a076-4a00-9f77-a561fdef76af tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "GET /compute/v2.1/servers/ac4aee12-09e3-4073-aa67-c109242e5f8e" status: 200 len: 1364 microversion: 2.1 time: 0.149595 Sep 27 17:41:17.232323 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 608/1239] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:41:17 2022] GET /compute/v2.1/servers/ac4aee12-09e3-4073-aa67-c109242e5f8e => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:41:18.255642 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-36b52510-a377-4b51-9a20-f26465550be1 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:41:18.256473 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-36b52510-a377-4b51-9a20-f26465550be1 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: ac4aee12-09e3-4073-aa67-c109242e5f8e] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:41:18.263484 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-36b52510-a377-4b51-9a20-f26465550be1 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:41:18.263883 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-36b52510-a377-4b51-9a20-f26465550be1 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:41:18.264316 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-36b52510-a377-4b51-9a20-f26465550be1 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:41:18.265007 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-36b52510-a377-4b51-9a20-f26465550be1 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:41:18.265459 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-36b52510-a377-4b51-9a20-f26465550be1 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:41:18.265882 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-36b52510-a377-4b51-9a20-f26465550be1 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:41:18.391173 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-36b52510-a377-4b51-9a20-f26465550be1 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b888fd409954909874b5443cfed2838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd65ea59a6d41219ecf99f5a554056a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:41:18.398670 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-36b52510-a377-4b51-9a20-f26465550be1 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "GET /compute/v2.1/servers/ac4aee12-09e3-4073-aa67-c109242e5f8e" status: 200 len: 1364 microversion: 2.1 time: 0.147393 Sep 27 17:41:18.399229 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 632/1240] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:41:18 2022] GET /compute/v2.1/servers/ac4aee12-09e3-4073-aa67-c109242e5f8e => generated 1364 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:41:19.420720 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-8c4e68c6-0c59-4539-be09-0b1676640865 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:41:19.421299 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-8c4e68c6-0c59-4539-be09-0b1676640865 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: ac4aee12-09e3-4073-aa67-c109242e5f8e] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:41:19.427710 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8c4e68c6-0c59-4539-be09-0b1676640865 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:41:19.428186 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8c4e68c6-0c59-4539-be09-0b1676640865 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:41:19.428614 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8c4e68c6-0c59-4539-be09-0b1676640865 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:41:19.429292 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8c4e68c6-0c59-4539-be09-0b1676640865 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:41:19.429732 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8c4e68c6-0c59-4539-be09-0b1676640865 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:41:19.430173 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8c4e68c6-0c59-4539-be09-0b1676640865 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:41:19.561320 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-8c4e68c6-0c59-4539-be09-0b1676640865 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b888fd409954909874b5443cfed2838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd65ea59a6d41219ecf99f5a554056a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:41:19.566967 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [req-2c84160c-b6d1-481b-86a7-3bdb9c1569ea req-478ad0cb-91c7-44cf-871e-fb5aeba9ba50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac4aee12-09e3-4073-aa67-c109242e5f8e", "name": "network-vif-plugged", "status": "completed", "tag": "a7b5c807-8a9f-4a64-98f2-6239b368508a"}]} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:41:19.569814 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-8c4e68c6-0c59-4539-be09-0b1676640865 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "GET /compute/v2.1/servers/ac4aee12-09e3-4073-aa67-c109242e5f8e" status: 200 len: 1364 microversion: 2.1 time: 0.152863 Sep 27 17:41:19.570374 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 609/1241] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:41:19 2022] GET /compute/v2.1/servers/ac4aee12-09e3-4073-aa67-c109242e5f8e => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:41:19.578335 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-2c84160c-b6d1-481b-86a7-3bdb9c1569ea req-478ad0cb-91c7-44cf-871e-fb5aeba9ba50 service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:41:19.578808 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-2c84160c-b6d1-481b-86a7-3bdb9c1569ea req-478ad0cb-91c7-44cf-871e-fb5aeba9ba50 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:41:19.579234 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-2c84160c-b6d1-481b-86a7-3bdb9c1569ea req-478ad0cb-91c7-44cf-871e-fb5aeba9ba50 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:41:19.590687 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.compute.server_external_events [req-2c84160c-b6d1-481b-86a7-3bdb9c1569ea req-478ad0cb-91c7-44cf-871e-fb5aeba9ba50 service nova] Creating event network-vif-plugged:a7b5c807-8a9f-4a64-98f2-6239b368508a for instance ac4aee12-09e3-4073-aa67-c109242e5f8e on hv-cinder-84914 Sep 27 17:41:19.595449 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [req-2c84160c-b6d1-481b-86a7-3bdb9c1569ea req-478ad0cb-91c7-44cf-871e-fb5aeba9ba50 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090404 Sep 27 17:41:19.596013 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 633/1242] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:41:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 17:41:20.592744 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-52145592-bd79-4ae9-a782-8b6fee01eb88 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:41:20.593357 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-52145592-bd79-4ae9-a782-8b6fee01eb88 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: ac4aee12-09e3-4073-aa67-c109242e5f8e] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:41:20.595996 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell0:SELECT=2 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:41:20.596689 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell0:SELECT=6 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:41:20.603243 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-52145592-bd79-4ae9-a782-8b6fee01eb88 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:41:20.603726 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-52145592-bd79-4ae9-a782-8b6fee01eb88 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:41:20.604164 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-52145592-bd79-4ae9-a782-8b6fee01eb88 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:41:20.604857 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-52145592-bd79-4ae9-a782-8b6fee01eb88 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:41:20.605315 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-52145592-bd79-4ae9-a782-8b6fee01eb88 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:41:20.605737 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-52145592-bd79-4ae9-a782-8b6fee01eb88 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:41:20.731138 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-52145592-bd79-4ae9-a782-8b6fee01eb88 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b888fd409954909874b5443cfed2838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd65ea59a6d41219ecf99f5a554056a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:41:20.738658 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-52145592-bd79-4ae9-a782-8b6fee01eb88 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "GET /compute/v2.1/servers/ac4aee12-09e3-4073-aa67-c109242e5f8e" status: 200 len: 1364 microversion: 2.1 time: 0.149737 Sep 27 17:41:20.739224 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 610/1243] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:41:20 2022] GET /compute/v2.1/servers/ac4aee12-09e3-4073-aa67-c109242e5f8e => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:41:21.758087 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_cell0:SELECT=6 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:41:21.762878 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-7f18d6e7-bbcc-43c9-a3ca-9bef7aad8995 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:41:21.763578 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-7f18d6e7-bbcc-43c9-a3ca-9bef7aad8995 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: ac4aee12-09e3-4073-aa67-c109242e5f8e] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:41:21.769902 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7f18d6e7-bbcc-43c9-a3ca-9bef7aad8995 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:41:21.770415 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7f18d6e7-bbcc-43c9-a3ca-9bef7aad8995 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:41:21.770856 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7f18d6e7-bbcc-43c9-a3ca-9bef7aad8995 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:41:21.771546 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7f18d6e7-bbcc-43c9-a3ca-9bef7aad8995 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:41:21.772003 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7f18d6e7-bbcc-43c9-a3ca-9bef7aad8995 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:41:21.772427 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7f18d6e7-bbcc-43c9-a3ca-9bef7aad8995 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:41:21.903771 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-7f18d6e7-bbcc-43c9-a3ca-9bef7aad8995 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b888fd409954909874b5443cfed2838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd65ea59a6d41219ecf99f5a554056a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:41:21.911910 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-7f18d6e7-bbcc-43c9-a3ca-9bef7aad8995 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "GET /compute/v2.1/servers/ac4aee12-09e3-4073-aa67-c109242e5f8e" status: 200 len: 1551 microversion: 2.1 time: 0.154808 Sep 27 17:41:21.912466 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 634/1244] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:41:21 2022] GET /compute/v2.1/servers/ac4aee12-09e3-4073-aa67-c109242e5f8e => generated 1551 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:41:21.934694 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-f2cc3f61-abae-4e59-bf20-4b2f34ba689b tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:41:21.935208 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-f2cc3f61-abae-4e59-bf20-4b2f34ba689b tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: ac4aee12-09e3-4073-aa67-c109242e5f8e] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:41:21.941567 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f2cc3f61-abae-4e59-bf20-4b2f34ba689b tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:41:21.942046 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f2cc3f61-abae-4e59-bf20-4b2f34ba689b tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:41:21.942513 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f2cc3f61-abae-4e59-bf20-4b2f34ba689b tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:41:21.943196 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f2cc3f61-abae-4e59-bf20-4b2f34ba689b tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:41:21.943646 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f2cc3f61-abae-4e59-bf20-4b2f34ba689b tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:41:21.944068 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f2cc3f61-abae-4e59-bf20-4b2f34ba689b tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:41:22.022176 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-f2cc3f61-abae-4e59-bf20-4b2f34ba689b tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "GET /compute/v2.1/servers/ac4aee12-09e3-4073-aa67-c109242e5f8e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091253 Sep 27 17:41:22.022774 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 611/1245] 10.222.0.55 () {58 vars in 1275 bytes} [Tue Sep 27 17:41:21 2022] GET /compute/v2.1/servers/ac4aee12-09e3-4073-aa67-c109242e5f8e/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:41:22.979463 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [req-0ab388ee-684b-4c1c-a306-b0f9baa6418b req-6520e44f-ebc5-42af-bcfb-a607a9d337a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac4aee12-09e3-4073-aa67-c109242e5f8e", "tag": "a7b5c807-8a9f-4a64-98f2-6239b368508a"}]} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:41:22.991406 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-0ab388ee-684b-4c1c-a306-b0f9baa6418b req-6520e44f-ebc5-42af-bcfb-a607a9d337a9 service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:41:22.992366 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-0ab388ee-684b-4c1c-a306-b0f9baa6418b req-6520e44f-ebc5-42af-bcfb-a607a9d337a9 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:41:22.992366 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-0ab388ee-684b-4c1c-a306-b0f9baa6418b req-6520e44f-ebc5-42af-bcfb-a607a9d337a9 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:41:23.003863 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.compute.server_external_events [req-0ab388ee-684b-4c1c-a306-b0f9baa6418b req-6520e44f-ebc5-42af-bcfb-a607a9d337a9 service nova] Creating event network-changed:a7b5c807-8a9f-4a64-98f2-6239b368508a for instance ac4aee12-09e3-4073-aa67-c109242e5f8e on hv-cinder-84914 Sep 27 17:41:23.009340 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [req-0ab388ee-684b-4c1c-a306-b0f9baa6418b req-6520e44f-ebc5-42af-bcfb-a607a9d337a9 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033457 Sep 27 17:41:23.010050 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 635/1246] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:41:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:42:38.239897 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:42:38.240636 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell1:SELECT=64 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:42:38.362344 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-8c7ea0ea-2e7b-42b2-b5ea-bce4ab8b211d tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:42:38.362846 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-8c7ea0ea-2e7b-42b2-b5ea-bce4ab8b211d tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: ac4aee12-09e3-4073-aa67-c109242e5f8e] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:42:38.368958 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8c7ea0ea-2e7b-42b2-b5ea-bce4ab8b211d tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:42:38.369433 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8c7ea0ea-2e7b-42b2-b5ea-bce4ab8b211d tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:42:38.369864 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8c7ea0ea-2e7b-42b2-b5ea-bce4ab8b211d tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:42:38.370642 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8c7ea0ea-2e7b-42b2-b5ea-bce4ab8b211d tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:42:38.371096 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8c7ea0ea-2e7b-42b2-b5ea-bce4ab8b211d tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:42:38.371515 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8c7ea0ea-2e7b-42b2-b5ea-bce4ab8b211d tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:42:38.395145 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-8c7ea0ea-2e7b-42b2-b5ea-bce4ab8b211d tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "GET /compute/v2.1/servers/ac4aee12-09e3-4073-aa67-c109242e5f8e/ips" status: 200 len: 146 microversion: 2.1 time: 0.158191 Sep 27 17:42:38.395684 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 612/1247] 10.222.0.55 () {58 vars in 1248 bytes} [Tue Sep 27 17:42:38 2022] GET /compute/v2.1/servers/ac4aee12-09e3-4073-aa67-c109242e5f8e/ips => generated 146 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:42:39.720163 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 27 17:42:39.720682 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Tue Sep 27 17:42:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ac4aee12-09e3-4073-aa67-c109242e5f8e/os-volume_attachments (ip 10.222.0.55) !!! Sep 27 17:42:39.721630 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:42:39.722205 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:42:39.727152 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-10aea040-b025-4bda-bfeb-45ba80084a34 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "379f11cf-c555-457c-b24a-ead4fe6fd83a"}} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:42:39.729568 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-10aea040-b025-4bda-bfeb-45ba80084a34 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: ac4aee12-09e3-4073-aa67-c109242e5f8e] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:42:39.739881 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-10aea040-b025-4bda-bfeb-45ba80084a34 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:42:39.740354 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-10aea040-b025-4bda-bfeb-45ba80084a34 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:42:39.741049 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-10aea040-b025-4bda-bfeb-45ba80084a34 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:42:39.741737 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-10aea040-b025-4bda-bfeb-45ba80084a34 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:42:39.742229 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-10aea040-b025-4bda-bfeb-45ba80084a34 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:42:39.742652 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-10aea040-b025-4bda-bfeb-45ba80084a34 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:42:39.988369 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-10aea040-b025-4bda-bfeb-45ba80084a34 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "POST /compute/v2.1/servers/ac4aee12-09e3-4073-aa67-c109242e5f8e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.269969 Sep 27 17:42:39.988960 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 636/1248] 10.222.0.55 () {60 vars in 1323 bytes} [Tue Sep 27 17:42:39 2022] POST /compute/v2.1/servers/ac4aee12-09e3-4073-aa67-c109242e5f8e/os-volume_attachments => generated 194 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:42:47.527271 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-630136a6-1615-433c-a693-2ac318e12312 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:42:47.529482 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-630136a6-1615-433c-a693-2ac318e12312 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: ac4aee12-09e3-4073-aa67-c109242e5f8e] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:42:47.536519 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-630136a6-1615-433c-a693-2ac318e12312 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:42:47.536990 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-630136a6-1615-433c-a693-2ac318e12312 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:42:47.537418 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-630136a6-1615-433c-a693-2ac318e12312 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:42:47.538114 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-630136a6-1615-433c-a693-2ac318e12312 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:42:47.538599 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-630136a6-1615-433c-a693-2ac318e12312 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:42:47.539019 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-630136a6-1615-433c-a693-2ac318e12312 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:42:47.567251 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-630136a6-1615-433c-a693-2ac318e12312 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "GET /compute/v2.1/servers/ac4aee12-09e3-4073-aa67-c109242e5f8e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043925 Sep 27 17:42:47.567795 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 613/1249] 10.222.0.55 () {58 vars in 1302 bytes} [Tue Sep 27 17:42:47 2022] GET /compute/v2.1/servers/ac4aee12-09e3-4073-aa67-c109242e5f8e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:42:47.580347 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-05a2f692-73b2-4a42-9397-17f303ccfa06 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:42:47.580854 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-05a2f692-73b2-4a42-9397-17f303ccfa06 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: ac4aee12-09e3-4073-aa67-c109242e5f8e] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:42:47.587119 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-05a2f692-73b2-4a42-9397-17f303ccfa06 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:42:47.587587 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-05a2f692-73b2-4a42-9397-17f303ccfa06 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:42:47.588009 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-05a2f692-73b2-4a42-9397-17f303ccfa06 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:42:47.588687 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-05a2f692-73b2-4a42-9397-17f303ccfa06 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:42:47.589131 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-05a2f692-73b2-4a42-9397-17f303ccfa06 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:42:47.589546 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-05a2f692-73b2-4a42-9397-17f303ccfa06 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:42:47.618232 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-05a2f692-73b2-4a42-9397-17f303ccfa06 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "GET /compute/v2.1/servers/ac4aee12-09e3-4073-aa67-c109242e5f8e/os-volume_attachments/379f11cf-c555-457c-b24a-ead4fe6fd83a" status: 200 len: 194 microversion: 2.1 time: 0.043595 Sep 27 17:42:47.618791 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 637/1250] 10.222.0.55 () {58 vars in 1413 bytes} [Tue Sep 27 17:42:47 2022] GET /compute/v2.1/servers/ac4aee12-09e3-4073-aa67-c109242e5f8e/os-volume_attachments/379f11cf-c555-457c-b24a-ead4fe6fd83a => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:42:48.946928 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-3bedd10f-e698-45fe-abd4-7da9789b45fa tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aacd120b-24fd-4fb1-99cb-c200b4470a9f"}} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:42:48.949318 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-3bedd10f-e698-45fe-abd4-7da9789b45fa tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: ac4aee12-09e3-4073-aa67-c109242e5f8e] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:42:48.955804 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3bedd10f-e698-45fe-abd4-7da9789b45fa tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:42:48.956284 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3bedd10f-e698-45fe-abd4-7da9789b45fa tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:42:48.956720 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3bedd10f-e698-45fe-abd4-7da9789b45fa tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:42:48.957402 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3bedd10f-e698-45fe-abd4-7da9789b45fa tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:42:48.957858 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3bedd10f-e698-45fe-abd4-7da9789b45fa tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:42:48.958307 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3bedd10f-e698-45fe-abd4-7da9789b45fa tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:42:49.207700 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-3bedd10f-e698-45fe-abd4-7da9789b45fa tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "POST /compute/v2.1/servers/ac4aee12-09e3-4073-aa67-c109242e5f8e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.264485 Sep 27 17:42:49.208373 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 614/1251] 10.222.0.55 () {60 vars in 1323 bytes} [Tue Sep 27 17:42:48 2022] POST /compute/v2.1/servers/ac4aee12-09e3-4073-aa67-c109242e5f8e/os-volume_attachments => generated 194 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:42:56.742670 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-fd208876-f864-4c67-a8cb-12abf936fcd7 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:42:56.744900 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-fd208876-f864-4c67-a8cb-12abf936fcd7 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: ac4aee12-09e3-4073-aa67-c109242e5f8e] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:42:56.752255 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-fd208876-f864-4c67-a8cb-12abf936fcd7 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:42:56.752773 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-fd208876-f864-4c67-a8cb-12abf936fcd7 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:42:56.753210 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-fd208876-f864-4c67-a8cb-12abf936fcd7 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:42:56.753906 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-fd208876-f864-4c67-a8cb-12abf936fcd7 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:42:56.754399 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-fd208876-f864-4c67-a8cb-12abf936fcd7 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:42:56.754828 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-fd208876-f864-4c67-a8cb-12abf936fcd7 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:42:56.792499 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-fd208876-f864-4c67-a8cb-12abf936fcd7 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "GET /compute/v2.1/servers/ac4aee12-09e3-4073-aa67-c109242e5f8e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.054017 Sep 27 17:42:56.793136 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 638/1252] 10.222.0.55 () {58 vars in 1302 bytes} [Tue Sep 27 17:42:56 2022] GET /compute/v2.1/servers/ac4aee12-09e3-4073-aa67-c109242e5f8e/os-volume_attachments => generated 371 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:42:56.941706 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-f002c61f-6d27-4425-bdb7-1b25d0496093 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:42:56.942286 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-f002c61f-6d27-4425-bdb7-1b25d0496093 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: ac4aee12-09e3-4073-aa67-c109242e5f8e] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:42:56.948367 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f002c61f-6d27-4425-bdb7-1b25d0496093 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:42:56.948849 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f002c61f-6d27-4425-bdb7-1b25d0496093 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:42:56.949288 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f002c61f-6d27-4425-bdb7-1b25d0496093 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:42:56.949976 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f002c61f-6d27-4425-bdb7-1b25d0496093 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:42:56.950460 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f002c61f-6d27-4425-bdb7-1b25d0496093 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:42:56.950889 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f002c61f-6d27-4425-bdb7-1b25d0496093 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:42:56.978991 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-f002c61f-6d27-4425-bdb7-1b25d0496093 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "GET /compute/v2.1/servers/ac4aee12-09e3-4073-aa67-c109242e5f8e/os-volume_attachments/379f11cf-c555-457c-b24a-ead4fe6fd83a" status: 200 len: 194 microversion: 2.1 time: 0.042288 Sep 27 17:42:56.979546 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 615/1253] 10.222.0.55 () {58 vars in 1413 bytes} [Tue Sep 27 17:42:56 2022] GET /compute/v2.1/servers/ac4aee12-09e3-4073-aa67-c109242e5f8e/os-volume_attachments/379f11cf-c555-457c-b24a-ead4fe6fd83a => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:42:56.990619 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-0eb63d21-b655-4b47-ae97-46d42b644ed7 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:42:56.991381 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-0eb63d21-b655-4b47-ae97-46d42b644ed7 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: ac4aee12-09e3-4073-aa67-c109242e5f8e] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:42:56.997150 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-0eb63d21-b655-4b47-ae97-46d42b644ed7 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:42:56.997618 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-0eb63d21-b655-4b47-ae97-46d42b644ed7 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:42:56.998098 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-0eb63d21-b655-4b47-ae97-46d42b644ed7 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:42:56.998774 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-0eb63d21-b655-4b47-ae97-46d42b644ed7 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:42:56.999277 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-0eb63d21-b655-4b47-ae97-46d42b644ed7 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:42:56.999688 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-0eb63d21-b655-4b47-ae97-46d42b644ed7 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:42:57.078577 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.objects.instance [None req-0eb63d21-b655-4b47-ae97-46d42b644ed7 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lazy-loading 'services' on Instance uuid ac4aee12-09e3-4073-aa67-c109242e5f8e {{(pid=120416) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 17:42:57.149598 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-0eb63d21-b655-4b47-ae97-46d42b644ed7 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "DELETE /compute/v2.1/servers/ac4aee12-09e3-4073-aa67-c109242e5f8e/os-volume_attachments/379f11cf-c555-457c-b24a-ead4fe6fd83a" status: 202 len: 0 microversion: 2.1 time: 0.162673 Sep 27 17:42:57.150215 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 639/1254] 10.222.0.55 () {58 vars in 1416 bytes} [Tue Sep 27 17:42:56 2022] DELETE /compute/v2.1/servers/ac4aee12-09e3-4073-aa67-c109242e5f8e/os-volume_attachments/379f11cf-c555-457c-b24a-ead4fe6fd83a => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 17:42:58.273141 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-69ee48af-c715-4830-ab07-3ab5adf10c90 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:42:58.273656 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-69ee48af-c715-4830-ab07-3ab5adf10c90 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: ac4aee12-09e3-4073-aa67-c109242e5f8e] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:42:58.280075 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-69ee48af-c715-4830-ab07-3ab5adf10c90 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:42:58.280557 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-69ee48af-c715-4830-ab07-3ab5adf10c90 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:42:58.281019 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-69ee48af-c715-4830-ab07-3ab5adf10c90 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:42:58.281701 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-69ee48af-c715-4830-ab07-3ab5adf10c90 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:42:58.282187 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-69ee48af-c715-4830-ab07-3ab5adf10c90 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:42:58.282611 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-69ee48af-c715-4830-ab07-3ab5adf10c90 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:42:58.311534 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-69ee48af-c715-4830-ab07-3ab5adf10c90 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "GET /compute/v2.1/servers/ac4aee12-09e3-4073-aa67-c109242e5f8e/os-volume_attachments/aacd120b-24fd-4fb1-99cb-c200b4470a9f" status: 200 len: 194 microversion: 2.1 time: 0.042407 Sep 27 17:42:58.312119 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 616/1255] 10.222.0.55 () {58 vars in 1413 bytes} [Tue Sep 27 17:42:58 2022] GET /compute/v2.1/servers/ac4aee12-09e3-4073-aa67-c109242e5f8e/os-volume_attachments/aacd120b-24fd-4fb1-99cb-c200b4470a9f => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:42:58.324302 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-549dbd64-630e-465d-b191-ae0543d31c0d tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:42:58.324912 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-549dbd64-630e-465d-b191-ae0543d31c0d tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: ac4aee12-09e3-4073-aa67-c109242e5f8e] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:42:58.331101 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-549dbd64-630e-465d-b191-ae0543d31c0d tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:42:58.331582 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-549dbd64-630e-465d-b191-ae0543d31c0d tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:42:58.332018 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-549dbd64-630e-465d-b191-ae0543d31c0d tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:42:58.332702 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-549dbd64-630e-465d-b191-ae0543d31c0d tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:42:58.333157 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-549dbd64-630e-465d-b191-ae0543d31c0d tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:42:58.333585 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-549dbd64-630e-465d-b191-ae0543d31c0d tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:42:58.412573 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.objects.instance [None req-549dbd64-630e-465d-b191-ae0543d31c0d tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lazy-loading 'services' on Instance uuid ac4aee12-09e3-4073-aa67-c109242e5f8e {{(pid=120416) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 17:42:58.481867 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-549dbd64-630e-465d-b191-ae0543d31c0d tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "DELETE /compute/v2.1/servers/ac4aee12-09e3-4073-aa67-c109242e5f8e/os-volume_attachments/aacd120b-24fd-4fb1-99cb-c200b4470a9f" status: 202 len: 0 microversion: 2.1 time: 0.162117 Sep 27 17:42:58.482491 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 640/1256] 10.222.0.55 () {58 vars in 1416 bytes} [Tue Sep 27 17:42:58 2022] DELETE /compute/v2.1/servers/ac4aee12-09e3-4073-aa67-c109242e5f8e/os-volume_attachments/aacd120b-24fd-4fb1-99cb-c200b4470a9f => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 17:42:59.658537 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-eea874b1-318c-4a58-8e93-964b282a097f tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:42:59.660718 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-eea874b1-318c-4a58-8e93-964b282a097f tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: ac4aee12-09e3-4073-aa67-c109242e5f8e] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:42:59.667344 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-eea874b1-318c-4a58-8e93-964b282a097f tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:42:59.667828 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-eea874b1-318c-4a58-8e93-964b282a097f tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:42:59.668264 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-eea874b1-318c-4a58-8e93-964b282a097f tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:42:59.668949 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-eea874b1-318c-4a58-8e93-964b282a097f tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:42:59.669400 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-eea874b1-318c-4a58-8e93-964b282a097f tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:42:59.669829 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-eea874b1-318c-4a58-8e93-964b282a097f tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:42:59.698716 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-eea874b1-318c-4a58-8e93-964b282a097f tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "GET /compute/v2.1/servers/ac4aee12-09e3-4073-aa67-c109242e5f8e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044197 Sep 27 17:42:59.699264 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 617/1257] 10.222.0.55 () {58 vars in 1302 bytes} [Tue Sep 27 17:42:59 2022] GET /compute/v2.1/servers/ac4aee12-09e3-4073-aa67-c109242e5f8e/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 17:42:59.816252 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-44708c2e-73ee-4e54-80af-7150737a9100 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:42:59.818534 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-44708c2e-73ee-4e54-80af-7150737a9100 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: ac4aee12-09e3-4073-aa67-c109242e5f8e] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:42:59.825134 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-44708c2e-73ee-4e54-80af-7150737a9100 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:42:59.825558 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-44708c2e-73ee-4e54-80af-7150737a9100 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:42:59.825997 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-44708c2e-73ee-4e54-80af-7150737a9100 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:42:59.826714 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-44708c2e-73ee-4e54-80af-7150737a9100 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:42:59.827172 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-44708c2e-73ee-4e54-80af-7150737a9100 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:42:59.827600 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-44708c2e-73ee-4e54-80af-7150737a9100 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:42:59.855532 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-44708c2e-73ee-4e54-80af-7150737a9100 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "GET /compute/v2.1/servers/ac4aee12-09e3-4073-aa67-c109242e5f8e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044218 Sep 27 17:42:59.856074 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 641/1258] 10.222.0.55 () {58 vars in 1302 bytes} [Tue Sep 27 17:42:59 2022] GET /compute/v2.1/servers/ac4aee12-09e3-4073-aa67-c109242e5f8e/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 27 17:42:59.922054 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-cfc4911b-db87-4140-b66c-25d6e4a73c0f tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:42:59.922604 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-cfc4911b-db87-4140-b66c-25d6e4a73c0f tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: ac4aee12-09e3-4073-aa67-c109242e5f8e] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:42:59.929008 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cfc4911b-db87-4140-b66c-25d6e4a73c0f tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:42:59.929489 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cfc4911b-db87-4140-b66c-25d6e4a73c0f tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:42:59.929924 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cfc4911b-db87-4140-b66c-25d6e4a73c0f tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:42:59.930635 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cfc4911b-db87-4140-b66c-25d6e4a73c0f tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:42:59.931092 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cfc4911b-db87-4140-b66c-25d6e4a73c0f tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:42:59.931513 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cfc4911b-db87-4140-b66c-25d6e4a73c0f tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:42:59.955300 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-cfc4911b-db87-4140-b66c-25d6e4a73c0f tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: ac4aee12-09e3-4073-aa67-c109242e5f8e] Going to try to terminate instance {{(pid=120415) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 17:43:00.029288 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-cfc4911b-db87-4140-b66c-25d6e4a73c0f tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "DELETE /compute/v2.1/servers/ac4aee12-09e3-4073-aa67-c109242e5f8e" status: 204 len: 0 microversion: 2.1 time: 0.110466 Sep 27 17:43:00.030140 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 618/1259] 10.222.0.55 () {58 vars in 1239 bytes} [Tue Sep 27 17:42:59 2022] DELETE /compute/v2.1/servers/ac4aee12-09e3-4073-aa67-c109242e5f8e => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 17:43:00.040329 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-b72f8219-fb23-4269-b236-8e3fd213f0f4 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:43:00.040943 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-b72f8219-fb23-4269-b236-8e3fd213f0f4 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: ac4aee12-09e3-4073-aa67-c109242e5f8e] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:43:00.046819 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b72f8219-fb23-4269-b236-8e3fd213f0f4 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:43:00.047299 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b72f8219-fb23-4269-b236-8e3fd213f0f4 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:43:00.047739 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b72f8219-fb23-4269-b236-8e3fd213f0f4 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:43:00.048424 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b72f8219-fb23-4269-b236-8e3fd213f0f4 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:43:00.048880 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b72f8219-fb23-4269-b236-8e3fd213f0f4 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:43:00.049955 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-b72f8219-fb23-4269-b236-8e3fd213f0f4 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:43:00.180147 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-b72f8219-fb23-4269-b236-8e3fd213f0f4 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b888fd409954909874b5443cfed2838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd65ea59a6d41219ecf99f5a554056a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:43:00.187780 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-b72f8219-fb23-4269-b236-8e3fd213f0f4 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "GET /compute/v2.1/servers/ac4aee12-09e3-4073-aa67-c109242e5f8e" status: 200 len: 1675 microversion: 2.1 time: 0.151506 Sep 27 17:43:00.188338 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 642/1260] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:43:00 2022] GET /compute/v2.1/servers/ac4aee12-09e3-4073-aa67-c109242e5f8e => generated 1675 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:43:01.211833 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-40e24f1c-c112-4bb8-b0ef-75960d297109 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:43:01.212534 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-40e24f1c-c112-4bb8-b0ef-75960d297109 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: ac4aee12-09e3-4073-aa67-c109242e5f8e] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:43:01.218951 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-40e24f1c-c112-4bb8-b0ef-75960d297109 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:43:01.219432 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-40e24f1c-c112-4bb8-b0ef-75960d297109 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:43:01.219871 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-40e24f1c-c112-4bb8-b0ef-75960d297109 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:43:01.220557 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-40e24f1c-c112-4bb8-b0ef-75960d297109 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:43:01.221021 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-40e24f1c-c112-4bb8-b0ef-75960d297109 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:43:01.221446 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-40e24f1c-c112-4bb8-b0ef-75960d297109 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:43:01.350721 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-40e24f1c-c112-4bb8-b0ef-75960d297109 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b888fd409954909874b5443cfed2838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd65ea59a6d41219ecf99f5a554056a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:43:01.358331 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-40e24f1c-c112-4bb8-b0ef-75960d297109 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "GET /compute/v2.1/servers/ac4aee12-09e3-4073-aa67-c109242e5f8e" status: 200 len: 1675 microversion: 2.1 time: 0.150723 Sep 27 17:43:01.358894 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 619/1261] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:43:01 2022] GET /compute/v2.1/servers/ac4aee12-09e3-4073-aa67-c109242e5f8e => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:43:02.382672 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-8b5a9c9d-783c-4cd7-a49b-c1b22a91e062 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:43:02.383305 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-8b5a9c9d-783c-4cd7-a49b-c1b22a91e062 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: ac4aee12-09e3-4073-aa67-c109242e5f8e] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:43:02.389583 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8b5a9c9d-783c-4cd7-a49b-c1b22a91e062 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:43:02.390065 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8b5a9c9d-783c-4cd7-a49b-c1b22a91e062 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:43:02.390525 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8b5a9c9d-783c-4cd7-a49b-c1b22a91e062 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:43:02.391227 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8b5a9c9d-783c-4cd7-a49b-c1b22a91e062 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:43:02.391669 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8b5a9c9d-783c-4cd7-a49b-c1b22a91e062 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:43:02.392093 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-8b5a9c9d-783c-4cd7-a49b-c1b22a91e062 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:43:02.639294 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-8b5a9c9d-783c-4cd7-a49b-c1b22a91e062 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b888fd409954909874b5443cfed2838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd65ea59a6d41219ecf99f5a554056a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:43:02.648112 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-8b5a9c9d-783c-4cd7-a49b-c1b22a91e062 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "GET /compute/v2.1/servers/ac4aee12-09e3-4073-aa67-c109242e5f8e" status: 200 len: 1675 microversion: 2.1 time: 0.269201 Sep 27 17:43:02.649002 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 643/1262] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:43:02 2022] GET /compute/v2.1/servers/ac4aee12-09e3-4073-aa67-c109242e5f8e => generated 1675 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:43:03.364117 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [req-979e20c4-ceae-4442-a3b3-42d45bb0663d req-f4423265-14c1-4df2-b20a-3435416a0285 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac4aee12-09e3-4073-aa67-c109242e5f8e", "name": "network-vif-deleted", "tag": "a7b5c807-8a9f-4a64-98f2-6239b368508a"}]} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:43:03.376089 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-979e20c4-ceae-4442-a3b3-42d45bb0663d req-f4423265-14c1-4df2-b20a-3435416a0285 service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:43:03.376657 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-979e20c4-ceae-4442-a3b3-42d45bb0663d req-f4423265-14c1-4df2-b20a-3435416a0285 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:43:03.377160 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-979e20c4-ceae-4442-a3b3-42d45bb0663d req-f4423265-14c1-4df2-b20a-3435416a0285 service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:43:03.394594 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.compute.server_external_events [req-979e20c4-ceae-4442-a3b3-42d45bb0663d req-f4423265-14c1-4df2-b20a-3435416a0285 service nova] Creating event network-vif-deleted:a7b5c807-8a9f-4a64-98f2-6239b368508a for instance ac4aee12-09e3-4073-aa67-c109242e5f8e on hv-cinder-84914 Sep 27 17:43:03.399742 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [req-979e20c4-ceae-4442-a3b3-42d45bb0663d req-f4423265-14c1-4df2-b20a-3435416a0285 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039355 Sep 27 17:43:03.400347 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 620/1263] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:43:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:43:03.671996 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-0e945b2d-5c63-43a8-976d-a514a67ec550 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:43:03.672963 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-0e945b2d-5c63-43a8-976d-a514a67ec550 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: ac4aee12-09e3-4073-aa67-c109242e5f8e] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:43:03.680367 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-0e945b2d-5c63-43a8-976d-a514a67ec550 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:43:03.680856 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-0e945b2d-5c63-43a8-976d-a514a67ec550 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:43:03.681288 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-0e945b2d-5c63-43a8-976d-a514a67ec550 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:43:03.681985 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-0e945b2d-5c63-43a8-976d-a514a67ec550 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:43:03.682560 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-0e945b2d-5c63-43a8-976d-a514a67ec550 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:43:03.683015 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-0e945b2d-5c63-43a8-976d-a514a67ec550 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:43:03.719667 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-0e945b2d-5c63-43a8-976d-a514a67ec550 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:43:03.720147 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-0e945b2d-5c63-43a8-976d-a514a67ec550 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:43:03.720580 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-0e945b2d-5c63-43a8-976d-a514a67ec550 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:43:03.721063 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.objects.instance [None req-0e945b2d-5c63-43a8-976d-a514a67ec550 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lazy-loading 'fault' on Instance uuid ac4aee12-09e3-4073-aa67-c109242e5f8e {{(pid=120416) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 17:43:03.762926 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-0e945b2d-5c63-43a8-976d-a514a67ec550 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b888fd409954909874b5443cfed2838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0bd65ea59a6d41219ecf99f5a554056a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:43:03.771114 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-0e945b2d-5c63-43a8-976d-a514a67ec550 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "GET /compute/v2.1/servers/ac4aee12-09e3-4073-aa67-c109242e5f8e" status: 200 len: 1328 microversion: 2.1 time: 0.103070 Sep 27 17:43:03.771681 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 644/1264] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:43:03 2022] GET /compute/v2.1/servers/ac4aee12-09e3-4073-aa67-c109242e5f8e => generated 1328 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:43:04.795596 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-e38879c9-86f2-407e-b712-d19e46572f6f tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:43:04.796308 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-e38879c9-86f2-407e-b712-d19e46572f6f tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: ac4aee12-09e3-4073-aa67-c109242e5f8e] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:43:04.802915 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e38879c9-86f2-407e-b712-d19e46572f6f tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:43:04.803383 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e38879c9-86f2-407e-b712-d19e46572f6f tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:43:04.803812 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e38879c9-86f2-407e-b712-d19e46572f6f tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:43:04.804486 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e38879c9-86f2-407e-b712-d19e46572f6f tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:43:04.804949 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e38879c9-86f2-407e-b712-d19e46572f6f tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:43:04.805341 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e38879c9-86f2-407e-b712-d19e46572f6f tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:43:04.818146 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.wsgi [None req-e38879c9-86f2-407e-b712-d19e46572f6f tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] HTTP exception thrown: Instance ac4aee12-09e3-4073-aa67-c109242e5f8e could not be found. Sep 27 17:43:04.819730 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-e38879c9-86f2-407e-b712-d19e46572f6f tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Request method failure captured: Sep 27 17:43:04.819730 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: request: GET /compute/v2.1/servers/ac4aee12-09e3-4073-aa67-c109242e5f8e HTTP/1.1 Sep 27 17:43:04.819730 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Accept: application/json Sep 27 17:43:04.819730 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Accept-Encoding: identity Sep 27 17:43:04.819730 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Connection: close Sep 27 17:43:04.819730 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Content-Length: 0 Sep 27 17:43:04.819730 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Content-Type: application/json Sep 27 17:43:04.819730 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Host: 10.222.0.55 Sep 27 17:43:04.819730 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Openstack-System-Scope: None Sep 27 17:43:04.819730 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: User-Agent: python-urllib3/1.26.12 Sep 27 17:43:04.819730 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Auth-Token: gAAAAABjMzSeQwcZWqcXgmVYQr9OX1fPdOc8LbvT3p3K_GqHGottEGJ3nE8beTzy5V-J53XdmBrLDoHkctevJ-1ZBC7x6TKRhW9vXIwHQV0_lIGi1eRrSix5Lye7_z--hwKR5pRn-xPXlr-ufpjtuWvHqpikbBxLLeu_q8dleU5RcNcQUEAU8yo Sep 27 17:43:04.819730 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Domain-Id: None Sep 27 17:43:04.819730 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Domain-Name: None Sep 27 17:43:04.819730 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Identity-Status: Confirmed Sep 27 17:43:04.819730 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Is-Admin-Project: True Sep 27 17:43:04.819730 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Domain-Id: default Sep 27 17:43:04.819730 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Domain-Name: Default Sep 27 17:43:04.819730 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Id: 0bd65ea59a6d41219ecf99f5a554056a Sep 27 17:43:04.819730 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Name: tempest-AttachVolumeTestJSON-1701714554 Sep 27 17:43:04.819730 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Role: reader,member Sep 27 17:43:04.819730 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Roles: reader,member Sep 27 17:43:04.821525 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/0bd65ea59a6d41219ecf99f5a554056a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_0bd65ea59a6d41219ecf99f5a554056a", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/0bd65ea59a6d41219ecf99f5a554056a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/0bd65ea59a6d41219ecf99f5a554056a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 27 17:43:04.821525 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Tenant: tempest-AttachVolumeTestJSON-1701714554 Sep 27 17:43:04.821525 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Tenant-Id: 0bd65ea59a6d41219ecf99f5a554056a Sep 27 17:43:04.821525 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1701714554 Sep 27 17:43:04.821525 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User: tempest-AttachVolumeTestJSON-1701714554-project Sep 27 17:43:04.821525 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Domain-Id: default Sep 27 17:43:04.821525 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Domain-Name: Default Sep 27 17:43:04.821525 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Id: 1b888fd409954909874b5443cfed2838 Sep 27 17:43:04.821525 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Name: tempest-AttachVolumeTestJSON-1701714554-project Sep 27 17:43:04.821525 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: method: > Sep 27 17:43:04.821525 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: exception: Instance ac4aee12-09e3-4073-aa67-c109242e5f8e could not be found. Sep 27 17:43:04.821525 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: action_args: {'id': 'ac4aee12-09e3-4073-aa67-c109242e5f8e'} Sep 27 17:43:04.822633 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 17:43:04.822633 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:43:04.822633 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 17:43:04.822633 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 17:43:04.822633 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 17:43:04.822633 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 17:43:04.822633 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 17:43:04.822633 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 17:43:04.822633 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 17:43:04.822633 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 17:43:04.822633 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac4aee12-09e3-4073-aa67-c109242e5f8e could not be found. Sep 27 17:43:04.822633 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:43:04.822633 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:43:04.822633 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:43:04.822633 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:43:04.822633 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:43:04.822633 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:43:04.822633 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 17:43:04.822633 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 17:43:04.822633 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 17:43:04.824101 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 17:43:04.824101 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 17:43:04.824101 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 17:43:04.824101 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 17:43:04.824101 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 17:43:04.824101 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 17:43:04.824101 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 17:43:04.824101 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac4aee12-09e3-4073-aa67-c109242e5f8e could not be found. Sep 27 17:43:04.824101 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:43:04.824101 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:43:04.824101 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:43:04.824101 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:43:04.824101 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:43:04.824101 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:43:04.824101 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 17:43:04.824101 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 17:43:04.824101 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac4aee12-09e3-4073-aa67-c109242e5f8e could not be found. Sep 27 17:43:04.824101 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:43:04.825593 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-e38879c9-86f2-407e-b712-d19e46572f6f tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Returning 404 to user: Instance ac4aee12-09e3-4073-aa67-c109242e5f8e could not be found. {{(pid=120415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 17:43:04.825593 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-e38879c9-86f2-407e-b712-d19e46572f6f tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "GET /compute/v2.1/servers/ac4aee12-09e3-4073-aa67-c109242e5f8e" status: 404 len: 111 microversion: 2.1 time: 0.029671 Sep 27 17:43:04.825593 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 621/1265] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:43:04 2022] GET /compute/v2.1/servers/ac4aee12-09e3-4073-aa67-c109242e5f8e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 17:43:04.829791 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-c60b4d94-a8f4-47f1-ac1b-1705cd5ad1c6 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Calling method '.version_select at 0x7fe7282e0dc0>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:43:04.848905 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-c60b4d94-a8f4-47f1-ac1b-1705cd5ad1c6 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1612067768" status: 202 len: 0 microversion: 2.1 time: 0.022907 Sep 27 17:43:04.849452 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 645/1266] 10.222.0.55 () {58 vars in 1221 bytes} [Tue Sep 27 17:43:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1612067768 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 27 17:43:07.714295 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-671ecd98-eb31-4fd9-b7e5-63227592caa6 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:43:07.714800 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-671ecd98-eb31-4fd9-b7e5-63227592caa6 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: ac4aee12-09e3-4073-aa67-c109242e5f8e] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:43:07.721628 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-671ecd98-eb31-4fd9-b7e5-63227592caa6 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:43:07.722141 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-671ecd98-eb31-4fd9-b7e5-63227592caa6 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:43:07.722581 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-671ecd98-eb31-4fd9-b7e5-63227592caa6 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:43:07.723268 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-671ecd98-eb31-4fd9-b7e5-63227592caa6 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:43:07.723721 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-671ecd98-eb31-4fd9-b7e5-63227592caa6 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:43:07.724147 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-671ecd98-eb31-4fd9-b7e5-63227592caa6 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:43:07.737803 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.wsgi [None req-671ecd98-eb31-4fd9-b7e5-63227592caa6 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] HTTP exception thrown: Instance ac4aee12-09e3-4073-aa67-c109242e5f8e could not be found. Sep 27 17:43:07.739383 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-671ecd98-eb31-4fd9-b7e5-63227592caa6 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Request method failure captured: Sep 27 17:43:07.739383 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: request: DELETE /compute/v2.1/servers/ac4aee12-09e3-4073-aa67-c109242e5f8e HTTP/1.1 Sep 27 17:43:07.739383 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Accept: application/json Sep 27 17:43:07.739383 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Accept-Encoding: identity Sep 27 17:43:07.739383 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Connection: close Sep 27 17:43:07.739383 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Content-Length: 0 Sep 27 17:43:07.739383 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Content-Type: application/json Sep 27 17:43:07.739383 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Host: 10.222.0.55 Sep 27 17:43:07.739383 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Openstack-System-Scope: None Sep 27 17:43:07.739383 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: User-Agent: python-urllib3/1.26.12 Sep 27 17:43:07.739383 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Auth-Token: gAAAAABjMzSeQwcZWqcXgmVYQr9OX1fPdOc8LbvT3p3K_GqHGottEGJ3nE8beTzy5V-J53XdmBrLDoHkctevJ-1ZBC7x6TKRhW9vXIwHQV0_lIGi1eRrSix5Lye7_z--hwKR5pRn-xPXlr-ufpjtuWvHqpikbBxLLeu_q8dleU5RcNcQUEAU8yo Sep 27 17:43:07.739383 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Domain-Id: None Sep 27 17:43:07.739383 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Domain-Name: None Sep 27 17:43:07.739383 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Identity-Status: Confirmed Sep 27 17:43:07.739383 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Is-Admin-Project: True Sep 27 17:43:07.739383 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Domain-Id: default Sep 27 17:43:07.739383 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Domain-Name: Default Sep 27 17:43:07.739383 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Id: 0bd65ea59a6d41219ecf99f5a554056a Sep 27 17:43:07.739383 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Name: tempest-AttachVolumeTestJSON-1701714554 Sep 27 17:43:07.739383 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Role: reader,member Sep 27 17:43:07.739383 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Roles: reader,member Sep 27 17:43:07.741410 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/0bd65ea59a6d41219ecf99f5a554056a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_0bd65ea59a6d41219ecf99f5a554056a", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/0bd65ea59a6d41219ecf99f5a554056a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/0bd65ea59a6d41219ecf99f5a554056a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 27 17:43:07.741410 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Tenant: tempest-AttachVolumeTestJSON-1701714554 Sep 27 17:43:07.741410 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Tenant-Id: 0bd65ea59a6d41219ecf99f5a554056a Sep 27 17:43:07.741410 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1701714554 Sep 27 17:43:07.741410 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User: tempest-AttachVolumeTestJSON-1701714554-project Sep 27 17:43:07.741410 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Domain-Id: default Sep 27 17:43:07.741410 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Domain-Name: Default Sep 27 17:43:07.741410 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Id: 1b888fd409954909874b5443cfed2838 Sep 27 17:43:07.741410 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Name: tempest-AttachVolumeTestJSON-1701714554-project Sep 27 17:43:07.741410 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: method: > Sep 27 17:43:07.741410 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: exception: Instance ac4aee12-09e3-4073-aa67-c109242e5f8e could not be found. Sep 27 17:43:07.741410 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: action_args: {'id': 'ac4aee12-09e3-4073-aa67-c109242e5f8e'} Sep 27 17:43:07.742559 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 17:43:07.742559 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:43:07.742559 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 17:43:07.742559 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 17:43:07.742559 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 17:43:07.742559 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 17:43:07.742559 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 17:43:07.742559 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 17:43:07.742559 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 17:43:07.742559 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 17:43:07.742559 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac4aee12-09e3-4073-aa67-c109242e5f8e could not be found. Sep 27 17:43:07.742559 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:43:07.742559 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:43:07.742559 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:43:07.742559 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:43:07.742559 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:43:07.742559 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:43:07.742559 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 17:43:07.742559 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 17:43:07.742559 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 17:43:07.744247 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 17:43:07.744247 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 27 17:43:07.744247 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 27 17:43:07.744247 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 27 17:43:07.744247 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 27 17:43:07.744247 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 17:43:07.744247 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 17:43:07.744247 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 17:43:07.744247 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 17:43:07.744247 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac4aee12-09e3-4073-aa67-c109242e5f8e could not be found. Sep 27 17:43:07.744247 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:43:07.744247 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:43:07.744247 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:43:07.744247 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:43:07.744247 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:43:07.744247 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:43:07.744247 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 17:43:07.744247 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 17:43:07.744247 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac4aee12-09e3-4073-aa67-c109242e5f8e could not be found. Sep 27 17:43:07.744247 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:43:07.745993 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-671ecd98-eb31-4fd9-b7e5-63227592caa6 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Returning 404 to user: Instance ac4aee12-09e3-4073-aa67-c109242e5f8e could not be found. {{(pid=120415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 17:43:07.745993 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-671ecd98-eb31-4fd9-b7e5-63227592caa6 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "DELETE /compute/v2.1/servers/ac4aee12-09e3-4073-aa67-c109242e5f8e" status: 404 len: 111 microversion: 2.1 time: 0.030412 Sep 27 17:43:07.745993 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 622/1267] 10.222.0.55 () {58 vars in 1239 bytes} [Tue Sep 27 17:43:07 2022] DELETE /compute/v2.1/servers/ac4aee12-09e3-4073-aa67-c109242e5f8e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 17:43:07.750211 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-2c162e5c-390d-4d26-b9fa-a0812c677990 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:43:07.750851 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-2c162e5c-390d-4d26-b9fa-a0812c677990 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: ac4aee12-09e3-4073-aa67-c109242e5f8e] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:43:07.757261 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-2c162e5c-390d-4d26-b9fa-a0812c677990 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:43:07.757732 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-2c162e5c-390d-4d26-b9fa-a0812c677990 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:43:07.758183 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-2c162e5c-390d-4d26-b9fa-a0812c677990 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:43:07.758859 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-2c162e5c-390d-4d26-b9fa-a0812c677990 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:43:07.759304 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-2c162e5c-390d-4d26-b9fa-a0812c677990 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:43:07.759720 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-2c162e5c-390d-4d26-b9fa-a0812c677990 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:43:07.772921 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.wsgi [None req-2c162e5c-390d-4d26-b9fa-a0812c677990 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] HTTP exception thrown: Instance ac4aee12-09e3-4073-aa67-c109242e5f8e could not be found. Sep 27 17:43:07.774590 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-2c162e5c-390d-4d26-b9fa-a0812c677990 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Request method failure captured: Sep 27 17:43:07.774590 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: request: GET /compute/v2.1/servers/ac4aee12-09e3-4073-aa67-c109242e5f8e HTTP/1.1 Sep 27 17:43:07.774590 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Accept: application/json Sep 27 17:43:07.774590 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Accept-Encoding: identity Sep 27 17:43:07.774590 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Connection: close Sep 27 17:43:07.774590 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Content-Length: 0 Sep 27 17:43:07.774590 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Content-Type: application/json Sep 27 17:43:07.774590 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Host: 10.222.0.55 Sep 27 17:43:07.774590 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Openstack-System-Scope: None Sep 27 17:43:07.774590 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: User-Agent: python-urllib3/1.26.12 Sep 27 17:43:07.774590 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Auth-Token: gAAAAABjMzSeQwcZWqcXgmVYQr9OX1fPdOc8LbvT3p3K_GqHGottEGJ3nE8beTzy5V-J53XdmBrLDoHkctevJ-1ZBC7x6TKRhW9vXIwHQV0_lIGi1eRrSix5Lye7_z--hwKR5pRn-xPXlr-ufpjtuWvHqpikbBxLLeu_q8dleU5RcNcQUEAU8yo Sep 27 17:43:07.774590 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Domain-Id: None Sep 27 17:43:07.774590 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Domain-Name: None Sep 27 17:43:07.774590 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Identity-Status: Confirmed Sep 27 17:43:07.774590 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Is-Admin-Project: True Sep 27 17:43:07.774590 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Domain-Id: default Sep 27 17:43:07.774590 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Domain-Name: Default Sep 27 17:43:07.774590 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Id: 0bd65ea59a6d41219ecf99f5a554056a Sep 27 17:43:07.774590 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Name: tempest-AttachVolumeTestJSON-1701714554 Sep 27 17:43:07.774590 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Role: reader,member Sep 27 17:43:07.774590 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Roles: reader,member Sep 27 17:43:07.776321 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/0bd65ea59a6d41219ecf99f5a554056a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_0bd65ea59a6d41219ecf99f5a554056a", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/0bd65ea59a6d41219ecf99f5a554056a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/0bd65ea59a6d41219ecf99f5a554056a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 27 17:43:07.776321 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Tenant: tempest-AttachVolumeTestJSON-1701714554 Sep 27 17:43:07.776321 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Tenant-Id: 0bd65ea59a6d41219ecf99f5a554056a Sep 27 17:43:07.776321 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1701714554 Sep 27 17:43:07.776321 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User: tempest-AttachVolumeTestJSON-1701714554-project Sep 27 17:43:07.776321 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Domain-Id: default Sep 27 17:43:07.776321 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Domain-Name: Default Sep 27 17:43:07.776321 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Id: 1b888fd409954909874b5443cfed2838 Sep 27 17:43:07.776321 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Name: tempest-AttachVolumeTestJSON-1701714554-project Sep 27 17:43:07.776321 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: method: > Sep 27 17:43:07.776321 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: exception: Instance ac4aee12-09e3-4073-aa67-c109242e5f8e could not be found. Sep 27 17:43:07.776321 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: action_args: {'id': 'ac4aee12-09e3-4073-aa67-c109242e5f8e'} Sep 27 17:43:07.777397 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 17:43:07.777397 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:43:07.777397 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 17:43:07.777397 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 17:43:07.777397 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 17:43:07.777397 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 17:43:07.777397 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 17:43:07.777397 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 17:43:07.777397 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 17:43:07.777397 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 17:43:07.777397 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac4aee12-09e3-4073-aa67-c109242e5f8e could not be found. Sep 27 17:43:07.777397 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:43:07.777397 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:43:07.777397 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:43:07.777397 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:43:07.777397 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:43:07.777397 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:43:07.777397 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 17:43:07.777397 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 17:43:07.777397 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 17:43:07.779065 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 17:43:07.779065 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 17:43:07.779065 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 17:43:07.779065 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 17:43:07.779065 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 17:43:07.779065 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 17:43:07.779065 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 17:43:07.779065 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac4aee12-09e3-4073-aa67-c109242e5f8e could not be found. Sep 27 17:43:07.779065 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:43:07.779065 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:43:07.779065 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:43:07.779065 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:43:07.779065 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:43:07.779065 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:43:07.779065 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 17:43:07.779065 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 17:43:07.779065 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac4aee12-09e3-4073-aa67-c109242e5f8e could not be found. Sep 27 17:43:07.779065 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:43:07.780604 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-2c162e5c-390d-4d26-b9fa-a0812c677990 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Returning 404 to user: Instance ac4aee12-09e3-4073-aa67-c109242e5f8e could not be found. {{(pid=120416) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 17:43:07.780604 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-2c162e5c-390d-4d26-b9fa-a0812c677990 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "GET /compute/v2.1/servers/ac4aee12-09e3-4073-aa67-c109242e5f8e" status: 404 len: 111 microversion: 2.1 time: 0.030318 Sep 27 17:43:07.780604 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 646/1268] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:43:07 2022] GET /compute/v2.1/servers/ac4aee12-09e3-4073-aa67-c109242e5f8e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 27 17:43:08.912129 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-7ef13422-95a1-4898-b17d-cbfb3a0c2423 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:43:08.912612 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-7ef13422-95a1-4898-b17d-cbfb3a0c2423 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: 9e6cccab-407e-45f8-9eb3-586fa28cd817] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:43:08.915035 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:43:08.920197 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7ef13422-95a1-4898-b17d-cbfb3a0c2423 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:43:08.920676 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7ef13422-95a1-4898-b17d-cbfb3a0c2423 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:43:08.921107 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7ef13422-95a1-4898-b17d-cbfb3a0c2423 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:43:08.921787 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7ef13422-95a1-4898-b17d-cbfb3a0c2423 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:43:08.922273 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7ef13422-95a1-4898-b17d-cbfb3a0c2423 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:43:08.922696 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7ef13422-95a1-4898-b17d-cbfb3a0c2423 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:43:08.926581 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:43:08.938891 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.wsgi [None req-7ef13422-95a1-4898-b17d-cbfb3a0c2423 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] HTTP exception thrown: Instance 9e6cccab-407e-45f8-9eb3-586fa28cd817 could not be found. Sep 27 17:43:08.940431 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-7ef13422-95a1-4898-b17d-cbfb3a0c2423 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Request method failure captured: Sep 27 17:43:08.940431 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: request: DELETE /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817 HTTP/1.1 Sep 27 17:43:08.940431 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Accept: application/json Sep 27 17:43:08.940431 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Accept-Encoding: identity Sep 27 17:43:08.940431 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Connection: close Sep 27 17:43:08.940431 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Content-Length: 0 Sep 27 17:43:08.940431 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Content-Type: application/json Sep 27 17:43:08.940431 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Host: 10.222.0.55 Sep 27 17:43:08.940431 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: Openstack-System-Scope: None Sep 27 17:43:08.940431 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: User-Agent: python-urllib3/1.26.12 Sep 27 17:43:08.940431 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Auth-Token: gAAAAABjMzSeQwcZWqcXgmVYQr9OX1fPdOc8LbvT3p3K_GqHGottEGJ3nE8beTzy5V-J53XdmBrLDoHkctevJ-1ZBC7x6TKRhW9vXIwHQV0_lIGi1eRrSix5Lye7_z--hwKR5pRn-xPXlr-ufpjtuWvHqpikbBxLLeu_q8dleU5RcNcQUEAU8yo Sep 27 17:43:08.940431 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Domain-Id: None Sep 27 17:43:08.940431 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Domain-Name: None Sep 27 17:43:08.940431 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Identity-Status: Confirmed Sep 27 17:43:08.940431 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Is-Admin-Project: True Sep 27 17:43:08.940431 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Domain-Id: default Sep 27 17:43:08.940431 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Domain-Name: Default Sep 27 17:43:08.940431 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Id: 0bd65ea59a6d41219ecf99f5a554056a Sep 27 17:43:08.940431 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Project-Name: tempest-AttachVolumeTestJSON-1701714554 Sep 27 17:43:08.940431 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Role: reader,member Sep 27 17:43:08.940431 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Roles: reader,member Sep 27 17:43:08.942251 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/0bd65ea59a6d41219ecf99f5a554056a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_0bd65ea59a6d41219ecf99f5a554056a", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/0bd65ea59a6d41219ecf99f5a554056a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/0bd65ea59a6d41219ecf99f5a554056a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 27 17:43:08.942251 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Tenant: tempest-AttachVolumeTestJSON-1701714554 Sep 27 17:43:08.942251 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Tenant-Id: 0bd65ea59a6d41219ecf99f5a554056a Sep 27 17:43:08.942251 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1701714554 Sep 27 17:43:08.942251 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User: tempest-AttachVolumeTestJSON-1701714554-project Sep 27 17:43:08.942251 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Domain-Id: default Sep 27 17:43:08.942251 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Domain-Name: Default Sep 27 17:43:08.942251 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Id: 1b888fd409954909874b5443cfed2838 Sep 27 17:43:08.942251 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: X-User-Name: tempest-AttachVolumeTestJSON-1701714554-project Sep 27 17:43:08.942251 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: method: > Sep 27 17:43:08.942251 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: exception: Instance 9e6cccab-407e-45f8-9eb3-586fa28cd817 could not be found. Sep 27 17:43:08.942251 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: action_args: {'id': '9e6cccab-407e-45f8-9eb3-586fa28cd817'} Sep 27 17:43:08.943344 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 17:43:08.943344 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:43:08.943344 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 17:43:08.943344 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 17:43:08.943344 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 17:43:08.943344 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 17:43:08.943344 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 17:43:08.943344 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 17:43:08.943344 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 17:43:08.943344 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 17:43:08.943344 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e6cccab-407e-45f8-9eb3-586fa28cd817 could not be found. Sep 27 17:43:08.943344 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:43:08.943344 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:43:08.943344 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:43:08.943344 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:43:08.943344 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:43:08.943344 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:43:08.943344 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 17:43:08.943344 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 17:43:08.943344 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 17:43:08.945223 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 17:43:08.945223 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 27 17:43:08.945223 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 27 17:43:08.945223 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 27 17:43:08.945223 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 27 17:43:08.945223 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 17:43:08.945223 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 17:43:08.945223 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 17:43:08.945223 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 17:43:08.945223 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e6cccab-407e-45f8-9eb3-586fa28cd817 could not be found. Sep 27 17:43:08.945223 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:43:08.945223 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:43:08.945223 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:43:08.945223 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:43:08.945223 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:43:08.945223 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:43:08.945223 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 17:43:08.945223 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 17:43:08.945223 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e6cccab-407e-45f8-9eb3-586fa28cd817 could not be found. Sep 27 17:43:08.945223 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 27 17:43:08.946946 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-7ef13422-95a1-4898-b17d-cbfb3a0c2423 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Returning 404 to user: Instance 9e6cccab-407e-45f8-9eb3-586fa28cd817 could not be found. {{(pid=120415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 17:43:08.946946 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-7ef13422-95a1-4898-b17d-cbfb3a0c2423 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "DELETE /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817" status: 404 len: 111 microversion: 2.1 time: 0.034035 Sep 27 17:43:08.946946 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 623/1269] 10.222.0.55 () {58 vars in 1239 bytes} [Tue Sep 27 17:43:08 2022] DELETE /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 17:43:08.950347 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-fc6620b4-9c39-4d8d-9cd6-e9269959e538 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:43:08.950958 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-fc6620b4-9c39-4d8d-9cd6-e9269959e538 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] [instance: 9e6cccab-407e-45f8-9eb3-586fa28cd817] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:43:08.957411 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-fc6620b4-9c39-4d8d-9cd6-e9269959e538 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:43:08.957925 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-fc6620b4-9c39-4d8d-9cd6-e9269959e538 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:43:08.958390 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-fc6620b4-9c39-4d8d-9cd6-e9269959e538 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:43:08.959079 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-fc6620b4-9c39-4d8d-9cd6-e9269959e538 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:43:08.959562 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-fc6620b4-9c39-4d8d-9cd6-e9269959e538 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:43:08.959986 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-fc6620b4-9c39-4d8d-9cd6-e9269959e538 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:43:08.973377 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.wsgi [None req-fc6620b4-9c39-4d8d-9cd6-e9269959e538 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] HTTP exception thrown: Instance 9e6cccab-407e-45f8-9eb3-586fa28cd817 could not be found. Sep 27 17:43:08.974929 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-fc6620b4-9c39-4d8d-9cd6-e9269959e538 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Request method failure captured: Sep 27 17:43:08.974929 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: request: GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817 HTTP/1.1 Sep 27 17:43:08.974929 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Accept: application/json Sep 27 17:43:08.974929 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Accept-Encoding: identity Sep 27 17:43:08.974929 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Connection: close Sep 27 17:43:08.974929 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Content-Length: 0 Sep 27 17:43:08.974929 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Content-Type: application/json Sep 27 17:43:08.974929 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Host: 10.222.0.55 Sep 27 17:43:08.974929 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Openstack-System-Scope: None Sep 27 17:43:08.974929 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: User-Agent: python-urllib3/1.26.12 Sep 27 17:43:08.974929 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Auth-Token: gAAAAABjMzSeQwcZWqcXgmVYQr9OX1fPdOc8LbvT3p3K_GqHGottEGJ3nE8beTzy5V-J53XdmBrLDoHkctevJ-1ZBC7x6TKRhW9vXIwHQV0_lIGi1eRrSix5Lye7_z--hwKR5pRn-xPXlr-ufpjtuWvHqpikbBxLLeu_q8dleU5RcNcQUEAU8yo Sep 27 17:43:08.974929 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Domain-Id: None Sep 27 17:43:08.974929 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Domain-Name: None Sep 27 17:43:08.974929 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Identity-Status: Confirmed Sep 27 17:43:08.974929 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Is-Admin-Project: True Sep 27 17:43:08.974929 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Domain-Id: default Sep 27 17:43:08.974929 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Domain-Name: Default Sep 27 17:43:08.974929 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Id: 0bd65ea59a6d41219ecf99f5a554056a Sep 27 17:43:08.974929 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Name: tempest-AttachVolumeTestJSON-1701714554 Sep 27 17:43:08.974929 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Role: reader,member Sep 27 17:43:08.974929 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Roles: reader,member Sep 27 17:43:08.976678 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/0bd65ea59a6d41219ecf99f5a554056a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_0bd65ea59a6d41219ecf99f5a554056a", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/0bd65ea59a6d41219ecf99f5a554056a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/0bd65ea59a6d41219ecf99f5a554056a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 27 17:43:08.976678 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Tenant: tempest-AttachVolumeTestJSON-1701714554 Sep 27 17:43:08.976678 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Tenant-Id: 0bd65ea59a6d41219ecf99f5a554056a Sep 27 17:43:08.976678 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1701714554 Sep 27 17:43:08.976678 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User: tempest-AttachVolumeTestJSON-1701714554-project Sep 27 17:43:08.976678 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Domain-Id: default Sep 27 17:43:08.976678 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Domain-Name: Default Sep 27 17:43:08.976678 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Id: 1b888fd409954909874b5443cfed2838 Sep 27 17:43:08.976678 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Name: tempest-AttachVolumeTestJSON-1701714554-project Sep 27 17:43:08.976678 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: method: > Sep 27 17:43:08.976678 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: exception: Instance 9e6cccab-407e-45f8-9eb3-586fa28cd817 could not be found. Sep 27 17:43:08.976678 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: action_args: {'id': '9e6cccab-407e-45f8-9eb3-586fa28cd817'} Sep 27 17:43:08.977612 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 17:43:08.977612 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:43:08.977612 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 17:43:08.977612 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 17:43:08.977612 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 17:43:08.977612 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 17:43:08.977612 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 17:43:08.977612 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 17:43:08.977612 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 17:43:08.977612 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 17:43:08.977612 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e6cccab-407e-45f8-9eb3-586fa28cd817 could not be found. Sep 27 17:43:08.977612 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:43:08.977612 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:43:08.977612 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:43:08.977612 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:43:08.977612 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:43:08.977612 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:43:08.977612 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 17:43:08.977612 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 17:43:08.977612 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 17:43:08.979246 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 17:43:08.979246 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 17:43:08.979246 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 17:43:08.979246 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 17:43:08.979246 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 17:43:08.979246 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 17:43:08.979246 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 17:43:08.979246 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e6cccab-407e-45f8-9eb3-586fa28cd817 could not be found. Sep 27 17:43:08.979246 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:43:08.979246 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:43:08.979246 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:43:08.979246 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:43:08.979246 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:43:08.979246 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:43:08.979246 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 17:43:08.979246 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 17:43:08.979246 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e6cccab-407e-45f8-9eb3-586fa28cd817 could not be found. Sep 27 17:43:08.979246 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:43:08.980730 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-fc6620b4-9c39-4d8d-9cd6-e9269959e538 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] Returning 404 to user: Instance 9e6cccab-407e-45f8-9eb3-586fa28cd817 could not be found. {{(pid=120416) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 17:43:08.980730 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-fc6620b4-9c39-4d8d-9cd6-e9269959e538 tempest-AttachVolumeTestJSON-1701714554 tempest-AttachVolumeTestJSON-1701714554-project] 10.222.0.55 "GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817" status: 404 len: 111 microversion: 2.1 time: 0.029887 Sep 27 17:43:08.980730 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 647/1270] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:43:08 2022] GET /compute/v2.1/servers/9e6cccab-407e-45f8-9eb3-586fa28cd817 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 27 17:43:33.457953 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-4f85a8b8-a115-42c9-b883-b81832d0d1f1 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-798994538", "imageRef": "9355bd92-0a49-42cd-b079-ff9f0d54b91b", "flavorRef": "452"}} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:43:33.465414 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_api:SELECT=1 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:43:33.512249 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.network.neutron [None req-4f85a8b8-a115-42c9-b883-b81832d0d1f1 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] validate_networks() for None {{(pid=120415) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 27 17:43:34.034930 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-4f85a8b8-a115-42c9-b883-b81832d0d1f1 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Flavor limits 0:0:0 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 27 17:43:34.035349 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-4f85a8b8-a115-42c9-b883-b81832d0d1f1 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Image limits 0:0:0 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 27 17:43:34.035814 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-4f85a8b8-a115-42c9-b883-b81832d0d1f1 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Flavor pref 0:0:0 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 27 17:43:34.036215 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-4f85a8b8-a115-42c9-b883-b81832d0d1f1 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Image pref 0:0:0 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 27 17:43:34.036617 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-4f85a8b8-a115-42c9-b883-b81832d0d1f1 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 27 17:43:34.045297 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4f85a8b8-a115-42c9-b883-b81832d0d1f1 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:43:34.045762 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4f85a8b8-a115-42c9-b883-b81832d0d1f1 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:43:34.046223 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4f85a8b8-a115-42c9-b883-b81832d0d1f1 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:43:34.046938 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4f85a8b8-a115-42c9-b883-b81832d0d1f1 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:43:34.047381 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4f85a8b8-a115-42c9-b883-b81832d0d1f1 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:43:34.047795 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4f85a8b8-a115-42c9-b883-b81832d0d1f1 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:43:34.064256 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.quota [None req-4f85a8b8-a115-42c9-b883-b81832d0d1f1 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Getting quotas for project aad3fbebc440463194bf8cf5ac707f13. Resources: {'cores', 'ram', 'instances'} {{(pid=120415) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 27 17:43:34.068787 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.quota [None req-4f85a8b8-a115-42c9-b883-b81832d0d1f1 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Getting quotas for user 753045042fbe4a19b40ccd30bec24cdc and project aad3fbebc440463194bf8cf5ac707f13. Resources: {'cores', 'ram', 'instances'} {{(pid=120415) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 27 17:43:34.079823 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-4f85a8b8-a115-42c9-b883-b81832d0d1f1 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Going to run 1 instances... {{(pid=120415) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 27 17:43:34.082130 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-4f85a8b8-a115-42c9-b883-b81832d0d1f1 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] [instance: a34b8bed-3a32-4241-ab88-6b47784d8a75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9355bd92-0a49-42cd-b079-ff9f0d54b91b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120415) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 27 17:43:34.129704 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-4f85a8b8-a115-42c9-b883-b81832d0d1f1 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.675542 Sep 27 17:43:34.130393 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 624/1271] 10.222.0.55 () {60 vars in 1147 bytes} [Tue Sep 27 17:43:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 677 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 27 17:43:34.141522 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-88f3098e-4a63-44f5-85f8-ecde354dafd0 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:43:34.142173 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-88f3098e-4a63-44f5-85f8-ecde354dafd0 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] [instance: a34b8bed-3a32-4241-ab88-6b47784d8a75] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:43:34.146291 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_api:SELECT=27,nova_api:DELETE=1 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:43:34.146291 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:43:34.198630 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-88f3098e-4a63-44f5-85f8-ecde354dafd0 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753045042fbe4a19b40ccd30bec24cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad3fbebc440463194bf8cf5ac707f13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:43:34.205312 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-88f3098e-4a63-44f5-85f8-ecde354dafd0 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] 10.222.0.55 "GET /compute/v2.1/servers/a34b8bed-3a32-4241-ab88-6b47784d8a75" status: 200 len: 1214 microversion: 2.1 time: 0.067738 Sep 27 17:43:34.205876 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 648/1272] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:43:34 2022] GET /compute/v2.1/servers/a34b8bed-3a32-4241-ab88-6b47784d8a75 => generated 1214 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:43:35.228537 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-f225473a-4e5b-4e07-87b4-463cac161560 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:43:35.229079 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-f225473a-4e5b-4e07-87b4-463cac161560 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] [instance: a34b8bed-3a32-4241-ab88-6b47784d8a75] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:43:35.284218 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-f225473a-4e5b-4e07-87b4-463cac161560 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753045042fbe4a19b40ccd30bec24cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad3fbebc440463194bf8cf5ac707f13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:43:35.291173 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-f225473a-4e5b-4e07-87b4-463cac161560 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] 10.222.0.55 "GET /compute/v2.1/servers/a34b8bed-3a32-4241-ab88-6b47784d8a75" status: 200 len: 1214 microversion: 2.1 time: 0.066936 Sep 27 17:43:35.291671 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 625/1273] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:43:35 2022] GET /compute/v2.1/servers/a34b8bed-3a32-4241-ab88-6b47784d8a75 => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:43:36.313661 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-5703a21e-2fb3-4da3-bd2c-3543cff042f0 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:43:36.314335 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-5703a21e-2fb3-4da3-bd2c-3543cff042f0 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] [instance: a34b8bed-3a32-4241-ab88-6b47784d8a75] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:43:36.373487 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-5703a21e-2fb3-4da3-bd2c-3543cff042f0 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753045042fbe4a19b40ccd30bec24cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad3fbebc440463194bf8cf5ac707f13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:43:36.382528 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-5703a21e-2fb3-4da3-bd2c-3543cff042f0 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] 10.222.0.55 "GET /compute/v2.1/servers/a34b8bed-3a32-4241-ab88-6b47784d8a75" status: 200 len: 1214 microversion: 2.1 time: 0.072590 Sep 27 17:43:36.383590 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 649/1274] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:43:36 2022] GET /compute/v2.1/servers/a34b8bed-3a32-4241-ab88-6b47784d8a75 => generated 1214 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:43:37.405754 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-e5a82e91-7316-4da8-b03c-c51067f1e100 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:43:37.406413 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-e5a82e91-7316-4da8-b03c-c51067f1e100 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] [instance: a34b8bed-3a32-4241-ab88-6b47784d8a75] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:43:37.460164 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-e5a82e91-7316-4da8-b03c-c51067f1e100 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753045042fbe4a19b40ccd30bec24cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad3fbebc440463194bf8cf5ac707f13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:43:37.467242 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-e5a82e91-7316-4da8-b03c-c51067f1e100 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] 10.222.0.55 "GET /compute/v2.1/servers/a34b8bed-3a32-4241-ab88-6b47784d8a75" status: 200 len: 1214 microversion: 2.1 time: 0.065368 Sep 27 17:43:37.467953 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 626/1275] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:43:37 2022] GET /compute/v2.1/servers/a34b8bed-3a32-4241-ab88-6b47784d8a75 => generated 1214 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:43:38.491404 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-11a977ae-a4cf-4d48-b4a9-11d58690dcf1 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:43:38.492270 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-11a977ae-a4cf-4d48-b4a9-11d58690dcf1 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] [instance: a34b8bed-3a32-4241-ab88-6b47784d8a75] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:43:38.498599 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-11a977ae-a4cf-4d48-b4a9-11d58690dcf1 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:43:38.499066 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-11a977ae-a4cf-4d48-b4a9-11d58690dcf1 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:43:38.499492 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-11a977ae-a4cf-4d48-b4a9-11d58690dcf1 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:43:38.500166 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-11a977ae-a4cf-4d48-b4a9-11d58690dcf1 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:43:38.500610 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-11a977ae-a4cf-4d48-b4a9-11d58690dcf1 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:43:38.501024 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-11a977ae-a4cf-4d48-b4a9-11d58690dcf1 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:43:38.559731 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-11a977ae-a4cf-4d48-b4a9-11d58690dcf1 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753045042fbe4a19b40ccd30bec24cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad3fbebc440463194bf8cf5ac707f13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:43:38.567886 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-11a977ae-a4cf-4d48-b4a9-11d58690dcf1 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] 10.222.0.55 "GET /compute/v2.1/servers/a34b8bed-3a32-4241-ab88-6b47784d8a75" status: 200 len: 1218 microversion: 2.1 time: 0.080892 Sep 27 17:43:38.568374 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 650/1276] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:43:38 2022] GET /compute/v2.1/servers/a34b8bed-3a32-4241-ab88-6b47784d8a75 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:43:39.592072 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-506810fa-411d-4e53-9641-54082126771e tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:43:39.592676 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-506810fa-411d-4e53-9641-54082126771e tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] [instance: a34b8bed-3a32-4241-ab88-6b47784d8a75] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:43:39.600265 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-506810fa-411d-4e53-9641-54082126771e tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:43:39.601184 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-506810fa-411d-4e53-9641-54082126771e tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:43:39.601645 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-506810fa-411d-4e53-9641-54082126771e tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:43:39.602363 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-506810fa-411d-4e53-9641-54082126771e tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:43:39.602818 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-506810fa-411d-4e53-9641-54082126771e tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:43:39.603245 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-506810fa-411d-4e53-9641-54082126771e tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:43:39.682996 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-506810fa-411d-4e53-9641-54082126771e tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753045042fbe4a19b40ccd30bec24cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad3fbebc440463194bf8cf5ac707f13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:43:39.690554 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-506810fa-411d-4e53-9641-54082126771e tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] 10.222.0.55 "GET /compute/v2.1/servers/a34b8bed-3a32-4241-ab88-6b47784d8a75" status: 200 len: 1272 microversion: 2.1 time: 0.102634 Sep 27 17:43:39.691142 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 627/1277] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:43:39 2022] GET /compute/v2.1/servers/a34b8bed-3a32-4241-ab88-6b47784d8a75 => generated 1272 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:43:40.646054 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [req-4b1de76b-670c-471a-8d92-5d1b54aac55c req-0609a1ab-9342-4dc0-8259-bf3b20749e4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a34b8bed-3a32-4241-ab88-6b47784d8a75", "tag": "a26d9bd3-3179-4ecb-8b96-d09e33cfa4a1"}]} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:43:40.657669 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-4b1de76b-670c-471a-8d92-5d1b54aac55c req-0609a1ab-9342-4dc0-8259-bf3b20749e4c service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:43:40.658296 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-4b1de76b-670c-471a-8d92-5d1b54aac55c req-0609a1ab-9342-4dc0-8259-bf3b20749e4c service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:43:40.658736 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-4b1de76b-670c-471a-8d92-5d1b54aac55c req-0609a1ab-9342-4dc0-8259-bf3b20749e4c service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:43:40.670886 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.compute.server_external_events [req-4b1de76b-670c-471a-8d92-5d1b54aac55c req-0609a1ab-9342-4dc0-8259-bf3b20749e4c service nova] Creating event network-changed:a26d9bd3-3179-4ecb-8b96-d09e33cfa4a1 for instance a34b8bed-3a32-4241-ab88-6b47784d8a75 on hv-cinder-84914 Sep 27 17:43:40.675746 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [req-4b1de76b-670c-471a-8d92-5d1b54aac55c req-0609a1ab-9342-4dc0-8259-bf3b20749e4c service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034239 Sep 27 17:43:40.677217 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 651/1278] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:43:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:43:40.714640 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-44b7a2b2-e859-418b-9a8d-3657c72b1d8a tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:43:40.715250 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-44b7a2b2-e859-418b-9a8d-3657c72b1d8a tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] [instance: a34b8bed-3a32-4241-ab88-6b47784d8a75] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:43:40.721609 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-44b7a2b2-e859-418b-9a8d-3657c72b1d8a tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:43:40.722103 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-44b7a2b2-e859-418b-9a8d-3657c72b1d8a tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:43:40.722547 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-44b7a2b2-e859-418b-9a8d-3657c72b1d8a tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:43:40.723797 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-44b7a2b2-e859-418b-9a8d-3657c72b1d8a tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:43:40.724249 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-44b7a2b2-e859-418b-9a8d-3657c72b1d8a tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:43:40.724669 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-44b7a2b2-e859-418b-9a8d-3657c72b1d8a tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:43:40.949034 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-44b7a2b2-e859-418b-9a8d-3657c72b1d8a tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753045042fbe4a19b40ccd30bec24cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad3fbebc440463194bf8cf5ac707f13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:43:40.956644 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-44b7a2b2-e859-418b-9a8d-3657c72b1d8a tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] 10.222.0.55 "GET /compute/v2.1/servers/a34b8bed-3a32-4241-ab88-6b47784d8a75" status: 200 len: 1314 microversion: 2.1 time: 0.245950 Sep 27 17:43:40.957217 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 628/1279] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:43:40 2022] GET /compute/v2.1/servers/a34b8bed-3a32-4241-ab88-6b47784d8a75 => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:43:41.980659 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-7198ca13-01a6-449a-ba7e-6e32726dbbad tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:43:41.981359 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-7198ca13-01a6-449a-ba7e-6e32726dbbad tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] [instance: a34b8bed-3a32-4241-ab88-6b47784d8a75] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:43:41.987969 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7198ca13-01a6-449a-ba7e-6e32726dbbad tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:43:41.988448 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7198ca13-01a6-449a-ba7e-6e32726dbbad tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:43:41.989404 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7198ca13-01a6-449a-ba7e-6e32726dbbad tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:43:41.990096 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7198ca13-01a6-449a-ba7e-6e32726dbbad tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:43:41.990553 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7198ca13-01a6-449a-ba7e-6e32726dbbad tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:43:41.990973 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-7198ca13-01a6-449a-ba7e-6e32726dbbad tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:43:42.117890 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-7198ca13-01a6-449a-ba7e-6e32726dbbad tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753045042fbe4a19b40ccd30bec24cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad3fbebc440463194bf8cf5ac707f13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:43:42.126491 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-7198ca13-01a6-449a-ba7e-6e32726dbbad tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] 10.222.0.55 "GET /compute/v2.1/servers/a34b8bed-3a32-4241-ab88-6b47784d8a75" status: 200 len: 1314 microversion: 2.1 time: 0.149867 Sep 27 17:43:42.127193 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 652/1280] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:43:41 2022] GET /compute/v2.1/servers/a34b8bed-3a32-4241-ab88-6b47784d8a75 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:43:43.149664 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-13a91d66-121e-41c1-a8a5-f07081bd97d1 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:43:43.150301 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-13a91d66-121e-41c1-a8a5-f07081bd97d1 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] [instance: a34b8bed-3a32-4241-ab88-6b47784d8a75] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:43:43.156752 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-13a91d66-121e-41c1-a8a5-f07081bd97d1 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:43:43.157264 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-13a91d66-121e-41c1-a8a5-f07081bd97d1 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:43:43.157702 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-13a91d66-121e-41c1-a8a5-f07081bd97d1 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:43:43.158417 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-13a91d66-121e-41c1-a8a5-f07081bd97d1 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:43:43.158867 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-13a91d66-121e-41c1-a8a5-f07081bd97d1 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:43:43.159290 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-13a91d66-121e-41c1-a8a5-f07081bd97d1 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:43:43.367406 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-13a91d66-121e-41c1-a8a5-f07081bd97d1 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753045042fbe4a19b40ccd30bec24cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad3fbebc440463194bf8cf5ac707f13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:43:43.374988 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-13a91d66-121e-41c1-a8a5-f07081bd97d1 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] 10.222.0.55 "GET /compute/v2.1/servers/a34b8bed-3a32-4241-ab88-6b47784d8a75" status: 200 len: 1314 microversion: 2.1 time: 0.229186 Sep 27 17:43:43.375641 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 629/1281] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:43:43 2022] GET /compute/v2.1/servers/a34b8bed-3a32-4241-ab88-6b47784d8a75 => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:43:44.398696 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-c6facaad-35b1-45c7-b655-e2d6f81f0f17 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:43:44.399305 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-c6facaad-35b1-45c7-b655-e2d6f81f0f17 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] [instance: a34b8bed-3a32-4241-ab88-6b47784d8a75] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:43:44.405683 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c6facaad-35b1-45c7-b655-e2d6f81f0f17 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:43:44.406185 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c6facaad-35b1-45c7-b655-e2d6f81f0f17 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:43:44.406616 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c6facaad-35b1-45c7-b655-e2d6f81f0f17 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:43:44.407290 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c6facaad-35b1-45c7-b655-e2d6f81f0f17 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:43:44.407734 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c6facaad-35b1-45c7-b655-e2d6f81f0f17 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:43:44.408149 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-c6facaad-35b1-45c7-b655-e2d6f81f0f17 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:43:44.539618 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-c6facaad-35b1-45c7-b655-e2d6f81f0f17 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753045042fbe4a19b40ccd30bec24cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad3fbebc440463194bf8cf5ac707f13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:43:44.547233 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-c6facaad-35b1-45c7-b655-e2d6f81f0f17 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] 10.222.0.55 "GET /compute/v2.1/servers/a34b8bed-3a32-4241-ab88-6b47784d8a75" status: 200 len: 1314 microversion: 2.1 time: 0.153076 Sep 27 17:43:44.547805 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 653/1282] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:43:44 2022] GET /compute/v2.1/servers/a34b8bed-3a32-4241-ab88-6b47784d8a75 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:43:45.570545 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-e8058a61-ae35-464d-bd9e-472890e389f9 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:43:45.571088 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-e8058a61-ae35-464d-bd9e-472890e389f9 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] [instance: a34b8bed-3a32-4241-ab88-6b47784d8a75] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:43:45.572931 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell0:SELECT=2 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:43:45.578575 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e8058a61-ae35-464d-bd9e-472890e389f9 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:43:45.579045 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e8058a61-ae35-464d-bd9e-472890e389f9 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:43:45.579469 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e8058a61-ae35-464d-bd9e-472890e389f9 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:43:45.580146 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e8058a61-ae35-464d-bd9e-472890e389f9 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:43:45.580588 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e8058a61-ae35-464d-bd9e-472890e389f9 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:43:45.581001 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e8058a61-ae35-464d-bd9e-472890e389f9 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:43:45.705399 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-e8058a61-ae35-464d-bd9e-472890e389f9 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753045042fbe4a19b40ccd30bec24cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad3fbebc440463194bf8cf5ac707f13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:43:45.713454 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-e8058a61-ae35-464d-bd9e-472890e389f9 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] 10.222.0.55 "GET /compute/v2.1/servers/a34b8bed-3a32-4241-ab88-6b47784d8a75" status: 200 len: 1314 microversion: 2.1 time: 0.147341 Sep 27 17:43:45.714021 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 630/1283] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:43:45 2022] GET /compute/v2.1/servers/a34b8bed-3a32-4241-ab88-6b47784d8a75 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:43:46.044511 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [req-f10fc48a-b2b8-48a3-bcf6-3e4b1aa01309 req-ff7d2013-df1a-4621-bb2c-06ecb1c31eab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a34b8bed-3a32-4241-ab88-6b47784d8a75", "name": "network-vif-plugged", "status": "completed", "tag": "a26d9bd3-3179-4ecb-8b96-d09e33cfa4a1"}]} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:43:46.055372 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-f10fc48a-b2b8-48a3-bcf6-3e4b1aa01309 req-ff7d2013-df1a-4621-bb2c-06ecb1c31eab service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:43:46.055938 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-f10fc48a-b2b8-48a3-bcf6-3e4b1aa01309 req-ff7d2013-df1a-4621-bb2c-06ecb1c31eab service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:43:46.056378 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-f10fc48a-b2b8-48a3-bcf6-3e4b1aa01309 req-ff7d2013-df1a-4621-bb2c-06ecb1c31eab service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:43:46.069776 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.compute.server_external_events [req-f10fc48a-b2b8-48a3-bcf6-3e4b1aa01309 req-ff7d2013-df1a-4621-bb2c-06ecb1c31eab service nova] Creating event network-vif-plugged:a26d9bd3-3179-4ecb-8b96-d09e33cfa4a1 for instance a34b8bed-3a32-4241-ab88-6b47784d8a75 on hv-cinder-84914 Sep 27 17:43:46.074847 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [req-f10fc48a-b2b8-48a3-bcf6-3e4b1aa01309 req-ff7d2013-df1a-4621-bb2c-06ecb1c31eab service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034307 Sep 27 17:43:46.075616 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 654/1284] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:43:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 27 17:43:46.741829 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-90d56afb-cce7-49bd-b8e6-60ef88cad4be tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:43:46.742480 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-90d56afb-cce7-49bd-b8e6-60ef88cad4be tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] [instance: a34b8bed-3a32-4241-ab88-6b47784d8a75] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:43:46.748895 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-90d56afb-cce7-49bd-b8e6-60ef88cad4be tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:43:46.749378 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-90d56afb-cce7-49bd-b8e6-60ef88cad4be tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:43:46.749815 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-90d56afb-cce7-49bd-b8e6-60ef88cad4be tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:43:46.750542 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-90d56afb-cce7-49bd-b8e6-60ef88cad4be tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:43:46.750997 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-90d56afb-cce7-49bd-b8e6-60ef88cad4be tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:43:46.751422 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-90d56afb-cce7-49bd-b8e6-60ef88cad4be tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:43:46.879761 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-90d56afb-cce7-49bd-b8e6-60ef88cad4be tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753045042fbe4a19b40ccd30bec24cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad3fbebc440463194bf8cf5ac707f13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:43:46.887279 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-90d56afb-cce7-49bd-b8e6-60ef88cad4be tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] 10.222.0.55 "GET /compute/v2.1/servers/a34b8bed-3a32-4241-ab88-6b47784d8a75" status: 200 len: 1314 microversion: 2.1 time: 0.149557 Sep 27 17:43:46.887849 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 631/1285] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:43:46 2022] GET /compute/v2.1/servers/a34b8bed-3a32-4241-ab88-6b47784d8a75 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:43:47.907948 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG dbcounter [-] [120416] Writing DB stats nova_cell0:SELECT=4 {{(pid=120416) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:43:47.912601 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-39821029-8b76-48fc-974d-34b31873d702 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:43:47.913301 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-39821029-8b76-48fc-974d-34b31873d702 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] [instance: a34b8bed-3a32-4241-ab88-6b47784d8a75] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:43:47.919638 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-39821029-8b76-48fc-974d-34b31873d702 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:43:47.920195 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-39821029-8b76-48fc-974d-34b31873d702 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:43:47.920632 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-39821029-8b76-48fc-974d-34b31873d702 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:43:47.921316 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-39821029-8b76-48fc-974d-34b31873d702 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:43:47.921766 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-39821029-8b76-48fc-974d-34b31873d702 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:43:47.922217 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-39821029-8b76-48fc-974d-34b31873d702 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:43:48.058654 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-39821029-8b76-48fc-974d-34b31873d702 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753045042fbe4a19b40ccd30bec24cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad3fbebc440463194bf8cf5ac707f13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:43:48.066265 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-39821029-8b76-48fc-974d-34b31873d702 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] 10.222.0.55 "GET /compute/v2.1/servers/a34b8bed-3a32-4241-ab88-6b47784d8a75" status: 200 len: 1464 microversion: 2.1 time: 0.159209 Sep 27 17:43:48.066835 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 655/1286] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:43:47 2022] GET /compute/v2.1/servers/a34b8bed-3a32-4241-ab88-6b47784d8a75 => generated 1464 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:43:48.112228 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-15fac46b-0492-4178-8dcf-6d28eedab166 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:43:48.112721 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-15fac46b-0492-4178-8dcf-6d28eedab166 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] [instance: a34b8bed-3a32-4241-ab88-6b47784d8a75] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:43:48.114559 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell0:SELECT=10 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 27 17:43:48.120525 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-15fac46b-0492-4178-8dcf-6d28eedab166 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:43:48.121001 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-15fac46b-0492-4178-8dcf-6d28eedab166 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:43:48.121438 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-15fac46b-0492-4178-8dcf-6d28eedab166 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:43:48.122135 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-15fac46b-0492-4178-8dcf-6d28eedab166 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:43:48.122582 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-15fac46b-0492-4178-8dcf-6d28eedab166 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:43:48.123001 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-15fac46b-0492-4178-8dcf-6d28eedab166 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:43:48.149538 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-15fac46b-0492-4178-8dcf-6d28eedab166 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] [instance: a34b8bed-3a32-4241-ab88-6b47784d8a75] Going to try to terminate instance {{(pid=120415) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 27 17:43:48.222564 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-15fac46b-0492-4178-8dcf-6d28eedab166 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] 10.222.0.55 "DELETE /compute/v2.1/servers/a34b8bed-3a32-4241-ab88-6b47784d8a75" status: 204 len: 0 microversion: 2.1 time: 0.113737 Sep 27 17:43:48.223055 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 632/1287] 10.222.0.55 () {58 vars in 1239 bytes} [Tue Sep 27 17:43:48 2022] DELETE /compute/v2.1/servers/a34b8bed-3a32-4241-ab88-6b47784d8a75 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 27 17:43:48.231215 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-ffe0a73b-d65b-4085-8609-2a4d2267a28f tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:43:48.231820 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-ffe0a73b-d65b-4085-8609-2a4d2267a28f tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] [instance: a34b8bed-3a32-4241-ab88-6b47784d8a75] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:43:48.237553 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ffe0a73b-d65b-4085-8609-2a4d2267a28f tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:43:48.238030 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ffe0a73b-d65b-4085-8609-2a4d2267a28f tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:43:48.238495 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ffe0a73b-d65b-4085-8609-2a4d2267a28f tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:43:48.239200 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ffe0a73b-d65b-4085-8609-2a4d2267a28f tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:43:48.240173 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ffe0a73b-d65b-4085-8609-2a4d2267a28f tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:43:48.240652 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-ffe0a73b-d65b-4085-8609-2a4d2267a28f tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:43:48.365701 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.policy [None req-ffe0a73b-d65b-4085-8609-2a4d2267a28f tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753045042fbe4a19b40ccd30bec24cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad3fbebc440463194bf8cf5ac707f13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120416) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:43:48.373572 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-ffe0a73b-d65b-4085-8609-2a4d2267a28f tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] 10.222.0.55 "GET /compute/v2.1/servers/a34b8bed-3a32-4241-ab88-6b47784d8a75" status: 200 len: 1470 microversion: 2.1 time: 0.146157 Sep 27 17:43:48.374149 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 656/1288] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:43:48 2022] GET /compute/v2.1/servers/a34b8bed-3a32-4241-ab88-6b47784d8a75 => generated 1470 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 27 17:43:49.398402 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-d48b69bc-9b3c-43fc-8117-b332c8ccdbc6 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:43:49.399102 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-d48b69bc-9b3c-43fc-8117-b332c8ccdbc6 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] [instance: a34b8bed-3a32-4241-ab88-6b47784d8a75] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:43:49.405663 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d48b69bc-9b3c-43fc-8117-b332c8ccdbc6 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:43:49.406178 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d48b69bc-9b3c-43fc-8117-b332c8ccdbc6 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:43:49.406622 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d48b69bc-9b3c-43fc-8117-b332c8ccdbc6 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:43:49.407310 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d48b69bc-9b3c-43fc-8117-b332c8ccdbc6 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:43:49.407761 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d48b69bc-9b3c-43fc-8117-b332c8ccdbc6 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:43:49.408184 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d48b69bc-9b3c-43fc-8117-b332c8ccdbc6 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:43:49.539404 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-d48b69bc-9b3c-43fc-8117-b332c8ccdbc6 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753045042fbe4a19b40ccd30bec24cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad3fbebc440463194bf8cf5ac707f13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:43:49.547028 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-d48b69bc-9b3c-43fc-8117-b332c8ccdbc6 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] 10.222.0.55 "GET /compute/v2.1/servers/a34b8bed-3a32-4241-ab88-6b47784d8a75" status: 200 len: 1470 microversion: 2.1 time: 0.153565 Sep 27 17:43:49.547598 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 633/1289] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:43:49 2022] GET /compute/v2.1/servers/a34b8bed-3a32-4241-ab88-6b47784d8a75 => generated 1470 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:43:50.233883 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [req-5683e3d8-ec83-4b6a-9852-fa0dd3533250 req-53d02809-260a-448c-8127-5a88615c0d0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a34b8bed-3a32-4241-ab88-6b47784d8a75", "name": "network-vif-deleted", "tag": "a26d9bd3-3179-4ecb-8b96-d09e33cfa4a1"}]} {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 27 17:43:50.244782 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-5683e3d8-ec83-4b6a-9852-fa0dd3533250 req-53d02809-260a-448c-8127-5a88615c0d0f service nova] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:43:50.245302 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-5683e3d8-ec83-4b6a-9852-fa0dd3533250 req-53d02809-260a-448c-8127-5a88615c0d0f service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:43:50.245728 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [req-5683e3d8-ec83-4b6a-9852-fa0dd3533250 req-53d02809-260a-448c-8127-5a88615c0d0f service nova] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:43:50.258349 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.compute.server_external_events [req-5683e3d8-ec83-4b6a-9852-fa0dd3533250 req-53d02809-260a-448c-8127-5a88615c0d0f service nova] Creating event network-vif-deleted:a26d9bd3-3179-4ecb-8b96-d09e33cfa4a1 for instance a34b8bed-3a32-4241-ab88-6b47784d8a75 on hv-cinder-84914 Sep 27 17:43:50.263591 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [req-5683e3d8-ec83-4b6a-9852-fa0dd3533250 req-53d02809-260a-448c-8127-5a88615c0d0f service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033429 Sep 27 17:43:50.266254 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 657/1290] 10.222.0.55 () {64 vars in 1317 bytes} [Tue Sep 27 17:43:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 27 17:43:50.570007 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-3c863510-0dc3-4743-902b-3fed8a67a8f9 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:43:50.570651 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-3c863510-0dc3-4743-902b-3fed8a67a8f9 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] [instance: a34b8bed-3a32-4241-ab88-6b47784d8a75] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:43:50.577017 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3c863510-0dc3-4743-902b-3fed8a67a8f9 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:43:50.577507 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3c863510-0dc3-4743-902b-3fed8a67a8f9 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:43:50.577945 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3c863510-0dc3-4743-902b-3fed8a67a8f9 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:43:50.578667 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3c863510-0dc3-4743-902b-3fed8a67a8f9 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:43:50.579129 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3c863510-0dc3-4743-902b-3fed8a67a8f9 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:43:50.579550 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3c863510-0dc3-4743-902b-3fed8a67a8f9 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:43:50.610431 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3c863510-0dc3-4743-902b-3fed8a67a8f9 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:43:50.610908 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3c863510-0dc3-4743-902b-3fed8a67a8f9 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:43:50.611337 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3c863510-0dc3-4743-902b-3fed8a67a8f9 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:43:50.611779 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.objects.instance [None req-3c863510-0dc3-4743-902b-3fed8a67a8f9 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Lazy-loading 'fault' on Instance uuid a34b8bed-3a32-4241-ab88-6b47784d8a75 {{(pid=120415) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 27 17:43:50.651622 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-3c863510-0dc3-4743-902b-3fed8a67a8f9 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '753045042fbe4a19b40ccd30bec24cdc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aad3fbebc440463194bf8cf5ac707f13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 27 17:43:50.659107 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-3c863510-0dc3-4743-902b-3fed8a67a8f9 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] 10.222.0.55 "GET /compute/v2.1/servers/a34b8bed-3a32-4241-ab88-6b47784d8a75" status: 200 len: 1304 microversion: 2.1 time: 0.092913 Sep 27 17:43:50.659675 dv-cinder-849143-8-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 634/1291] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:43:50 2022] GET /compute/v2.1/servers/a34b8bed-3a32-4241-ab88-6b47784d8a75 => generated 1304 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 27 17:43:51.684500 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-02597348-6539-431a-9621-b3915a480b76 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Calling method '>' {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 27 17:43:51.685196 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.compute.api [None req-02597348-6539-431a-9621-b3915a480b76 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] [instance: a34b8bed-3a32-4241-ab88-6b47784d8a75] Fetching instance by UUID {{(pid=120416) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 27 17:43:51.691298 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-02597348-6539-431a-9621-b3915a480b76 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:43:51.691777 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-02597348-6539-431a-9621-b3915a480b76 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:43:51.692209 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-02597348-6539-431a-9621-b3915a480b76 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:43:51.692895 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-02597348-6539-431a-9621-b3915a480b76 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Acquiring lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 27 17:43:51.693346 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-02597348-6539-431a-9621-b3915a480b76 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 27 17:43:51.693766 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG oslo_concurrency.lockutils [None req-02597348-6539-431a-9621-b3915a480b76 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Lock "b2a4a363-82fa-43f0-a614-939b4985f9a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120416) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 27 17:43:51.706660 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.wsgi [None req-02597348-6539-431a-9621-b3915a480b76 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] HTTP exception thrown: Instance a34b8bed-3a32-4241-ab88-6b47784d8a75 could not be found. Sep 27 17:43:51.708285 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-02597348-6539-431a-9621-b3915a480b76 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Request method failure captured: Sep 27 17:43:51.708285 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: request: GET /compute/v2.1/servers/a34b8bed-3a32-4241-ab88-6b47784d8a75 HTTP/1.1 Sep 27 17:43:51.708285 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Accept: application/json Sep 27 17:43:51.708285 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Accept-Encoding: identity Sep 27 17:43:51.708285 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Connection: close Sep 27 17:43:51.708285 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Content-Length: 0 Sep 27 17:43:51.708285 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Content-Type: application/json Sep 27 17:43:51.708285 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Host: 10.222.0.55 Sep 27 17:43:51.708285 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: Openstack-System-Scope: None Sep 27 17:43:51.708285 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: User-Agent: python-urllib3/1.26.12 Sep 27 17:43:51.708285 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Auth-Token: gAAAAABjMzZDsBUeJD2Ve1oNw_myaDMNg7VAT_2-eTof0ThqfNv2O-_O_LyUz6v_2Ty4B1lQiIUNo3c2Nl20jilmzqn1Bgt6Bj59xriZ5Z1MXyL3cYKrpG39_VfDZiGjli00dUH0n6TtcQ7pFzJdE2gakgQCsyWgubiGW4Xara7GmFPhxstQ6KA Sep 27 17:43:51.708285 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Domain-Id: None Sep 27 17:43:51.708285 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Domain-Name: None Sep 27 17:43:51.708285 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Identity-Status: Confirmed Sep 27 17:43:51.708285 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Is-Admin-Project: True Sep 27 17:43:51.708285 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Domain-Id: default Sep 27 17:43:51.708285 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Domain-Name: Default Sep 27 17:43:51.708285 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Id: aad3fbebc440463194bf8cf5ac707f13 Sep 27 17:43:51.708285 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Project-Name: tempest-VolumesNegativeTest-345729415 Sep 27 17:43:51.708285 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Role: reader,member Sep 27 17:43:51.708285 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Roles: reader,member Sep 27 17:43:51.710139 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/aad3fbebc440463194bf8cf5ac707f13"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_aad3fbebc440463194bf8cf5ac707f13", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/aad3fbebc440463194bf8cf5ac707f13"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/aad3fbebc440463194bf8cf5ac707f13"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}] Sep 27 17:43:51.710139 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Tenant: tempest-VolumesNegativeTest-345729415 Sep 27 17:43:51.710139 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Tenant-Id: aad3fbebc440463194bf8cf5ac707f13 Sep 27 17:43:51.710139 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-Tenant-Name: tempest-VolumesNegativeTest-345729415 Sep 27 17:43:51.710139 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User: tempest-VolumesNegativeTest-345729415-project Sep 27 17:43:51.710139 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Domain-Id: default Sep 27 17:43:51.710139 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Domain-Name: Default Sep 27 17:43:51.710139 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Id: 753045042fbe4a19b40ccd30bec24cdc Sep 27 17:43:51.710139 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: X-User-Name: tempest-VolumesNegativeTest-345729415-project Sep 27 17:43:51.710139 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: method: > Sep 27 17:43:51.710139 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: exception: Instance a34b8bed-3a32-4241-ab88-6b47784d8a75 could not be found. Sep 27 17:43:51.710139 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: action_args: {'id': 'a34b8bed-3a32-4241-ab88-6b47784d8a75'} Sep 27 17:43:51.711311 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: {{(pid=120416) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 27 17:43:51.711311 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:43:51.711311 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 27 17:43:51.711311 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 27 17:43:51.711311 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 27 17:43:51.711311 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 27 17:43:51.711311 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 27 17:43:51.711311 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 27 17:43:51.711311 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 27 17:43:51.711311 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 27 17:43:51.711311 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a34b8bed-3a32-4241-ab88-6b47784d8a75 could not be found. Sep 27 17:43:51.711311 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:43:51.711311 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:43:51.711311 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:43:51.711311 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:43:51.711311 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:43:51.711311 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:43:51.711311 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 27 17:43:51.711311 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 27 17:43:51.711311 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 27 17:43:51.713051 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 27 17:43:51.713051 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 27 17:43:51.713051 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 27 17:43:51.713051 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 27 17:43:51.713051 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 27 17:43:51.713051 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 27 17:43:51.713051 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 27 17:43:51.713051 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a34b8bed-3a32-4241-ab88-6b47784d8a75 could not be found. Sep 27 17:43:51.713051 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:43:51.713051 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 27 17:43:51.713051 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:43:51.713051 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 27 17:43:51.713051 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 27 17:43:51.713051 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 27 17:43:51.713051 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 27 17:43:51.713051 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 27 17:43:51.713051 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a34b8bed-3a32-4241-ab88-6b47784d8a75 could not be found. Sep 27 17:43:51.713051 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: ERROR nova.api.openstack.wsgi Sep 27 17:43:51.714774 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: DEBUG nova.api.openstack.wsgi [None req-02597348-6539-431a-9621-b3915a480b76 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] Returning 404 to user: Instance a34b8bed-3a32-4241-ab88-6b47784d8a75 could not be found. {{(pid=120416) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 27 17:43:51.714774 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: INFO nova.api.openstack.requestlog [None req-02597348-6539-431a-9621-b3915a480b76 tempest-VolumesNegativeTest-345729415 tempest-VolumesNegativeTest-345729415-project] 10.222.0.55 "GET /compute/v2.1/servers/a34b8bed-3a32-4241-ab88-6b47784d8a75" status: 404 len: 111 microversion: 2.1 time: 0.029912 Sep 27 17:43:51.714774 dv-cinder-849143-8-iscsi devstack@n-api.service[120416]: [pid: 120416|app: 0|req: 658/1292] 10.222.0.55 () {58 vars in 1236 bytes} [Tue Sep 27 17:43:51 2022] GET /compute/v2.1/servers/a34b8bed-3a32-4241-ab88-6b47784d8a75 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0)